Showing 1–49 of 49 results for author: Cohen, S N

Generalization Error of Graph Neural Networks in the Mean-field Regime

Authors: Gholamali Aminian, Yixuan He, Gesine Reinert, Łukasz Szpruch, Samuel N. Cohen

Abstract: This work provides a theoretical framework for assessing the generalization error of graph neural networks in the over-parameterized regime, where the number of parameters surpasses the quantity of data points. We explore two widely utilized types of graph neural networks: graph convolutional neural networks and message passing graph neural networks. Prior to this study, existing bounds on the gen… ▽ More This work provides a theoretical framework for assessing the generalization error of graph neural networks in the over-parameterized regime, where the number of parameters surpasses the quantity of data points. We explore two widely utilized types of graph neural networks: graph convolutional neural networks and message passing graph neural networks. Prior to this study, existing bounds on the generalization error in the over-parametrized regime were uninformative, limiting our understanding of over-parameterized network performance. Our novel approach involves deriving upper bounds within the mean-field regime for evaluating the generalization error of these graph neural networks. We establish upper bounds with a convergence rate of $O(1/n)$, where $n$ is the number of graph samples. These upper bounds offer a theoretical assurance of the networks' performance on unseen data in the challenging over-parameterized regime and overall contribute to our understanding of their performance. △ Less

Submitted 1 July, 2024; v1 submitted 10 February, 2024; originally announced February 2024.

Comments: Accepted in ICML 2024

Optimal adaptive control with separable drift uncertainty

Authors: Samuel N. Cohen, Christoph Knochenhauer, Alexander Merkel

Abstract: We consider a problem of stochastic optimal control with separable drift uncertainty in strong formulation on a finite horizon. The drift coefficient of the state $Y^{u}$ is multiplicatively influenced by an unknown random variable $λ$, while admissible controls $u$ are required to be adapted to the observation filtration. Choosing a control actively influences the state and information acquisitio… ▽ More We consider a problem of stochastic optimal control with separable drift uncertainty in strong formulation on a finite horizon. The drift coefficient of the state $Y^{u}$ is multiplicatively influenced by an unknown random variable $λ$, while admissible controls $u$ are required to be adapted to the observation filtration. Choosing a control actively influences the state and information acquisition simultaneously and comes with a learning effect. The problem, initially non-Markovian, is embedded into a higher-dimensional Markovian, full information control problem with control-dependent filtration and noise. To that problem, we apply the stochastic Perron method to characterize the value function as the unique viscosity solution to the HJB equation, explicitly construct $\varepsilon$-optimal controls and show that the values of strong and weak formulations agree. Numerical illustrations show a significant difference between the adaptive control and the certainty equivalence control. △ Less

Submitted 10 November, 2023; v1 submitted 13 September, 2023; originally announced September 2023.

Hyperbolic contractivity and the Hilbert metric on probability measures

Authors: Samuel N. Cohen, Eliana Fausti

Abstract: This paper gives a self-contained introduction to the Hilbert projective metric $\mathcal{H}$ and its fundamental properties, with a particular focus on the space of probability measures. We start by defining the Hilbert pseudo-metric on convex cones, focusing mainly on dual formulations of $\mathcal{H}$ . We show that linear operators on convex cones contract in the distance given by the hyperbol… ▽ More This paper gives a self-contained introduction to the Hilbert projective metric $\mathcal{H}$ and its fundamental properties, with a particular focus on the space of probability measures. We start by defining the Hilbert pseudo-metric on convex cones, focusing mainly on dual formulations of $\mathcal{H}$ . We show that linear operators on convex cones contract in the distance given by the hyperbolic tangent of $\mathcal{H}$, which in particular implies Birkhoff's classical contraction result for $\mathcal{H}$. Turning to spaces of probability measures, where $\mathcal{H}$ is a metric, we analyse the dual formulation of $\mathcal{H}$ in the general setting, and explore the geometry of the probability simplex under $\mathcal{H}$ in the special case of discrete probability measures. Throughout, we compare $\mathcal{H}$ with other distances between probability measures. In particular, we show how convergence in $\mathcal{H}$ implies convergence in total variation, $p$-Wasserstein distance, and any $f$-divergence. Furthermore, we derive a novel sharp bound for the total variation between two probability measures in terms of their Hilbert distance. △ Less

Submitted 5 September, 2023; originally announced September 2023.

Comments: 29 pages, 3 figures

MSC Class: 47A35; 15B51; 60B10; 52B12; 62B11; 94A15

Mean-field Analysis of Generalization Errors

Authors: Gholamali Aminian, Samuel N. Cohen, Łukasz Szpruch

Abstract: We propose a novel framework for exploring weak and $L_2$ generalization errors of algorithms through the lens of differential calculus on the space of probability measures. Specifically, we consider the KL-regularized empirical risk minimization problem and establish generic conditions under which the generalization error convergence rate, when training on a sample of size $n$, is… ▽ More We propose a novel framework for exploring weak and $L_2$ generalization errors of algorithms through the lens of differential calculus on the space of probability measures. Specifically, we consider the KL-regularized empirical risk minimization problem and establish generic conditions under which the generalization error convergence rate, when training on a sample of size $n$, is $\mathcal{O}(1/n)$. In the context of supervised learning with a one-hidden layer neural network in the mean-field regime, these conditions are reflected in suitable integrability and regularity assumptions on the loss and activation functions. △ Less

Submitted 20 June, 2023; originally announced June 2023.

Comments: 49 pages

MSC Class: 62B10; 60F99; 49N80; 46N30

Nowcasting with signature methods

Authors: Samuel N. Cohen, Silvia Lui, Will Malpass, Giulia Mantoan, Lars Nesheim, Áureo de Paula, Andrew Reeves, Craig Scott, Emma Small, Lingyi Yang

Abstract: Key economic variables are often published with a significant delay of over a month. The nowcasting literature has arisen to provide fast, reliable estimates of delayed economic indicators and is closely related to filtering methods in signal processing. The path signature is a mathematical object which captures geometric properties of sequential data; it naturally handles missing data from mixed… ▽ More Key economic variables are often published with a significant delay of over a month. The nowcasting literature has arisen to provide fast, reliable estimates of delayed economic indicators and is closely related to filtering methods in signal processing. The path signature is a mathematical object which captures geometric properties of sequential data; it naturally handles missing data from mixed frequency and/or irregular sampling -- issues often encountered when merging multiple data sources -- by embedding the observed data in continuous time. Calculating path signatures and using them as features in models has achieved state-of-the-art results in fields such as finance, medicine, and cyber security. We look at the nowcasting problem by applying regression on signatures, a simple linear model on these nonlinear objects that we show subsumes the popular Kalman filter. We quantify the performance via a simulation exercise, and through application to nowcasting US GDP growth, where we see a lower error than a dynamic factor model based on the New York Fed staff nowcasting model. Finally we demonstrate the flexibility of this method by applying regression on signatures to nowcast weekly fuel prices using daily data. Regression on signatures is an easy-to-apply approach that allows great flexibility for data with complex sampling patterns. △ Less

Submitted 17 May, 2023; originally announced May 2023.

Comments: Our implementation of this algorithm in Python to reproduce the results is available at https://github.com/alan-turing-institute/Nowcasting_with_signatures To apply this method for your application, see also SigNow at https://github.com/datasciencecampus/SigNow_ONS_Turing

MSC Class: 60L10; 60L90; 60G35; 62M10; 62M20

Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equations

Authors: Deqing Jiang, Justin Sirignano, Samuel N. Cohen

Abstract: Numerically solving high-dimensional partial differential equations (PDEs) is a major challenge. Conventional methods, such as finite difference methods, are unable to solve high-dimensional PDEs due to the curse-of-dimensionality. A variety of deep learning methods have been recently developed to try and solve high-dimensional PDEs by approximating the solution using a neural network. In this pap… ▽ More Numerically solving high-dimensional partial differential equations (PDEs) is a major challenge. Conventional methods, such as finite difference methods, are unable to solve high-dimensional PDEs due to the curse-of-dimensionality. A variety of deep learning methods have been recently developed to try and solve high-dimensional PDEs by approximating the solution using a neural network. In this paper, we prove global convergence for one of the commonly-used deep learning algorithms for solving PDEs, the Deep Galerkin Method (DGM). DGM trains a neural network approximator to solve the PDE using stochastic gradient descent. We prove that, as the number of hidden units in the single-layer network goes to infinity (i.e., in the ``wide network limit"), the trained neural network converges to the solution of an infinite-dimensional linear ordinary differential equation (ODE). The PDE residual of the limiting approximator converges to zero as the training time $\rightarrow \infty$. Under mild assumptions, this convergence also implies that the neural network approximator converges to the solution of the PDE. A closely related class of deep learning methods for PDEs is Physics Informed Neural Networks (PINNs). Using the same mathematical techniques, we can prove a similar global convergence result for the PINN neural network approximators. Both proofs require analyzing a kernel function in the limit ODE governing the evolution of the limit neural network approximator. A key technical challenge is that the kernel function, which is a composition of the PDE operator and the neural tangent kernel (NTK) operator, lacks a spectral gap, therefore requiring a careful analysis of its properties. △ Less

Submitted 10 May, 2023; originally announced May 2023.

Exponential contractions and robustness for approximate Wonham filters

Authors: Samuel N. Cohen, Eliana Fausti

Abstract: We consider the problem of estimating the state of a continuous-time Markov chain from noisy observations. We show that the corresponding optimal filter is strictly contracting pathwise, when considered in the Hilbert projective space, and give explicit deterministic and pathwise rates of convergence. Using this, we provide alternative proofs of the robustness of optimal filters, improving on know… ▽ More We consider the problem of estimating the state of a continuous-time Markov chain from noisy observations. We show that the corresponding optimal filter is strictly contracting pathwise, when considered in the Hilbert projective space, and give explicit deterministic and pathwise rates of convergence. Using this, we provide alternative proofs of the robustness of optimal filters, improving on known error estimates, and derive rigorous and computable error bounds for approximate filters. △ Less

Submitted 3 May, 2023; originally announced May 2023.

Comments: 48 pages, 3 figures

A Framework for Auditable Synthetic Data Generation

Authors: Florimond Houssiau, Samuel N. Cohen, Lukasz Szpruch, Owen Daniel, Michaela G. Lawrence, Robin Mitra, Henry Wilde, Callum Mole

Abstract: Synthetic data has gained significant momentum thanks to sophisticated machine learning tools that enable the synthesis of high-dimensional datasets. However, many generation techniques do not give the data controller control over what statistical patterns are captured, leading to concerns over privacy protection. While synthetic records are not linked to a particular real-world individual, they c… ▽ More Synthetic data has gained significant momentum thanks to sophisticated machine learning tools that enable the synthesis of high-dimensional datasets. However, many generation techniques do not give the data controller control over what statistical patterns are captured, leading to concerns over privacy protection. While synthetic records are not linked to a particular real-world individual, they can reveal information about users indirectly which may be unacceptable for data owners. There is thus a need to empirically verify the privacy of synthetic data -- a particularly challenging task in high-dimensional data. In this paper we present a general framework for synthetic data generation that gives data controllers full control over which statistical properties the synthetic data ought to preserve, what exact information loss is acceptable, and how to quantify it. The benefits of the approach are that (1) one can generate synthetic data that results in high utility for a given task, while (2) empirically validating that only statistics considered safe by the data curator are used to generate the data. We thus show the potential for synthetic data to be an effective means of releasing confidential data safely, while retaining useful information for analysts. △ Less

Submitted 21 November, 2022; originally announced November 2022.

TAPAS: a Toolbox for Adversarial Privacy Auditing of Synthetic Data

Authors: Florimond Houssiau, James Jordon, Samuel N. Cohen, Owen Daniel, Andrew Elliott, James Geddes, Callum Mole, Camila Rangel-Smith, Lukasz Szpruch

Abstract: Personal data collected at scale promises to improve decision-making and accelerate innovation. However, sharing and using such data raises serious privacy concerns. A promising solution is to produce synthetic data, artificial records to share instead of real data. Since synthetic records are not linked to real persons, this intuitively prevents classical re-identification attacks. However, this… ▽ More Personal data collected at scale promises to improve decision-making and accelerate innovation. However, sharing and using such data raises serious privacy concerns. A promising solution is to produce synthetic data, artificial records to share instead of real data. Since synthetic records are not linked to real persons, this intuitively prevents classical re-identification attacks. However, this is insufficient to protect privacy. We here present TAPAS, a toolbox of attacks to evaluate synthetic data privacy under a wide range of scenarios. These attacks include generalizations of prior works and novel attacks. We also introduce a general framework for reasoning about privacy threats to synthetic data and showcase TAPAS on several examples. △ Less

Submitted 11 November, 2022; originally announced November 2022.

Comments: Published at the SyntheticData4ML Neurips workshop

Hedging option books using neural-SDE market models

Authors: Samuel N. Cohen, Christoph Reisinger, Sheng Wang

Abstract: We study the capability of arbitrage-free neural-SDE market models to yield effective strategies for hedging options. In particular, we derive sensitivity-based and minimum-variance-based hedging strategies using these models and examine their performance when applied to various option portfolios using real-world data. Through backtesting analysis over typical and stressed market periods, we show… ▽ More We study the capability of arbitrage-free neural-SDE market models to yield effective strategies for hedging options. In particular, we derive sensitivity-based and minimum-variance-based hedging strategies using these models and examine their performance when applied to various option portfolios using real-world data. Through backtesting analysis over typical and stressed market periods, we show that neural-SDE market models achieve lower hedging errors than Black--Scholes delta and delta-vega hedging consistently over time, and are less sensitive to the tenor choice of hedging instruments. In addition, hedging using market models leads to similar performance to hedging using Heston models, while the former tends to be more robust during stressed market periods. △ Less

Submitted 31 May, 2022; originally announced May 2022.

MSC Class: 91B28; 91B70; 62M45; 62P05

Synthetic Data -- what, why and how?

Authors: James Jordon, Lukasz Szpruch, Florimond Houssiau, Mirko Bottarelli, Giovanni Cherubin, Carsten Maple, Samuel N. Cohen, Adrian Weller

Abstract: This explainer document aims to provide an overview of the current state of the rapidly expanding work on synthetic data technologies, with a particular focus on privacy. The article is intended for a non-technical audience, though some formal definitions have been given to provide clarity to specialists. This article is intended to enable the reader to quickly become familiar with the notion of s… ▽ More This explainer document aims to provide an overview of the current state of the rapidly expanding work on synthetic data technologies, with a particular focus on privacy. The article is intended for a non-technical audience, though some formal definitions have been given to provide clarity to specialists. This article is intended to enable the reader to quickly become familiar with the notion of synthetic data, as well as understand some of the subtle intricacies that come with it. We do believe that synthetic data is a very useful tool, and our hope is that this report highlights that, while drawing attention to nuances that can easily be overlooked in its deployment. △ Less

Submitted 6 May, 2022; originally announced May 2022.

Comments: Commissioned by the Royal Society. 57 pages 2 figures

Neural Q-learning for solving PDEs

Authors: Samuel N. Cohen, Deqing Jiang, Justin Sirignano

Abstract: Solving high-dimensional partial differential equations (PDEs) is a major challenge in scientific computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning. Our "Q-PDE" algorithm is mesh-free and therefore has the potential to overcome the curse of dimensionality. Using a neural tangent kernel (NTK) approach, we prove… ▽ More Solving high-dimensional partial differential equations (PDEs) is a major challenge in scientific computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning. Our "Q-PDE" algorithm is mesh-free and therefore has the potential to overcome the curse of dimensionality. Using a neural tangent kernel (NTK) approach, we prove that the neural network approximator for the PDE solution, trained with the Q-PDE algorithm, converges to the trajectory of an infinite-dimensional ordinary differential equation (ODE) as the number of hidden units $\rightarrow \infty$. For monotone PDE (i.e. those given by monotone operators, which may be nonlinear), despite the lack of a spectral gap in the NTK, we then prove that the limit neural network, which satisfies the infinite-dimensional ODE, converges in $L^2$ to the PDE solution as the training time $\rightarrow \infty$. More generally, we can prove that any fixed point of the wide-network limit for the Q-PDE algorithm is a solution of the PDE (not necessarily under the monotone condition). The numerical performance of the Q-PDE algorithm is studied for several elliptic PDEs. △ Less

Submitted 24 June, 2023; v1 submitted 31 March, 2022; originally announced March 2022.

MSC Class: 65N12; 62M45; 37N30; 60H30

Estimating risks of option books using neural-SDE market models

Authors: Samuel N. Cohen, Christoph Reisinger, Sheng Wang

Abstract: In this paper, we examine the capacity of an arbitrage-free neural-SDE market model to produce realistic scenarios for the joint dynamics of multiple European options on a single underlying. We subsequently demonstrate its use as a risk simulation engine for option portfolios. Through backtesting analysis, we show that our models are more computationally efficient and accurate for evaluating the V… ▽ More In this paper, we examine the capacity of an arbitrage-free neural-SDE market model to produce realistic scenarios for the joint dynamics of multiple European options on a single underlying. We subsequently demonstrate its use as a risk simulation engine for option portfolios. Through backtesting analysis, we show that our models are more computationally efficient and accurate for evaluating the Value-at-Risk (VaR) of option portfolios, with better coverage performance and less procyclicality than standard filtered historical simulation approaches. △ Less

Submitted 14 February, 2022; originally announced February 2022.

MSC Class: 91B28; 91B70; 62M45; 62P05

Gradient-based estimation of linear Hawkes processes with general kernels

Authors: Álvaro Cartea, Samuel N. Cohen, Saad Labyad

Abstract: Linear multivariate Hawkes processes (MHP) are a fundamental class of point processes with self-excitation. When estimating parameters for these processes, a difficulty is that the two main error functionals, the log-likelihood and the least squares error (LSE), as well as the evaluation of their gradients, have a quadratic complexity in the number of observed events. In practice, this prohibits t… ▽ More Linear multivariate Hawkes processes (MHP) are a fundamental class of point processes with self-excitation. When estimating parameters for these processes, a difficulty is that the two main error functionals, the log-likelihood and the least squares error (LSE), as well as the evaluation of their gradients, have a quadratic complexity in the number of observed events. In practice, this prohibits the use of exact gradient-based algorithms for parameter estimation. We construct an adaptive stratified sampling estimator of the gradient of the LSE. This results in a fast parametric estimation method for MHP with general kernels, applicable to large datasets, which compares favourably with existing methods. △ Less

Submitted 20 November, 2021; originally announced November 2021.

Comments: 51 pages, 17 figures, 1 table

MSC Class: 60G55; 62M09; 90C52; 93E10

Identifiability in inverse reinforcement learning

Authors: Haoyang Cao, Samuel N. Cohen, Lukasz Szpruch

Abstract: Inverse reinforcement learning attempts to reconstruct the reward function in a Markov decision problem, using observations of agent actions. As already observed in Russell [1998] the problem is ill-posed, and the reward function is not identifiable, even under the presence of perfect information about optimal behavior. We provide a resolution to this non-identifiability for problems with entropy… ▽ More Inverse reinforcement learning attempts to reconstruct the reward function in a Markov decision problem, using observations of agent actions. As already observed in Russell [1998] the problem is ill-posed, and the reward function is not identifiable, even under the presence of perfect information about optimal behavior. We provide a resolution to this non-identifiability for problems with entropy regularization. For a given environment, we fully characterize the reward functions leading to a given policy and demonstrate that, given demonstrations of actions for the same reward under two distinct discount factors, or under sufficiently different environments, the unobserved reward can be recovered up to a constant. We also give general necessary and sufficient conditions for reconstruction of time-homogeneous rewards on finite horizons, and for action-independent rewards, generalizing recent results of Kim et al. [2021] and Fu et al. [2018]. △ Less

Submitted 8 November, 2021; v1 submitted 7 June, 2021; originally announced June 2021.

MSC Class: 2020: 49N45; 93B30; 93E12; 93B15; 49N10; 90C40; 60J10; 62M05

Arbitrage-free neural-SDE market models

Authors: Samuel N. Cohen, Christoph Reisinger, Sheng Wang

Abstract: Modelling joint dynamics of liquid vanilla options is crucial for arbitrage-free pricing of illiquid derivatives and managing risks of option trade books. This paper develops a nonparametric model for the European options book respecting underlying financial constraints and while being practically implementable. We derive a state space for prices which are free from static (or model-independent) a… ▽ More Modelling joint dynamics of liquid vanilla options is crucial for arbitrage-free pricing of illiquid derivatives and managing risks of option trade books. This paper develops a nonparametric model for the European options book respecting underlying financial constraints and while being practically implementable. We derive a state space for prices which are free from static (or model-independent) arbitrage and study the inference problem where a model is learnt from discrete time series data of stock and option prices. We use neural networks as function approximators for the drift and diffusion of the modelled SDE system, and impose constraints on the neural nets such that no-arbitrage conditions are preserved. In particular, we give methods to calibrate \textit{neural SDE} models which are guaranteed to satisfy a set of linear inequalities. We validate our approach with numerical experiments using data generated from a Heston stochastic local volatility model. △ Less

Submitted 23 August, 2021; v1 submitted 23 May, 2021; originally announced May 2021.

MSC Class: 91B28; 91B70; 62M45; 62P05

Black-box model risk in finance

Authors: Samuel N. Cohen, Derek Snow, Lukasz Szpruch

Abstract: Machine learning models are increasingly used in a wide variety of financial settings. The difficulty of understanding the inner workings of these systems, combined with their wide applicability, has the potential to lead to significant new risks for users; these risks need to be understood and quantified. In this sub-chapter, we will focus on a well studied application of machine learning techniq… ▽ More Machine learning models are increasingly used in a wide variety of financial settings. The difficulty of understanding the inner workings of these systems, combined with their wide applicability, has the potential to lead to significant new risks for users; these risks need to be understood and quantified. In this sub-chapter, we will focus on a well studied application of machine learning techniques, to pricing and hedging of financial options. Our aim will be to highlight the various sources of risk that the introduction of machine learning emphasises or de-emphasises, and the possible risk mitigation and management strategies that are available. △ Less

Submitted 9 February, 2021; originally announced February 2021.

Asymptotic Randomised Control with applications to bandits

Authors: Samuel N. Cohen, Tanut Treetanthiploet

Abstract: We consider a general multi-armed bandit problem with correlated (and simple contextual and restless) elements, as a relaxed control problem. By introducing an entropy regularisation, we obtain a smooth asymptotic approximation to the value function. This yields a novel semi-index approximation of the optimal decision process. This semi-index can be interpreted as explicitly balancing an explorati… ▽ More We consider a general multi-armed bandit problem with correlated (and simple contextual and restless) elements, as a relaxed control problem. By introducing an entropy regularisation, we obtain a smooth asymptotic approximation to the value function. This yields a novel semi-index approximation of the optimal decision process. This semi-index can be interpreted as explicitly balancing an exploration-exploitation trade-off as in the optimistic (UCB) principle where the learning premium explicitly describes asymmetry of information available in the environment and non-linearity in the reward function. Performance of the resulting Asymptotic Randomised Control (ARC) algorithm compares favourably well with other approaches to correlated multi-armed bandits. △ Less

Submitted 3 September, 2022; v1 submitted 14 October, 2020; originally announced October 2020.

MSC Class: 60J20; 93E35; 90C40; 41A58

Detecting and repairing arbitrage in traded option prices

Authors: Samuel N. Cohen, Christoph Reisinger, Sheng Wang

Abstract: Option price data are used as inputs for model calibration, risk-neutral density estimation and many other financial applications. The presence of arbitrage in option price data can lead to poor performance or even failure of these tasks, making pre-processing of the data to eliminate arbitrage necessary. Most attention in the relevant literature has been devoted to arbitrage-free smoothing and fi… ▽ More Option price data are used as inputs for model calibration, risk-neutral density estimation and many other financial applications. The presence of arbitrage in option price data can lead to poor performance or even failure of these tasks, making pre-processing of the data to eliminate arbitrage necessary. Most attention in the relevant literature has been devoted to arbitrage-free smoothing and filtering (i.e. removing) of data. In contrast to smoothing, which typically changes nearly all data, or filtering, which truncates data, we propose to repair data by only necessary and minimal changes. We formulate the data repair as a linear programming (LP) problem, where the no-arbitrage relations are constraints, and the objective is to minimise prices' changes within their bid and ask price bounds. Through empirical studies, we show that the proposed arbitrage repair method gives sparse perturbations on data, and is fast when applied to real world large-scale problems due to the LP formulation. In addition, we show that removing arbitrage from prices data by our repair method can improve model calibration with enhanced robustness and reduced calibration error. △ Less

Submitted 21 August, 2020; originally announced August 2020.

Comments: Our implementation of this algorithm in Python is available in the repository https://github.com/vicaws/arbitragerepair

MSC Class: 91G20; 90C90

Gittins' theorem under uncertainty

Authors: Samuel N. Cohen, Tanut Treetanthiploet

Abstract: We study dynamic allocation problems for discrete time multi-armed bandits under uncertainty, based on the the theory of nonlinear expectations. We show that, under strong independence of the bandits and with some relaxation in the definition of optimality, a Gittins allocation index gives optimal choices. This involves studying the interaction of our uncertainty with controls which determine the… ▽ More We study dynamic allocation problems for discrete time multi-armed bandits under uncertainty, based on the the theory of nonlinear expectations. We show that, under strong independence of the bandits and with some relaxation in the definition of optimality, a Gittins allocation index gives optimal choices. This involves studying the interaction of our uncertainty with controls which determine the filtration. We also run a simple numerical example which illustrates the interaction between the willingness to explore and uncertainty aversion of the agent when making decisions. △ Less

Submitted 14 June, 2021; v1 submitted 12 July, 2019; originally announced July 2019.

MSC Class: 93E35; 60G40; 91B32; 91B70

Bounding quantiles of Wasserstein distance between true and empirical measure

Authors: Samuel N. Cohen, Martin N. A. Tegnér, Johannes Wiesel

Abstract: Consider the empirical measure, $\hat{\mathbb{P}}_N$, associated to $N$ i.i.d. samples of a given probability distribution $\mathbb{P}$ on the unit interval. For fixed $\mathbb{P}$ the Wasserstein distance between $\hat{\mathbb{P}}_N$ and $\mathbb{P}$ is a random variable on the sample space $[0,1]^N$. Our main result is that its normalised quantiles are asymptotically maximised when $\mathbb{P}$… ▽ More Consider the empirical measure, $\hat{\mathbb{P}}_N$, associated to $N$ i.i.d. samples of a given probability distribution $\mathbb{P}$ on the unit interval. For fixed $\mathbb{P}$ the Wasserstein distance between $\hat{\mathbb{P}}_N$ and $\mathbb{P}$ is a random variable on the sample space $[0,1]^N$. Our main result is that its normalised quantiles are asymptotically maximised when $\mathbb{P}$ is a convex combination between the uniform distribution supported on the two points $\{0,1\}$ and the uniform distribution on the unit interval $[0,1]$. This allows us to obtain explicit asymptotic confidence regions for the underlying measure $\mathbb{P}$. We also suggest extensions to higher dimensions with numerical evidence. △ Less

Submitted 3 July, 2019; originally announced July 2019.

MSC Class: 60F05; 62G15; 60E15

Pathwise Stochastic Control with Applications to Robust Filtering

Authors: Andrew L. Allan, Samuel N. Cohen

Abstract: We study the problem of pathwise stochastic optimal control, where the optimization is performed for each fixed realisation of the driving noise, by phrasing the problem in terms of the optimal control of rough differential equations. We investigate the degeneracy phenomenon induced by directly controlling the coefficient of the noise term, and propose a simple procedure to resolve this degeneracy… ▽ More We study the problem of pathwise stochastic optimal control, where the optimization is performed for each fixed realisation of the driving noise, by phrasing the problem in terms of the optimal control of rough differential equations. We investigate the degeneracy phenomenon induced by directly controlling the coefficient of the noise term, and propose a simple procedure to resolve this degeneracy whilst retaining dynamic programming. As an application, we use pathwise stochastic control in the context of stochastic filtering to construct filters which are robust to parameter uncertainty, demonstrating an original application of rough path theory to statistics. △ Less

Submitted 12 June, 2019; v1 submitted 14 February, 2019; originally announced February 2019.

Comments: 42 pages

MSC Class: 60H99; 93E20; 93E11

Switching Cost Models as Hypothesis Tests

Authors: Samuel N. Cohen, Timo Henckel, Gordon D. Menzies, Johannes Muhle-Karbe, Daniel J. Zizzo

Abstract: We relate models based on costs of switching beliefs (e.g. due to inattention) to hypothesis tests. Specifically, for an inference problem with a penalty for mistakes and for switching the inferred value, a band of inaction is optimal. We show this band is equivalent to a confidence interval, and therefore to a two-sided hypothesis test. We relate models based on costs of switching beliefs (e.g. due to inattention) to hypothesis tests. Specifically, for an inference problem with a penalty for mistakes and for switching the inferred value, a band of inaction is optimal. We show this band is equivalent to a confidence interval, and therefore to a two-sided hypothesis test. △ Less

Submitted 29 August, 2018; originally announced August 2018.

European Option Pricing with Stochastic Volatility models under Parameter Uncertainty

Authors: Samuel N. Cohen, Martin Tegnér

Abstract: We consider stochastic volatility models under parameter uncertainty and investigate how model derived prices of European options are affected. We let the pricing parameters evolve dynamically in time within a specified region, and formalise the problem as a control problem where the control acts on the parameters to maximise/minimise the option value. Through a dual representation with backward s… ▽ More We consider stochastic volatility models under parameter uncertainty and investigate how model derived prices of European options are affected. We let the pricing parameters evolve dynamically in time within a specified region, and formalise the problem as a control problem where the control acts on the parameters to maximise/minimise the option value. Through a dual representation with backward stochastic differential equations, we obtain explicit equations for Heston's model and investigate several numerical solutions thereof. In an empirical study, we apply our results to market data from the S&P 500 index where the model is estimated to historical asset prices. We find that the conservative model-prices cover 98% of the considered market-prices for a set of European call options. △ Less

Submitted 10 July, 2018; originally announced July 2018.

Parameter Uncertainty in the Kalman-Bucy Filter

Authors: Andrew L. Allan, Samuel N. Cohen

Abstract: In standard treatments of stochastic filtering one first has to estimate the values of the parameters of the model. Simply running the filter without considering the reliability of this estimate does not take into account this additional source of statistical uncertainty. We propose an approach to address this problem when working with the continuous-time Kalman-Bucy filter. We show how our approa… ▽ More In standard treatments of stochastic filtering one first has to estimate the values of the parameters of the model. Simply running the filter without considering the reliability of this estimate does not take into account this additional source of statistical uncertainty. We propose an approach to address this problem when working with the continuous-time Kalman-Bucy filter. We show how our approach may be reformulated as an optimal control problem, and proceed to analyse the corresponding value function in some detail. In particular we present a novel uniqueness result for the associated Hamilton-Jacobi-Bellman equation. △ Less

Submitted 3 September, 2018; v1 submitted 5 October, 2017; originally announced October 2017.

Comments: 29 pages, 4 figures

MSC Class: 62M20; 60G35; 93E11; 62F86; 49L25

Data and uncertainty in extreme risks - a nonlinear expectations approach

Authors: Samuel N. Cohen

Abstract: Estimation of tail quantities, such as expected shortfall or Value at Risk, is a difficult problem. We show how the theory of nonlinear expectations, in particular the Data-robust expectation introduced in [5], can assist in the quantification of statistical uncertainty for these problems. However, when we are in a heavy-tailed context (in particular when our data are described by a Pareto distrib… ▽ More Estimation of tail quantities, such as expected shortfall or Value at Risk, is a difficult problem. We show how the theory of nonlinear expectations, in particular the Data-robust expectation introduced in [5], can assist in the quantification of statistical uncertainty for these problems. However, when we are in a heavy-tailed context (in particular when our data are described by a Pareto distribution, as is common in much of extreme value theory), the theory of [5] is insufficient, and requires an additional regularization step which we introduce. By asking whether this regularization is possible, we obtain a qualitative requirement for reliable estimation of tail quantities and risk measures, in a Pareto setting. △ Less

Submitted 14 February, 2018; v1 submitted 23 May, 2017; originally announced May 2017.

MSC Class: 62F86; 60A86; 62G32; 91G70

Data-driven nonlinear expectations for statistical uncertainty in decisions

Authors: Samuel N. Cohen

Abstract: In stochastic decision problems, one often wants to estimate the underlying probability measure statistically, and then to use this estimate as a basis for decisions. We shall consider how the uncertainty in this estimation can be explicitly and consistently incorporated in the valuation of decisions, using the theory of nonlinear expectations. In stochastic decision problems, one often wants to estimate the underlying probability measure statistically, and then to use this estimate as a basis for decisions. We shall consider how the uncertainty in this estimation can be explicitly and consistently incorporated in the valuation of decisions, using the theory of nonlinear expectations. △ Less

Submitted 21 September, 2016; originally announced September 2016.

MSC Class: 62F86; 62F25; 62A86; 91G70; 90B50

Uncertainty and filtering of hidden Markov models in discrete time

Authors: Samuel N. Cohen

Abstract: We consider the problem of filtering an unseen Markov chain from noisy observations, in the presence of uncertainty regarding the parameters of the processes involved. Using the theory of nonlinear expectations, we describe the uncertainty in terms of a penalty function, which can be propagated forward in time in the place of the filter. We consider the problem of filtering an unseen Markov chain from noisy observations, in the presence of uncertainty regarding the parameters of the processes involved. Using the theory of nonlinear expectations, we describe the uncertainty in terms of a penalty function, which can be propagated forward in time in the place of the filter. △ Less

Submitted 12 May, 2018; v1 submitted 1 June, 2016; originally announced June 2016.

MSC Class: 62M20; 60G35; 93E11

Classical Adjoints for Ergodic Stochastic Control

Authors: Samuel N. Cohen, Victor Fedyashov

Abstract: In this paper we consider ergodic optimal control of a diffusion process $\{X^u_t\}_{t \geq 0}$, taking values in $\bR^n$, where both drift and volatility are controlled. We establish a novel strong duality between the existence of a unique solution to the infinite horizon adjoint BSDE and strong dissipativity of $X^u$. We then proceed to show that the latter implies irreducibility, the strong Fel… ▽ More In this paper we consider ergodic optimal control of a diffusion process $\{X^u_t\}_{t \geq 0}$, taking values in $\bR^n$, where both drift and volatility are controlled. We establish a novel strong duality between the existence of a unique solution to the infinite horizon adjoint BSDE and strong dissipativity of $X^u$. We then proceed to show that the latter implies irreducibility, the strong Feller property and exponential ergodicity. We conclude by discussing the connection with ergodic BSDEs. △ Less

Submitted 13 November, 2015; originally announced November 2015.

MSC Class: 93E20; 60H30; 60F17

Nash equilibria for non zero-sum ergodic stochastic differential games

Authors: Samuel N. Cohen, Victor Fedyashov

Abstract: In this paper we consider non zero-sum games where multiple players control the drift of a process, and their payoffs depend on its ergodic behaviour. We establish their connection with systems of Ergodic BSDEs, and prove the existence of a Nash equilibrium under the generalised Isaac's conditions. We also study the case of interacting players of different type. In this paper we consider non zero-sum games where multiple players control the drift of a process, and their payoffs depend on its ergodic behaviour. We establish their connection with systems of Ergodic BSDEs, and prove the existence of a Nash equilibrium under the generalised Isaac's conditions. We also study the case of interacting players of different type. △ Less

Submitted 15 June, 2017; v1 submitted 9 November, 2015; originally announced November 2015.

MSC Class: 91A60; 49N70; 93E20

Ergodic Backward Stochastic Difference Equations

Authors: Andrew L. Allan, Samuel N. Cohen

Abstract: We consider ergodic backward stochastic differential equations in a discrete time setting, where noise is generated by a finite state Markov chain. We show existence and uniqueness of solutions, along with a comparison theorem. To obtain this result, we use a Nummelin splitting argument to obtain ergodicity estimates for a discrete time Markov chain which hold uniformly under suitable perturbation… ▽ More We consider ergodic backward stochastic differential equations in a discrete time setting, where noise is generated by a finite state Markov chain. We show existence and uniqueness of solutions, along with a comparison theorem. To obtain this result, we use a Nummelin splitting argument to obtain ergodicity estimates for a discrete time Markov chain which hold uniformly under suitable perturbations of its transition matrix. We conclude with an application of this theory to a treatment of an ergodic control problem. △ Less

Submitted 1 September, 2015; originally announced September 2015.

MSC Class: 60J10; 93E20; 60F99

Ergodic BSDEs with jumps and time dependence

Authors: Samuel N. Cohen, Victor Fedyashov

Abstract: In this paper we look at ergodic BSDEs in the case where the forward dynamics are given by the solution to a non-autonomous (time-periodic coefficients) Ornstein-Uhlenbeck SDE with Lévy noise, taking values in a separable Hilbert space. We establish the existence of a unique bounded solution to an infinite horizon discounted BSDE. We then use the vanishing discount approach, together with coupling… ▽ More In this paper we look at ergodic BSDEs in the case where the forward dynamics are given by the solution to a non-autonomous (time-periodic coefficients) Ornstein-Uhlenbeck SDE with Lévy noise, taking values in a separable Hilbert space. We establish the existence of a unique bounded solution to an infinite horizon discounted BSDE. We then use the vanishing discount approach, together with coupling techniques, to obtain a Markovian solution to the EBSDE. We also prove uniqueness under certain growth conditions. Applications are then given, in particular to risk-averse ergodic optimal control and power plant evaluation under uncertainty. △ Less

Submitted 10 November, 2015; v1 submitted 17 June, 2014; originally announced June 2014.

MSC Class: 60H20; 93E20; 60F17

Filters and smoothers for self-exciting Markov modulated counting processes

Authors: Samuel N. Cohen, Robert J. Elliott

Abstract: We consider a self-exciting counting process, the parameters of which depend on a hidden finite-state Markov chain. We derive the optimal filter and smoother for the hidden chain based on observation of the jump process. This filter is in closed form and is finite dimensional. We demonstrate the performance of this filter both with simulated data, and by analysing the `flash crash' of 6th May 2010… ▽ More We consider a self-exciting counting process, the parameters of which depend on a hidden finite-state Markov chain. We derive the optimal filter and smoother for the hidden chain based on observation of the jump process. This filter is in closed form and is finite dimensional. We demonstrate the performance of this filter both with simulated data, and by analysing the `flash crash' of 6th May 2010 in this framework. △ Less

Submitted 25 November, 2013; originally announced November 2013.

MSC Class: 62M05; 60G55; 60J28; 91G70

A martingale representation theorem for a class of jump processes

Authors: Samuel N. Cohen

Abstract: We give a bare-hands approach to the martingale representation theorem for integer valued random measures, which allows for a wide class of infinite activity jump processes, as well as all processes with well-ordered jumps. We give a bare-hands approach to the martingale representation theorem for integer valued random measures, which allows for a wide class of infinite activity jump processes, as well as all processes with well-ordered jumps. △ Less

Submitted 23 October, 2013; originally announced October 2013.

MSC Class: 60G57; 60G44

Reflected Backward Stochastic Difference Equations and Optimal Stop** Problems under g-expectation

Authors: Lifen An, Samuel N. Cohen, Shaolin Ji

Abstract: In this paper, we study reflected backward stochastic difference equations (RBSDEs for short) with finitely many states in discrete time. The general existence and uniqueness result, as well as comparison theorems for the solutions, are established under mild assumptions. The connections between RBSDEs and optimal stop** problems are also given. Then we apply the obtained results to explore opti… ▽ More In this paper, we study reflected backward stochastic difference equations (RBSDEs for short) with finitely many states in discrete time. The general existence and uniqueness result, as well as comparison theorems for the solutions, are established under mild assumptions. The connections between RBSDEs and optimal stop** problems are also given. Then we apply the obtained results to explore optimal stop** problems under $g$-expectation. Finally, we study the pricing of American contingent claims in our context. △ Less

Submitted 1 July, 2013; v1 submitted 4 May, 2013; originally announced May 2013.

Comments: 29 pages

Undiscounted Markov chain BSDEs to stop** times

Authors: Samuel N. Cohen

Abstract: We consider Backward Stochastic Differential Equations in a setting where noise is generated by a countable state, continuous time Markov chain, and the terminal value is prescribed at a stop** time. We show that, given sufficient integrability of the stop** time and a growth bound on the terminal value and BSDE driver, these equations admit unique solutions satisfying the same growth bound (u… ▽ More We consider Backward Stochastic Differential Equations in a setting where noise is generated by a countable state, continuous time Markov chain, and the terminal value is prescribed at a stop** time. We show that, given sufficient integrability of the stop** time and a growth bound on the terminal value and BSDE driver, these equations admit unique solutions satisfying the same growth bound (up to multiplication by a constant). This holds without assuming that the driver is monotone in y, that is, our results do not require that the terminal value be discounted at some uniform rate. We show that the conditions are satisfied for hitting times of states of the chain, and hence present some novel applications of the theory of these BSDEs. △ Less

Submitted 19 February, 2013; originally announced February 2013.

MSC Class: 60J27; 93E20; 94C05

Ergodic BSDEs driven by Markov Chains

Authors: Samuel N. Cohen, Ying Hu

Abstract: We consider ergodic backward stochastic differential equations, in a setting where noise is generated by a countable state uniformly ergodic Markov chain. We show that for Lipschitz drivers such that a comparison theorem holds, these equations admit unique solutions. To obtain this result, we show by coupling and splitting techniques that uniform ergodicity estimates of Markov chains are robust to… ▽ More We consider ergodic backward stochastic differential equations, in a setting where noise is generated by a countable state uniformly ergodic Markov chain. We show that for Lipschitz drivers such that a comparison theorem holds, these equations admit unique solutions. To obtain this result, we show by coupling and splitting techniques that uniform ergodicity estimates of Markov chains are robust to perturbations of the rate matrix, and that these perturbations correspond in a natural way to EBSDEs. We then consider applications of this theory to Markov decision problems with a risk-averse average reward criterion. △ Less

Submitted 24 July, 2012; originally announced July 2012.

MSC Class: 60J27; 93E20; 49J55

On Markovian solutions to Markov Chain BSDEs

Authors: Samuel N. Cohen, Lukasz Szpruch

Abstract: We study (backward) stochastic differential equations with noise coming from a finite state Markov chain. We show that, for the solutions of these equations to be `Markovian', in the sense that they are deterministic functions of the state of the underlying chain, the integrand must be of a specific form. This allows us to connect these equations to coupled systems of ODEs, and hence to give fast… ▽ More We study (backward) stochastic differential equations with noise coming from a finite state Markov chain. We show that, for the solutions of these equations to be `Markovian', in the sense that they are deterministic functions of the state of the underlying chain, the integrand must be of a specific form. This allows us to connect these equations to coupled systems of ODEs, and hence to give fast numerical methods for the evaluation of Markov-Chain BSDEs. △ Less

Submitted 24 November, 2011; originally announced November 2011.

MSC Class: 60J27; 60H05; 34A12

A limit order book model for latency arbitrage

Authors: Samuel N. Cohen, Lukasz Szpruch

Abstract: We consider a single security market based on a limit order book and two investors, with different speeds of trade execution. If the fast investor can front-run the slower investor, we show that this allows the fast trader to obtain risk free profits, but that these profits cannot be scaled. We derive the fast trader's optimal behaviour when she has only distributional knowledge of the slow trader… ▽ More We consider a single security market based on a limit order book and two investors, with different speeds of trade execution. If the fast investor can front-run the slower investor, we show that this allows the fast trader to obtain risk free profits, but that these profits cannot be scaled. We derive the fast trader's optimal behaviour when she has only distributional knowledge of the slow trader's actions, with few restrictions on the possible prior distributions. We also consider the slower trader's response to the presence of a fast trader in a market, and the effects of the introduction of a `Tobin tax' on financial transactions. We show that such a tax can lead to the elimination of profits from front-running strategies. Consequently, a Tobin tax can both increase market efficiency and attract traders to a market. △ Less

Submitted 21 October, 2011; originally announced October 2011.

MSC Class: 91B26; 91G99

Quasi-sure analysis, aggregation and dual representations of sublinear expectations in general spaces

Authors: Samuel N. Cohen

Abstract: We consider coherent sublinear expectations on a measurable space, without assuming the existence of a dominating probability measure. By considering a decomposition of the space in terms of the supports of the measures representing our sublinear expectation, we give a simple construction, in a quasi-sure sense, of the (linear) conditional expectations, and hence give a representation for the cond… ▽ More We consider coherent sublinear expectations on a measurable space, without assuming the existence of a dominating probability measure. By considering a decomposition of the space in terms of the supports of the measures representing our sublinear expectation, we give a simple construction, in a quasi-sure sense, of the (linear) conditional expectations, and hence give a representation for the conditional sublinear expectation. We also show an aggregation property holds, and give an equivalence between consistency and a pasting property of measures. △ Less

Submitted 26 October, 2011; v1 submitted 12 October, 2011; originally announced October 2011.

MSC Class: 60A10; 60A86; 91B06

Chaos representations for Marked Point Processes

Authors: Samuel N. Cohen

Abstract: We show that for a large class of marked point processes there exists a random measure m with the predictable representation property such that iterated integrals with respect to m span the space of square integrable random variables. We show that for a large class of marked point processes there exists a random measure m with the predictable representation property such that iterated integrals with respect to m span the space of square integrable random variables. △ Less

Submitted 4 October, 2011; originally announced October 2011.

MSC Class: 60G55; 60H20

Representing filtration consistent nonlinear expectations as $g$-expectations in general probability spaces

Authors: Samuel N. Cohen

Abstract: We consider filtration consistent nonlinear expectations in probability spaces satisfying only the usual conditions and separability. Under a domination assumption, we demonstrate that these nonlinear expectations can be expressed as the solutions to Backward Stochastic Differential Equations with Lipschitz continuous drivers, where both the martingale and the driver terms are permitted to jump, a… ▽ More We consider filtration consistent nonlinear expectations in probability spaces satisfying only the usual conditions and separability. Under a domination assumption, we demonstrate that these nonlinear expectations can be expressed as the solutions to Backward Stochastic Differential Equations with Lipschitz continuous drivers, where both the martingale and the driver terms are permitted to jump, and the martingale representation is infinite dimensional. To establish this result, we show that this domination condition is sufficient to guarantee that the comparison theorem for BSDEs will hold, and we generalise the nonlinear Doob-Meyer decomposition of Peng to a general context. △ Less

Submitted 25 February, 2011; originally announced February 2011.

MSC Class: 60G48; 60H20; 91B06

What risk measures are time consistent for all filtrations?

Authors: Samuel N. Cohen

Abstract: We study coherent risk measures which are time-consistent for multiple filtrations. We show that a coherent risk measure is time-consistent for every filtration if and only if it is one of four main types. Furthermore, if the risk measure is strictly monotone it is linear, and if the reference probability space is not atomic then it is either linear or an essential supremum. We study coherent risk measures which are time-consistent for multiple filtrations. We show that a coherent risk measure is time-consistent for every filtration if and only if it is one of four main types. Furthermore, if the risk measure is strictly monotone it is linear, and if the reference probability space is not atomic then it is either linear or an essential supremum. △ Less

Submitted 4 July, 2010; originally announced July 2010.

Comments: 8 pages

Existence, uniqueness and comparisons for BSDEs in general spaces

Authors: Samuel N. Cohen, Robert J. Elliott

Abstract: We present a theory of backward stochastic differential equations in continuous time with an arbitrary filtered probability space. No assumptions are made regarding the left continuity of the filtration, of the predictable quadratic variations of martingales or of the measure integrating the driver. We present conditions for existence and uniqueness of square-integrable solutions, using Lipschitz… ▽ More We present a theory of backward stochastic differential equations in continuous time with an arbitrary filtered probability space. No assumptions are made regarding the left continuity of the filtration, of the predictable quadratic variations of martingales or of the measure integrating the driver. We present conditions for existence and uniqueness of square-integrable solutions, using Lipschitz continuity of the driver. These conditions unite the requirements for existence in continuous and discrete time and allow discrete processes to be embedded with continuous ones. We also present conditions for a comparison theorem and hence construct time consistent nonlinear expectations in these general spaces. △ Less

Submitted 12 October, 2012; v1 submitted 4 January, 2010; originally announced January 2010.

Comments: Published in at http://dx.doi.org/10.1214/11-AOP679 the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP679

Journal ref: Annals of Probability 2012, Vol. 40, No. 5, 2264-2297

Time consistency and moving horizons for risk measures

Authors: Samuel N. Cohen, Robert J. Elliott

Abstract: We consider portfolio selection when decisions based on a dynamic risk measure are affected by the use of a moving horizon, and the possible inconsistencies that this creates. By giving a formal treatment of time consistency which is independent of Bellman's equations, we show that there is a new sense in which these decisions can be seen as consistent. We consider portfolio selection when decisions based on a dynamic risk measure are affected by the use of a moving horizon, and the possible inconsistencies that this creates. By giving a formal treatment of time consistency which is independent of Bellman's equations, we show that there is a new sense in which these decisions can be seen as consistent. △ Less

Submitted 9 July, 2010; v1 submitted 7 December, 2009; originally announced December 2009.

Comments: 15 pages

A general theory of Finite State Backward Stochastic Difference Equations

Authors: Samuel N. Cohen, Robert J. Elliott

Abstract: By analogy with the theory of Backward Stochastic Differential Equations, we define Backward Stochastic Difference Equations on spaces related to discrete time, finite state processes. This paper considers these processes as constructions in their own right, not as approximations to the continuous case. We establish the existence and uniqueness of solutions under weaker assumptions than are need… ▽ More By analogy with the theory of Backward Stochastic Differential Equations, we define Backward Stochastic Difference Equations on spaces related to discrete time, finite state processes. This paper considers these processes as constructions in their own right, not as approximations to the continuous case. We establish the existence and uniqueness of solutions under weaker assumptions than are needed in the continuous time setting, and also establish a comparison theorem for these solutions. The conditions of this theorem are shown to approximate those required in the continuous time setting. We also explore the relationship between the driver $F$ and the set of solutions; in particular, we determine under what conditions the driver is uniquely determined by the solution. Applications to the theory of nonlinear expectations are explored, including a representation result. △ Less

Submitted 11 January, 2010; v1 submitted 27 October, 2008; originally announced October 2008.

Comments: 25 pages, final preprint prior to refereeing

MSC Class: 60H10; 60G42; 65C30

Journal ref: Stochastic Processes and their Applications 120 (2010), pp. 442-466

A Ring Isomorphism and corresponding Pseudoinverses

Authors: Samuel N. Cohen, Robert J. Elliott, Charles E. M. Pearce

Abstract: This paper studies the set of $n\times n$ matrices for which all row and column sums equal zero. By representing these matrices in a lower dimensional space, it is shown that this set is closed under addition and multiplication, and furthermore is isomorphic to the set of arbitrary $(n-1)\times (n-1)$ matrices. The Moore-Penrose pseudoinverse corresponds with the true inverse, (when it exists),… ▽ More This paper studies the set of $n\times n$ matrices for which all row and column sums equal zero. By representing these matrices in a lower dimensional space, it is shown that this set is closed under addition and multiplication, and furthermore is isomorphic to the set of arbitrary $(n-1)\times (n-1)$ matrices. The Moore-Penrose pseudoinverse corresponds with the true inverse, (when it exists), in this lower dimension and an explicit representation of this pseudoinverse in terms of the lower dimensional space is given. This analysis is then extended to non-square matrices with all row or all column sums equal to zero. △ Less

Submitted 1 October, 2008; originally announced October 2008.

Comments: 9 Pages

MSC Class: 15A09; 16S50

Comparisons for backward stochastic differential equations on Markov chains and related no-arbitrage conditions

Authors: Samuel N. Cohen, Robert J. Elliott

Abstract: Most previous contributions to BSDEs, and the related theories of nonlinear expectation and dynamic risk measures, have been in the framework of continuous time diffusions or jump diffusions. Using solutions of BSDEs on spaces related to finite state, continuous time Markov chains, we develop a theory of nonlinear expectations in the spirit of [Dynamically consistent nonlinear evaluations and ex… ▽ More Most previous contributions to BSDEs, and the related theories of nonlinear expectation and dynamic risk measures, have been in the framework of continuous time diffusions or jump diffusions. Using solutions of BSDEs on spaces related to finite state, continuous time Markov chains, we develop a theory of nonlinear expectations in the spirit of [Dynamically consistent nonlinear evaluations and expectations (2005) Shandong Univ.]. We prove basic properties of these expectations and show their applications to dynamic risk measures on such spaces. In particular, we prove comparison theorems for scalar and vector valued solutions to BSDEs, and discuss arbitrage and risk measures in the scalar case. △ Less

Submitted 14 January, 2010; v1 submitted 30 September, 2008; originally announced October 2008.

Comments: Published in at http://dx.doi.org/10.1214/09-AAP619 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP619 MSC Class: 60H10 (Primary) 91B70 (Secondary)

Journal ref: Annals of Applied Probability 2010, Vol. 20, No. 1, 267-311

Solutions of Backward Stochastic Differential Equations on Markov Chains

Authors: Samuel N. Cohen, Robert J. Elliott

Abstract: We consider backward stochastic differential equations (BSDEs) related to finite state, continuous time Markov chains. We show that appropriate solutions exist for arbitrary terminal conditions, and are unique up to sets of measure zero. We do not require the generating functions to be monotonic, instead using only an appropriate Lipschitz continuity condition. We consider backward stochastic differential equations (BSDEs) related to finite state, continuous time Markov chains. We show that appropriate solutions exist for arbitrary terminal conditions, and are unique up to sets of measure zero. We do not require the generating functions to be monotonic, instead using only an appropriate Lipschitz continuity condition. △ Less

Submitted 29 September, 2008; originally announced September 2008.

Comments: To appear in Communications on Stochastic Analysis, August 2008

MSC Class: 60H10; 60H05