-
Probabilistic cellular automata with local transition matrices: synchronization, ergodicity, and inference
Authors:
Erhan Bayraktar,
Fei Lu,
Mauro Maggioni,
Ruoyu Wu,
Sichen Yang
Abstract:
We introduce a new class of probabilistic cellular automata that are capable of exhibiting rich dynamics such as synchronization and ergodicity and can be easily inferred from data. The system is a finite-state locally interacting Markov chain on a circular graph. Each site's subsequent state is random, with a distribution determined by its neighborhood's empirical distribution multiplied by a loc…
▽ More
We introduce a new class of probabilistic cellular automata that are capable of exhibiting rich dynamics such as synchronization and ergodicity and can be easily inferred from data. The system is a finite-state locally interacting Markov chain on a circular graph. Each site's subsequent state is random, with a distribution determined by its neighborhood's empirical distribution multiplied by a local transition matrix. We establish sufficient and necessary conditions on the local transition matrix for synchronization and ergodicity. Also, we introduce novel least squares estimators for inferring the local transition matrix from various types of data, which may consist of either multiple trajectories, a long trajectory, or ensemble sequences without trajectory information. Under suitable identifiability conditions, we show the asymptotic normality of these estimators and provide non-asymptotic bounds for their accuracy.
△ Less
Submitted 23 June, 2024; v1 submitted 5 May, 2024;
originally announced May 2024.
-
DEX Specs: A Mean Field Approach to DeFi Currency Exchanges
Authors:
Erhan Bayraktar,
Asaf Cohen,
April Nellis
Abstract:
We investigate the behavior of liquidity providers (LPs) by modeling a decentralized cryptocurrency exchange (DEX) based on Uniswap v3. LPs with heterogeneous characteristics choose optimal liquidity positions subject to uncertainty regarding the size of exogenous incoming transactions and the prices of assets in the wider market. They engage in a game among themselves, and the resulting liquidity…
▽ More
We investigate the behavior of liquidity providers (LPs) by modeling a decentralized cryptocurrency exchange (DEX) based on Uniswap v3. LPs with heterogeneous characteristics choose optimal liquidity positions subject to uncertainty regarding the size of exogenous incoming transactions and the prices of assets in the wider market. They engage in a game among themselves, and the resulting liquidity distribution determines the exchange rate dynamics and potential arbitrage opportunities of the pool. We calibrate the distribution of LP characteristics based on Uniswap data and the equilibrium strategy resulting from this mean-field game produces pool exchange rate dynamics and liquidity evolution consistent with observed pool behavior. We subsequently introduce Maximal Extractable Value (MEV) bots who perform Just-In-Time (JIT) liquidity attacks, and develop a Stackelberg game between LPs and bots. This addition results in more accurate simulated pool exchange rate dynamics and stronger predictive power regarding the evolution of the pool liquidity distribution.
△ Less
Submitted 13 April, 2024;
originally announced April 2024.
-
Non-parametric estimates for graphon mean-field particle systems
Authors:
Erhan Bayraktar,
Hongyi Zhou
Abstract:
We consider the graphon mean-field system introduced in the work of Bayraktar, Chakraborty, and Wu. It is the large-population limit of a heterogeneously interacting diffusive particle system, where the interaction is of mean-field type with weights characterized by an underlying graphon function. Through observation of continuous-time trajectories within the particle system, we construct plug-in…
▽ More
We consider the graphon mean-field system introduced in the work of Bayraktar, Chakraborty, and Wu. It is the large-population limit of a heterogeneously interacting diffusive particle system, where the interaction is of mean-field type with weights characterized by an underlying graphon function. Through observation of continuous-time trajectories within the particle system, we construct plug-in estimators of the particle density, the drift coefficient, and thus the graphon interaction weights of the mean-field system. Our estimators for the density and drift are direct results of kernel interpolation on the empirical data, and a deconvolution method leads to an estimator of the underlying graphon function. We show that, as the number of particles increases, the graphon estimator converges to the true graphon function pointwisely, and as a consequence, in the cut metric. Besides, we conduct a minimax analysis within a particular class of particle systems to justify the pointwise optimality of the density and drift estimators.
△ Less
Submitted 9 March, 2024; v1 submitted 8 February, 2024;
originally announced February 2024.
-
Binomial-tree approximation for time-inconsistent stop**
Authors:
Erhan Bayraktar,
Zhenhua Wang,
Zhou Zhou
Abstract:
For time-inconsistent stop** in a one-dimensional diffusion setup, we investigate how to use discrete-time models to approximate the original problem. In particular, we consider the value function $V(\cdot)$ induced by all mild equilibria in the continuous-time problem, as well as the value $V^h(\cdot)$ associated with the equilibria in a binomial-tree setting with time step size $h$. We show th…
▽ More
For time-inconsistent stop** in a one-dimensional diffusion setup, we investigate how to use discrete-time models to approximate the original problem. In particular, we consider the value function $V(\cdot)$ induced by all mild equilibria in the continuous-time problem, as well as the value $V^h(\cdot)$ associated with the equilibria in a binomial-tree setting with time step size $h$. We show that $\lim_{h\rightarrow 0+} V^h \leq V$. We provide an example showing that the exact convergence may fail. Then we relax the set of equilibria and consider the value $V^h_{\varepsilon}(\cdot)$ induced by $\varepsilon$-equilibria in the binomial-tree model. We prove that $\lim_{\varepsilon \rightarrow 0+}\lim_{h \rightarrow 0+}V^h_{\varepsilon} = V$.
△ Less
Submitted 2 February, 2024;
originally announced February 2024.
-
The McCormick martingale optimal transport
Authors:
Erhan Bayraktar,
Bingyan Han,
Dominykas Norgilas
Abstract:
Martingale optimal transport (MOT) often yields broad price bounds for options, constraining their practical applicability. In this study, we extend MOT by incorporating causality constraints among assets, inspired by the nonanticipativity condition of stochastic processes. However, this introduces a computationally challenging bilinear program. To tackle this issue, we propose McCormick relaxatio…
▽ More
Martingale optimal transport (MOT) often yields broad price bounds for options, constraining their practical applicability. In this study, we extend MOT by incorporating causality constraints among assets, inspired by the nonanticipativity condition of stochastic processes. However, this introduces a computationally challenging bilinear program. To tackle this issue, we propose McCormick relaxations to ease the bicausal formulation and refer to it as McCormick MOT. The primal attainment and strong duality of McCormick MOT are established under standard assumptions. Empirically, McCormick MOT demonstrates the capability to narrow price bounds, achieving an average reduction of 1% or 4%. The degree of improvement depends on the payoffs of the options and the liquidity of the relevant vanilla options.
△ Less
Submitted 27 January, 2024;
originally announced January 2024.
-
On Time-Inconsistency in Mean Field Games
Authors:
Erhan Bayraktar,
Zhenhua Wang
Abstract:
We investigate an infinite-horizon time-inconsistent mean-field game (MFG) in a discrete time setting. We first present a classic equilibrium for the MFG and its associated existence result. This classic equilibrium aligns with the conventional equilibrium concept studied in MFG literature when the context is time-consistent. Then we demonstrate that while this equilibrium produces an approximate…
▽ More
We investigate an infinite-horizon time-inconsistent mean-field game (MFG) in a discrete time setting. We first present a classic equilibrium for the MFG and its associated existence result. This classic equilibrium aligns with the conventional equilibrium concept studied in MFG literature when the context is time-consistent. Then we demonstrate that while this equilibrium produces an approximate optimal strategy when applied to the related $N$-agent games, it does so solely in a precommitment sense. Therefore, it cannot function as a genuinely approximate equilibrium strategy from the perspective of a sophisticated agent within the $N$-agent game. To address this limitation, we propose a new consistent equilibrium concept in both the MFG and the $N$-agent game. We show that a consistent equilibrium in the MFG can indeed function as an approximate consistent equilibrium in the $N$-agent game. Additionally, we analyze the convergence of consistent equilibria for $N$-agent games toward a consistent MFG equilibrium as $N$ tends to infinity.
△ Less
Submitted 12 December, 2023;
originally announced December 2023.
-
Infinite Horizon Average Cost Optimality Criteria for Mean-Field Control
Authors:
Erhan Bayraktar,
Ali D. Kara
Abstract:
We study mean-field control problems in discrete-time under the infinite horizon average cost optimality criteria. We focus on both the finite population and the infinite population setups. We show the existence of a solution to the average cost optimality equation (ACOE) and the existence of optimal stationary Markov policies for finite population problems under (i) a minorization condition that…
▽ More
We study mean-field control problems in discrete-time under the infinite horizon average cost optimality criteria. We focus on both the finite population and the infinite population setups. We show the existence of a solution to the average cost optimality equation (ACOE) and the existence of optimal stationary Markov policies for finite population problems under (i) a minorization condition that provides geometric ergodicity on the collective state process of the agents, and (ii) under standard Lipschitz continuity assumptions on the stage-wise cost and transition function of the agents when the Lipschitz constant of the transition function satisfies a certain bound. For the infinite population problem, we establish the existence of a solution to the ACOE, and the existence of optimal policies under the continuity assumptions on the cost and the transition functions. Finally, we relate the finite population and infinite population control problems: (i) we prove that the optimal value of the finite population problem converges to the optimal value of the infinite population problem as the number of agents grows to infinity; (ii) we show that the accumulation points of the finite population optimal solution corresponds to an optimal solution for the infinite population problem, and finally (iii), we show that one can use the solution of the infinite population problem for the finite population problem symmetrically across the agents to achieve near optimal performance when the population is sufficiently large.
△ Less
Submitted 17 April, 2024; v1 submitted 20 September, 2023;
originally announced September 2023.
-
Comparison of viscosity solutions for a class of second order PDEs on the Wasserstein space
Authors:
Erhan Bayraktar,
Ibrahim Ekren,
Xin Zhang
Abstract:
We prove a comparison result for viscosity solutions of second order parabolic partial differential equations in the Wasserstein space. The comparison is valid for semisolutions that are Lipschitz continuous in the measure in a Fourier-Wasserstein metric and uniformly continuous in time. The class of equations we consider is motivated by Mckean-Vlasov control problems with common noise and filteri…
▽ More
We prove a comparison result for viscosity solutions of second order parabolic partial differential equations in the Wasserstein space. The comparison is valid for semisolutions that are Lipschitz continuous in the measure in a Fourier-Wasserstein metric and uniformly continuous in time. The class of equations we consider is motivated by Mckean-Vlasov control problems with common noise and filtering problems. The proof of comparison relies on a novel version of Ishii's lemma, which is tailor-made for the class of equations we consider.
△ Less
Submitted 13 September, 2023; v1 submitted 10 September, 2023;
originally announced September 2023.
-
Existence of Markov equilibrium control in discrete time
Authors:
Erhan Bayraktar,
Bingyan Han
Abstract:
For time-inconsistent stochastic controls in discrete time and finite horizon, an open problem in Björk and Murgoci (Finance Stoch, 2014) is the existence of an equilibrium control. A nonrandomized Borel measurable Markov equilibrium policy exists if the objective is inf-compact in every time step. We provide a sufficient condition for the inf-compactness and thus existence, with costs that are lo…
▽ More
For time-inconsistent stochastic controls in discrete time and finite horizon, an open problem in Björk and Murgoci (Finance Stoch, 2014) is the existence of an equilibrium control. A nonrandomized Borel measurable Markov equilibrium policy exists if the objective is inf-compact in every time step. We provide a sufficient condition for the inf-compactness and thus existence, with costs that are lower semicontinuous (l.s.c.) and bounded from below and transition kernels that are continuous in controls under given states. The control spaces need not to be compact.
△ Less
Submitted 15 December, 2023; v1 submitted 14 August, 2023;
originally announced August 2023.
-
Relaxed Equilibria for Time-Inconsistent Markov Decision Processes
Authors:
Erhan Bayraktar,
Yu-Jui Huang,
Zhenhua Wang,
Zhou Zhou
Abstract:
This paper considers an infinite-horizon Markov decision process (MDP) that allows for general non-exponential discount functions, in both discrete and continuous time. Due to the inherent time inconsistency, we look for a randomized equilibrium policy (i.e., relaxed equilibrium) in an intra-personal game between an agent's current and future selves. When we modify the MDP by entropy regularizatio…
▽ More
This paper considers an infinite-horizon Markov decision process (MDP) that allows for general non-exponential discount functions, in both discrete and continuous time. Due to the inherent time inconsistency, we look for a randomized equilibrium policy (i.e., relaxed equilibrium) in an intra-personal game between an agent's current and future selves. When we modify the MDP by entropy regularization, a relaxed equilibrium is shown to exist by a nontrivial entropy estimate. As the degree of regularization diminishes, the entropy-regularized MDPs approximate the original MDP, which gives the general existence of a relaxed equilibrium in the limit by weak convergence arguments. As opposed to prior studies that consider only deterministic policies, our existence of an equilibrium does not require any convexity (or concavity) of the controlled transition probabilities and reward function. Interestingly, this benefit of considering randomized policies is unique to the time-inconsistent case.
△ Less
Submitted 9 July, 2023;
originally announced July 2023.
-
Fitted Value Iteration Methods for Bicausal Optimal Transport
Authors:
Erhan Bayraktar,
Bingyan Han
Abstract:
We develop a fitted value iteration (FVI) method to compute bicausal optimal transport (OT) where couplings have an adapted structure. Based on the dynamic programming formulation, FVI adopts a function class to approximate the value functions in bicausal OT. Under the concentrability condition and approximate completeness assumption, we prove the sample complexity using (local) Rademacher complex…
▽ More
We develop a fitted value iteration (FVI) method to compute bicausal optimal transport (OT) where couplings have an adapted structure. Based on the dynamic programming formulation, FVI adopts a function class to approximate the value functions in bicausal OT. Under the concentrability condition and approximate completeness assumption, we prove the sample complexity using (local) Rademacher complexity. Furthermore, we demonstrate that multilayer neural networks with appropriate structures satisfy the crucial assumptions required in sample complexity proofs. Numerical experiments reveal that FVI outperforms linear programming and adapted Sinkhorn methods in scalability as the time horizon increases, while still maintaining acceptable accuracy.
△ Less
Submitted 1 November, 2023; v1 submitted 21 June, 2023;
originally announced June 2023.
-
Stochastic Control/Stop** Problem with Expectation Constraints
Authors:
Erhan Bayraktar,
Song Yao
Abstract:
We study a stochastic control/stop** problem with a series of inequality-type and equality-type expectation constraints in a general non-Markovian framework. We demonstrate that the stochastic control/stop** problem with expectation constraints (CSEC) is independent of a specific probability setting and is equivalent to the constrained stochastic control/stop** problem in weak formulation (a…
▽ More
We study a stochastic control/stop** problem with a series of inequality-type and equality-type expectation constraints in a general non-Markovian framework. We demonstrate that the stochastic control/stop** problem with expectation constraints (CSEC) is independent of a specific probability setting and is equivalent to the constrained stochastic control/stop** problem in weak formulation (an optimization over joint laws of Brownian motion, state dynamics, diffusion controls and stop** rules on an enlarged canonical space). Using a martingale-problem formulation of controlled SDEs in spirit of \cite{Stroock_Varadhan}, we characterize the probability classes in weak formulation by countably many actions of canonical processes, and thus obtain the upper semi-analyticity of the CSEC value function.
Then we employ a measurable selection argument to establish a dynamic programming principle (DPP) in weak formulation for the CSEC value function, in which the conditional expected costs act as additional states for constraint levels at the intermediate horizon. This article extends the results of \cite{Elk_Tan_2013b} to the expectation-constraint case. We extend our previous work \cite{OSEC_stop**} to the more complicated setting where the diffusion is controlled. Compared to that paper the topological properties of diffusion-control spaces and the corresponding measurability are more technically involved which complicate the arguments especially for the measurable selection for the super-solution side of DPP in the weak formulation.
△ Less
Submitted 29 May, 2023;
originally announced May 2023.
-
Hölder regularity and roughness: construction and examples
Authors:
Erhan Bayraktar,
Purba Das,
Donghan Kim
Abstract:
We study how to construct a stochastic process on a finite interval with given `roughness' and finite joint moments of marginal distributions. We first extend Ciesielski's isomorphism along a general sequence of partitions, and provide a characterization of Hölder regularity of a function in terms of its Schauder coefficients. Using this characterization we provide a better (pathwise) estimator of…
▽ More
We study how to construct a stochastic process on a finite interval with given `roughness' and finite joint moments of marginal distributions. We first extend Ciesielski's isomorphism along a general sequence of partitions, and provide a characterization of Hölder regularity of a function in terms of its Schauder coefficients. Using this characterization we provide a better (pathwise) estimator of Hölder exponent. As an additional application, we construct fake (fractional) Brownian motions with some path properties and finite moments of marginal distributions same as (fractional) Brownian motions. These belong to non-Gaussian families of stochastic processes which are statistically difficult to distinguish from real (fractional) Brownian motions.
△ Less
Submitted 6 May, 2024; v1 submitted 26 April, 2023;
originally announced April 2023.
-
Estimation of a pure-jump stable Cox-Ingersoll-Ross process
Authors:
Elise Bayraktar,
Emmanuelle Clément
Abstract:
We consider a pure-jump stable Cox-Ingersoll-Ross ($α$-stable CIR) process driven by a non-symmetric stable L{é}vy process with jump activity $α$ $\in$ (1, 2) and we address the joint estimation of drift, scaling and jump activity parameters from high-frequency observations of the process on a fixed time period. We first prove the existence of a consistent, rate optimal and asymptotically conditio…
▽ More
We consider a pure-jump stable Cox-Ingersoll-Ross ($α$-stable CIR) process driven by a non-symmetric stable L{é}vy process with jump activity $α$ $\in$ (1, 2) and we address the joint estimation of drift, scaling and jump activity parameters from high-frequency observations of the process on a fixed time period. We first prove the existence of a consistent, rate optimal and asymptotically conditionally gaussian estimator based on an approximation of the likelihood function. Moreover, uniqueness of the drift estimators is established assuming that the scaling coefficient and the jump activity are known or consistently estimated. Next we propose easy-toimplement preliminary estimators of all parameters and we improve them by a one-step procedure.
△ Less
Submitted 12 February, 2024; v1 submitted 5 April, 2023;
originally announced April 2023.
-
Quantifying dimensional change in stochastic portfolio theory
Authors:
Erhan Bayraktar,
Donghan Kim,
Abhishek Tilva
Abstract:
In this paper, we develop the theory of functional generation of portfolios in an equity market with changing dimension. By introducing dimensional jumps in the market, as well as jumps in stock capitalization between the dimensional jumps, we construct different types of self-financing stock portfolios (additive, multiplicative, and rank-based) in a very general setting. Our study explains how a…
▽ More
In this paper, we develop the theory of functional generation of portfolios in an equity market with changing dimension. By introducing dimensional jumps in the market, as well as jumps in stock capitalization between the dimensional jumps, we construct different types of self-financing stock portfolios (additive, multiplicative, and rank-based) in a very general setting. Our study explains how a dimensional change caused by a listing or delisting event of a stock, and unexpected shocks in the market, affect portfolio return. We also provide empirical analyses of some classical portfolios, quantifying the impact of dimensional change in portfolio performance relative to the market.
△ Less
Submitted 6 April, 2023; v1 submitted 1 March, 2023;
originally announced March 2023.
-
Equilibrium transport with time-inconsistent costs: An application to matching problems in the job market
Authors:
Erhan Bayraktar,
Bingyan Han
Abstract:
Given two probability measures on sequential data, we investigate the transport problem with time-inconsistent preferences under a discrete-time setting. Motivating examples are nonlinear objectives, state-dependent costs, and regularized optimal transport with general $f$-divergence. Under the bicausal constraint, we introduce the concept of equilibrium transport. The existence is proved in the s…
▽ More
Given two probability measures on sequential data, we investigate the transport problem with time-inconsistent preferences under a discrete-time setting. Motivating examples are nonlinear objectives, state-dependent costs, and regularized optimal transport with general $f$-divergence. Under the bicausal constraint, we introduce the concept of equilibrium transport. The existence is proved in the semi-discrete Markovian case and the continuous non-Markovian case with strict quasiconvexity, while the uniqueness also holds in the second case. We apply our framework to study inertia of two job markets, top-ranking executives and academia. The empirical analysis shows that a job market with stronger inertia is less efficient. The University of California (UC) postdoc job market has the strongest inertia even than that of executives, while there is no evidence of inertia in the UC faculty job market.
△ Less
Submitted 28 August, 2023; v1 submitted 2 February, 2023;
originally announced February 2023.
-
Supermartingale Brenier's Theorem with full-marginals constraint
Authors:
Erhan Bayraktar,
Shuoqing Deng,
Dominykas Norgilas
Abstract:
We explicitly construct the supermartingale version of the Fr{é}chet-Hoeffding coupling in the setting with infinitely many marginal constraints. This extends the results of Henry-Labordere et al. obtained in the martingale setting. Our construction is based on the Markovian iteration of one-period optimal supermartingale couplings. In the limit, as the number of iterations goes to infinity, we ob…
▽ More
We explicitly construct the supermartingale version of the Fr{é}chet-Hoeffding coupling in the setting with infinitely many marginal constraints. This extends the results of Henry-Labordere et al. obtained in the martingale setting. Our construction is based on the Markovian iteration of one-period optimal supermartingale couplings. In the limit, as the number of iterations goes to infinity, we obtain a pure jump process that belongs to a family of local L{é}vy models introduced by Carr et al. We show that the constructed processes solve the continuous-time supermartingale optimal transport problem for a particular family of path-dependent cost functions. The explicit computations are provided in the following three cases: the uniform case, the Bachelier model and the Geometric Brownian Motion case.
△ Less
Submitted 29 December, 2022;
originally announced December 2022.
-
Systemic robustness: a mean-field particle system approach
Authors:
Erhan Bayraktar,
Gaoyue Guo,
Wenpin Tang,
Yuming Paul Zhang
Abstract:
This paper is concerned with the problem of budget control in a large particle system modeled by stochastic differential equations involving hitting times, which arises from considerations of systemic risk in a regional financial network. Motivated by Tang and Tsai (Ann. Probab., 46(2018), pp. 1597{1650), we focus on the number or proportion of surviving entities that never default to measure the…
▽ More
This paper is concerned with the problem of budget control in a large particle system modeled by stochastic differential equations involving hitting times, which arises from considerations of systemic risk in a regional financial network. Motivated by Tang and Tsai (Ann. Probab., 46(2018), pp. 1597{1650), we focus on the number or proportion of surviving entities that never default to measure the systemic robustness. First we show that both the mean-field particle system and its limiting McKean-Vlasov equation are well-posed by virtue of the notion of minimal solutions. We then establish a connection between the proportion of surviving entities in the large particle system and the probability of default in the limiting McKean-Vlasov equation as the size of the interacting particle system N tends to infinity. Finally, we study the asymptotic efficiency of budget control in different economy regimes: the expected number of surviving entities is of constant order in a negative economy; it is of order of the square root of N in a neutral economy; and it is of order N in a positive economy where the budget's effect is negligible.
△ Less
Submitted 29 August, 2023; v1 submitted 16 December, 2022;
originally announced December 2022.
-
Arbitrage theory in a market of stochastic dimension
Authors:
Erhan Bayraktar,
Donghan Kim,
Abhishek Tilva
Abstract:
This paper studies an equity market of stochastic dimension, where the number of assets fluctuates over time. In such a market, we develop the fundamental theorem of asset pricing, which provides the equivalence of the following statements: (i) there exists a supermartingale numéraire portfolio; (ii) each dissected market, which is of a fixed dimension between dimensional jumps, has locally finite…
▽ More
This paper studies an equity market of stochastic dimension, where the number of assets fluctuates over time. In such a market, we develop the fundamental theorem of asset pricing, which provides the equivalence of the following statements: (i) there exists a supermartingale numéraire portfolio; (ii) each dissected market, which is of a fixed dimension between dimensional jumps, has locally finite growth; (iii) there is no arbitrage of the first kind; (iv) there exists a local martingale deflator; (v) the market is viable. We also present the optional decomposition theorem, which characterizes a given nonnegative process as the wealth process of some investment-consumption strategy. Furthermore, similar results still hold in an open market embedded in the entire market of stochastic dimension, where investors can only invest in a fixed number of large capitalization stocks. These results are developed in an equity market model where the price process is given by a piecewise continuous semimartingale of stochastic dimension. Without the continuity assumption on the price process, we present similar results but without explicit characterization of the numéraire portfolio.
△ Less
Submitted 13 June, 2023; v1 submitted 8 December, 2022;
originally announced December 2022.
-
Stability and Sample Complexity of Divergence Regularized Optimal Transport
Authors:
Erhan Bayraktar,
Stephan Eckstein,
Xin Zhang
Abstract:
We study stability and sample complexity properties of divergence regularized optimal transport (DOT). First, we obtain quantitative stability results for optimizers of DOT measured in Wasserstein distance, which are applicable to a wide class of divergences and simultaneously improve known results for entropic optimal transport. Second, we study the case of sample complexity, where the DOT proble…
▽ More
We study stability and sample complexity properties of divergence regularized optimal transport (DOT). First, we obtain quantitative stability results for optimizers of DOT measured in Wasserstein distance, which are applicable to a wide class of divergences and simultaneously improve known results for entropic optimal transport. Second, we study the case of sample complexity, where the DOT problem is approximated using empirical measures of the marginals. We show that divergence regularization can improve the corresponding convergence rate compared to unregularized optimal transport. To this end, we prove upper bounds which exploit both the regularity of cost function and divergence functional, as well as the intrinsic dimension of the marginals. Along the way, we establish regularity properties of dual optimizers of DOT, as well as general limit theorems for empirical measures with suitable classes of test functions.
△ Less
Submitted 16 January, 2024; v1 submitted 1 December, 2022;
originally announced December 2022.
-
Deep Signature Algorithm for Multi-dimensional Path-Dependent Options
Authors:
Erhan Bayraktar,
Qi Feng,
Zhaoyu Zhang
Abstract:
In this work, we study the deep signature algorithms for path-dependent options. We extend the backward scheme in [Huré-Pham-Warin. Mathematics of Computation 89, no. 324 (2020)] for state-dependent FBSDEs with reflections to path-dependent FBSDEs with reflections, by adding the signature layer to the backward scheme. Our algorithm applies to both European and American type option pricing problems…
▽ More
In this work, we study the deep signature algorithms for path-dependent options. We extend the backward scheme in [Huré-Pham-Warin. Mathematics of Computation 89, no. 324 (2020)] for state-dependent FBSDEs with reflections to path-dependent FBSDEs with reflections, by adding the signature layer to the backward scheme. Our algorithm applies to both European and American type option pricing problems while the payoff function depends on the whole paths of the underlying forward stock process. We prove the convergence analysis of our numerical algorithm with explicit dependence on the truncation order of the signature and the neural network approximation errors. Numerical examples for the algorithm are provided including: Amerasian option under the Black-Scholes model, American option with a path-dependent geometric mean payoff function, and the Shiryaev's optimal stop** problem.
△ Less
Submitted 15 January, 2024; v1 submitted 21 November, 2022;
originally announced November 2022.
-
Finite Approximations for Mean Field Type Multi-Agent Control and Their Near Optimality
Authors:
Erhan Bayraktar,
Nicole Bauerle,
Ali Devran Kara
Abstract:
We study a multi-agent mean field type control problem in discrete time where the agents aim to find a socially optimal strategy and where the state and action spaces for the agents are assumed to be continuous. The agents are only weakly coupled through the distribution of their state variables. The problem in its original form can be formulated as a classical Markov decision process (MDP), howev…
▽ More
We study a multi-agent mean field type control problem in discrete time where the agents aim to find a socially optimal strategy and where the state and action spaces for the agents are assumed to be continuous. The agents are only weakly coupled through the distribution of their state variables. The problem in its original form can be formulated as a classical Markov decision process (MDP), however, this formulation suffers from several practical difficulties. In this work, we attempt to overcome the curse of dimensionality, coordination complexity between the agents, and the necessity of perfect feedback collection from all the agents (which might be hard to do for large populations.)
We provide several approximations: we establish the near optimality of the action and state space discretization of the agents under standard regularity assumptions for the considered formulation by constructing and studying the measure valued MDP counterpart for finite and infinite population settings. It is a well known approach to consider the infinite population problem for mean-field type models, since it provides symmetric policies for the agents which simplifies the coordination between the agents. However, the optimality analysis is harder as the state space of the measure valued infinite population MDP is continuous (even after space discretization of the agents). Therefore, as a final step, we provide further approximations for the infinite population problem by focusing on smaller sized sub-population distributions.
△ Less
Submitted 23 July, 2023; v1 submitted 17 November, 2022;
originally announced November 2022.
-
A neural network approach to high-dimensional optimal switching problems with jumps in energy markets
Authors:
Erhan Bayraktar,
Asaf Cohen,
April Nellis
Abstract:
We develop a backward-in-time machine learning algorithm that uses a sequence of neural networks to solve optimal switching problems in energy production, where electricity and fossil fuel prices are subject to stochastic jumps. We then apply this algorithm to a variety of energy scheduling problems, including novel high-dimensional energy production problems. Our experimental results demonstrate…
▽ More
We develop a backward-in-time machine learning algorithm that uses a sequence of neural networks to solve optimal switching problems in energy production, where electricity and fossil fuel prices are subject to stochastic jumps. We then apply this algorithm to a variety of energy scheduling problems, including novel high-dimensional energy production problems. Our experimental results demonstrate that the algorithm performs with accuracy and experiences linear to sub-linear slowdowns as dimension increases, demonstrating the value of the algorithm for solving high-dimensional switching problems.
△ Less
Submitted 16 September, 2023; v1 submitted 6 October, 2022;
originally announced October 2022.
-
A smooth variational principle on Wasserstein space
Authors:
Erhan Bayraktar,
Ibrahim Ekren,
Xin Zhang
Abstract:
In this note, we provide a smooth variational principle on Wasserstein space by constructing a smooth gauge-type function using the sliced Wasserstein distance. This function is a crucial tool for optimization problems and in viscosity theory of PDEs on Wasserstein space.
In this note, we provide a smooth variational principle on Wasserstein space by constructing a smooth gauge-type function using the sliced Wasserstein distance. This function is a crucial tool for optimization problems and in viscosity theory of PDEs on Wasserstein space.
△ Less
Submitted 15 November, 2022; v1 submitted 29 September, 2022;
originally announced September 2022.
-
Data-Driven Nonparametric Robust Control under Dependence Uncertainty
Authors:
Erhan Bayraktar,
Tao Chen
Abstract:
We consider a multi-period stochastic control problem where the multivariate driving stochastic factor of the system has known marginal distributions but uncertain dependence structure. To solve the problem, we propose to implement the nonparametric adaptive robust control framework. We aim to find the optimal control against the worst-case copulae in a sequence of shrinking uncertainty sets which…
▽ More
We consider a multi-period stochastic control problem where the multivariate driving stochastic factor of the system has known marginal distributions but uncertain dependence structure. To solve the problem, we propose to implement the nonparametric adaptive robust control framework. We aim to find the optimal control against the worst-case copulae in a sequence of shrinking uncertainty sets which are generated from continuously observing the data. Then, we use a stochastic gradient descent ascent algorithm to numerically handle the corresponding high dimensional dynamic inf-sup optimization problem. We present the numerical results in the context of utility maximization and show that the controller benefits from knowing more information about the uncertain model.
△ Less
Submitted 11 September, 2022;
originally announced September 2022.
-
A Rank-Based Reward between a Principal and a Field of Agents: Application to Energy Savings
Authors:
Clémence Alasseur,
Erhan Bayraktar,
Roxana Dumitrescu,
Quentin Jacquet
Abstract:
In this paper, we consider the problem of a Principal aiming at designing a reward function for a population of heterogeneous agents. We construct an incentive based on the ranking of the agents, so that a competition among the latter is initiated. We place ourselves in the limit setting of mean-field type interactions and prove the existence and uniqueness of the equilibrium distribution for a gi…
▽ More
In this paper, we consider the problem of a Principal aiming at designing a reward function for a population of heterogeneous agents. We construct an incentive based on the ranking of the agents, so that a competition among the latter is initiated. We place ourselves in the limit setting of mean-field type interactions and prove the existence and uniqueness of the equilibrium distribution for a given reward, for which we can find an explicit representation. Focusing first on the homogeneous setting, we characterize the optimal reward function using a convex reformulation of the problem and provide an interpretation of its behaviour. We then show that this characterization still holds for a sub-class of heterogeneous populations. For the general case, we propose a convergent numerical method which fully exploits the characterization of the mean-field equilibrium. We develop a case study related to the French market of Energy Saving Certificates based on the use of realistic data, which shows that the ranking system allows to achieve the sobriety target imposed by the European commission.
△ Less
Submitted 1 August, 2023; v1 submitted 8 September, 2022;
originally announced September 2022.
-
A PDE approach for regret bounds under partial monitoring
Authors:
Erhan Bayraktar,
Ibrahim Ekren,
Xin Zhang
Abstract:
In this paper, we study a learning problem in which a forecaster only observes partial information. By properly rescaling the problem, we heuristically derive a limiting PDE on Wasserstein space which characterizes the asymptotic behavior of the regret of the forecaster. Using a verification type argument, we show that the problem of obtaining regret bounds and efficient algorithms can be tackled…
▽ More
In this paper, we study a learning problem in which a forecaster only observes partial information. By properly rescaling the problem, we heuristically derive a limiting PDE on Wasserstein space which characterizes the asymptotic behavior of the regret of the forecaster. Using a verification type argument, we show that the problem of obtaining regret bounds and efficient algorithms can be tackled by finding appropriate smooth sub/supersolutions of this parabolic PDE.
△ Less
Submitted 2 September, 2022;
originally announced September 2022.
-
Supermartingale shadow couplings: the decreasing case
Authors:
Erhan Bayraktar,
Shuoqing Deng,
Dominykas Norgilas
Abstract:
For two measures $μ$ and $ν$ that are in convex-decreasing order, Nutz and Stebegg (Canonical supermartingale couplings, Ann. Probab., 46(6):3351--3398, 2018) studied the optimal transport problem with supermartingale constraints and introduced two canonical couplings, namely the increasing and decreasing transport plans, that are optimal for a large class of cost functions. In the present paper w…
▽ More
For two measures $μ$ and $ν$ that are in convex-decreasing order, Nutz and Stebegg (Canonical supermartingale couplings, Ann. Probab., 46(6):3351--3398, 2018) studied the optimal transport problem with supermartingale constraints and introduced two canonical couplings, namely the increasing and decreasing transport plans, that are optimal for a large class of cost functions. In the present paper we provide an explicit construction of the decreasing coupling $π^D$ by establishing a Brenier-type result: (a generalised version of) $π^D$ concentrates on the graphs of two functions.
Our construction is based on the concept of the supermartingale \textit{shadow} measure and requires a suitable extension of the results by Juillet (Stability of the shadow projection and the left-curtain coupling, Ann. Inst. H. Poincaré Probab. Statist., 52(4):1823--1843, November 2016) and Beiglböck and Juillet (Shadow couplings, Trans. Amer. Math. Soc., 374:4973--5002, 2021) established in the martingale setting. In particular, we prove the stability of the supermartingale shadow measure with respect to initial and target measures $μ,ν$, introduce an infinite family of lifted supermartingale couplings that arise via shadow measure, and show how to explicitly determine the `martingale points' of each such coupling.
△ Less
Submitted 24 July, 2022;
originally announced July 2022.
-
Stability of Time-inconsistent Stop** for One-dimensional Diffusion -- A Longer Version
Authors:
Erhan Bayraktar,
Zhenhua Wang,
Zhou Zhou
Abstract:
We investigate the stability of the equilibrium-induced optimal value in one-dimensional diffusion setting for a time-inconsistent stop** problem under non-exponential discounting. We show that the optimal value is semi-continuous with respect to the drift, volatility, and reward function. An example is provided showing that the exact continuity may fail. With equilibria extended to…
▽ More
We investigate the stability of the equilibrium-induced optimal value in one-dimensional diffusion setting for a time-inconsistent stop** problem under non-exponential discounting. We show that the optimal value is semi-continuous with respect to the drift, volatility, and reward function. An example is provided showing that the exact continuity may fail. With equilibria extended to $\varepsilon$-equilibria, we establish the relaxed continuity of the optimal value.
△ Less
Submitted 3 October, 2022; v1 submitted 17 July, 2022;
originally announced July 2022.
-
Stability of Equilibria in Time-inconsistent Stop** Problems
Authors:
Erhan Bayraktar,
Zhenhua Wang,
Zhou Zhou
Abstract:
We investigate the stability of equilibrium-induced optimal values with respect to (w.r.t.) reward functions $f$ and transition kernels $Q$ for time-inconsistent stop** problems under nonexponential discounting in discrete time. First, with locally uniform convergence of $f$ and $Q$ equipped with total variation distance, we show that the optimal value is semi-continuous w.r.t. $(f,Q)$. We provi…
▽ More
We investigate the stability of equilibrium-induced optimal values with respect to (w.r.t.) reward functions $f$ and transition kernels $Q$ for time-inconsistent stop** problems under nonexponential discounting in discrete time. First, with locally uniform convergence of $f$ and $Q$ equipped with total variation distance, we show that the optimal value is semi-continuous w.r.t. $(f,Q)$. We provide examples showing that continuity may fail in general, and the convergence for $Q$ in total variation cannot be replaced by weak convergence. Next we show that with the uniform convergence of $f$ and $Q$, the optimal value is continuous w.r.t. $(f,Q)$ when we consider a relaxed limit over $\varepsilon$-equilibria. We also provide an example showing that for such continuity the uniform convergence of $(f,Q)$ cannot be replaced by locally uniform convergence.
△ Less
Submitted 17 May, 2022;
originally announced May 2022.
-
Concentration of measure for Graphon particle system
Authors:
Erhan Bayraktar,
Donghan Kim
Abstract:
We study heterogeneously interacting diffusive particle systems with mean-field type interaction characterized by an underlying graphon and their finite particle approximations. Under suitable conditions, we obtain exponential concentration estimates over a finite time horizon for both 1 and 2 Wasserstein distances between the empirical measures of the finite particle systems and the averaged law…
▽ More
We study heterogeneously interacting diffusive particle systems with mean-field type interaction characterized by an underlying graphon and their finite particle approximations. Under suitable conditions, we obtain exponential concentration estimates over a finite time horizon for both 1 and 2 Wasserstein distances between the empirical measures of the finite particle systems and the averaged law of the graphon system, extending the work of Bayraktar-Wu.
△ Less
Submitted 10 May, 2022;
originally announced May 2022.
-
Exponential Entropy dissipation for weakly self-consistent Vlasov-Fokker-Planck equations
Authors:
Erhan Bayraktar,
Qi Feng,
Wuchen Li
Abstract:
We study long-time dynamical behaviors of weakly self-consistent Vlasov-Fokker-Planck equations. We introduce Hessian matrix conditions on mean-field kernel functions, which characterizes the exponential convergence of solutions in $L^1$ distances. The matrix condition is derived from the dissipation of a selected Lyapunov functional, namely auxiliary Fisher information functional. We verify propo…
▽ More
We study long-time dynamical behaviors of weakly self-consistent Vlasov-Fokker-Planck equations. We introduce Hessian matrix conditions on mean-field kernel functions, which characterizes the exponential convergence of solutions in $L^1$ distances. The matrix condition is derived from the dissipation of a selected Lyapunov functional, namely auxiliary Fisher information functional. We verify proposed matrix conditions in examples.
△ Less
Submitted 23 October, 2023; v1 submitted 25 April, 2022;
originally announced April 2022.
-
Walsh Diffusions as Time Changed Multi-parameter Processes
Authors:
Erhan Bayraktar,
**gjie Zhang,
Xin Zhang
Abstract:
Inspired by allocation strategies in multi-armed bandit model, we propose a pathwise construction of Walsh diffusions. For any infinitesimal generator on a star shaped graph, there exists a unique time change associated with a multi-parameter process such that the time change of this multi-parameter process is the desired diffusion. The time change has an interpretation of time allocation of the p…
▽ More
Inspired by allocation strategies in multi-armed bandit model, we propose a pathwise construction of Walsh diffusions. For any infinitesimal generator on a star shaped graph, there exists a unique time change associated with a multi-parameter process such that the time change of this multi-parameter process is the desired diffusion. The time change has an interpretation of time allocation of the process on each edge, and it can be derived explicitly from a family of equations.
△ Less
Submitted 5 July, 2024; v1 submitted 14 April, 2022;
originally announced April 2022.
-
Approximate Q-Learning for Controlled Diffusion Processes and its Near Optimality
Authors:
Erhan Bayraktar,
Ali Devran Kara
Abstract:
We study a Q learning algorithm for continuous time stochastic control problems. The proposed algorithm uses the sampled state process by discretizing the state and control action spaces under piece-wise constant control processes. We show that the algorithm converges to the optimality equation of a finite Markov decision process (MDP). Using this MDP model, we provide an upper bound for the appro…
▽ More
We study a Q learning algorithm for continuous time stochastic control problems. The proposed algorithm uses the sampled state process by discretizing the state and control action spaces under piece-wise constant control processes. We show that the algorithm converges to the optimality equation of a finite Markov decision process (MDP). Using this MDP model, we provide an upper bound for the approximation error for the optimal value function of the continuous time control problem. Furthermore, we present provable upper-bounds for the performance loss of the learned control process compared to the optimal admissible control process of the original problem. The provided error upper-bounds are functions of the time and space discretization parameters, and they reveal the effect of different levels of the approximation: (i) approximation of the continuous time control problem by an MDP, (ii) use of piece-wise constant control processes, (iii) space discretization. Finally, we state a time complexity bound for the proposed algorithm as a function of the time and space discretization parameters.
△ Less
Submitted 8 March, 2023; v1 submitted 14 March, 2022;
originally announced March 2022.
-
Nonparametric Adaptive Robust Control Under Model Uncertainty
Authors:
Erhan Bayraktar,
Tao Chen
Abstract:
We consider a discrete time stochastic Markovian control problem under model uncertainty. Such uncertainty not only comes from the fact that the true probability law of the underlying stochastic process is unknown, but the parametric family of probability distributions which the true law belongs to is also unknown. We propose a nonparametric adaptive robust control methodology to deal with such pr…
▽ More
We consider a discrete time stochastic Markovian control problem under model uncertainty. Such uncertainty not only comes from the fact that the true probability law of the underlying stochastic process is unknown, but the parametric family of probability distributions which the true law belongs to is also unknown. We propose a nonparametric adaptive robust control methodology to deal with such problem. Our approach hinges on the following building concepts: first, using the adaptive robust paradigm to incorporate online learning and uncertainty reduction into the robust control problem; second, learning the unknown probability law through the empirical distribution, and representing uncertainty reduction in terms of a sequence of Wasserstein balls around the empirical distribution; third, using Lagrangian duality to convert the optimization over Wasserstein balls to a scalar optimization problem, and adopting a machine learning technique to achieve efficient computation of the optimal control. We illustrate our methodology by considering a utility maximization problem. Numerical comparisons show that the nonparametric adaptive robust control approach is preferable to the traditional robust frameworks.
△ Less
Submitted 21 March, 2022; v1 submitted 21 February, 2022;
originally announced February 2022.
-
Propagation of Chaos of Forward-Backward Stochastic Differential Equations with Graphon Interactions
Authors:
Erhan Bayraktar,
Ruoyu Wu,
Xin Zhang
Abstract:
In this paper, we study graphon mean field games using a system of forward-backward stochastic differential equations. We establish the existence and uniqueness of solutions under two different assumptions and prove the stability with respect to the interacting graphons which are necessary to show propagation of chaos results. As an application of propagation of chaos, we prove the convergence of…
▽ More
In this paper, we study graphon mean field games using a system of forward-backward stochastic differential equations. We establish the existence and uniqueness of solutions under two different assumptions and prove the stability with respect to the interacting graphons which are necessary to show propagation of chaos results. As an application of propagation of chaos, we prove the convergence of n-player game Nash equilibrium for a general model, which is new in the theory of graphon mean field games.
△ Less
Submitted 16 February, 2022;
originally announced February 2022.
-
Equilibria of Time-inconsistent Stop** for One-dimensional Diffusion Processes
Authors:
Erhan Bayraktar,
Zhenhua Wang,
Zhou Zhou
Abstract:
We consider three equilibrium concepts proposed in the literature for time-inconsistent stop** problems, including mild equilibria, weak equilibria and strong equilibria. The discount function is assumed to be log sub-additive and the underlying process is one-dimensional diffusion. We first provide necessary and sufficient conditions for the characterization of weak equilibria. The smooth-fit c…
▽ More
We consider three equilibrium concepts proposed in the literature for time-inconsistent stop** problems, including mild equilibria, weak equilibria and strong equilibria. The discount function is assumed to be log sub-additive and the underlying process is one-dimensional diffusion. We first provide necessary and sufficient conditions for the characterization of weak equilibria. The smooth-fit condition is obtained as a by-product. Next, based on the characterization of weak equilibria, we show that an optimal mild equilibrium is also weak. Then we provide conditions under which a weak equilibrium is strong. We further show that an optimal mild equilibrium is also strong under a certain condition. Finally, we provide several examples including one shows a weak equilibrium may not be strong, and another one shows a strong equilibrium may not be optimal mild.
△ Less
Submitted 2 November, 2022; v1 submitted 19 January, 2022;
originally announced January 2022.
-
Mean field control and finite dimensional approximation for regime-switching jump diffusions
Authors:
Erhan Bayraktar,
Alekos Cecchin,
Prakash Chakraborty
Abstract:
We consider a jump-diffusion mean field control problem with regime switching in the state dynamics. The corresponding value function is characterized as the unique viscosity solution of a HJB master equation on the space of probability measures. Using this characterization, we prove that the value function, which is not regular, is the limit of a finite agent centralized optimal control problem a…
▽ More
We consider a jump-diffusion mean field control problem with regime switching in the state dynamics. The corresponding value function is characterized as the unique viscosity solution of a HJB master equation on the space of probability measures. Using this characterization, we prove that the value function, which is not regular, is the limit of a finite agent centralized optimal control problem as the number of agents go to infinity, with an explicit convergence rate. Assuming in addition that the value function is smooth, we establish a quantitative propagation of chaos result for the optimal trajectory of agent states.
△ Less
Submitted 19 September, 2022; v1 submitted 19 September, 2021;
originally announced September 2021.
-
A potential-based construction of the increasing supermartingale coupling
Authors:
Erhan Bayraktar,
Shuoqing Deng,
Dominykas Norgilas
Abstract:
The increasing supermartingale coupling, introduced by Nutz and Stebegg (Canonical supermartingale couplings, Annals of Probability, 46(6):3351--3398, 2018) is an extreme point of the set of `supermartingale' couplings between two real probability measures in convex-decreasing order. In the present paper we provide an explicit construction of a triple of functions, on the graph of which the increa…
▽ More
The increasing supermartingale coupling, introduced by Nutz and Stebegg (Canonical supermartingale couplings, Annals of Probability, 46(6):3351--3398, 2018) is an extreme point of the set of `supermartingale' couplings between two real probability measures in convex-decreasing order. In the present paper we provide an explicit construction of a triple of functions, on the graph of which the increasing supermartingale coupling concentrates. In particular, we show that the increasing supermartingale coupling can be identified with the left-curtain martingale coupling and the antitone coupling to the left and to the right of a uniquely determined regime-switching point, respectively.
Our construction is based on the concept of the shadow measure. We show how to determine the potential of the shadow measure associated to a supermartingale, extending the recent results of Beiglböck et al. (The potential of the shadow measure, Electron. Commun. Probab., 27, paper no. 16, 1--12, 2022) obtained in the martingale setting.
△ Less
Submitted 14 March, 2022; v1 submitted 7 August, 2021;
originally announced August 2021.
-
A Note on Utility Maximization with Proportional Transaction Costs and Stability of Optimal Portfolios
Authors:
Erhan Bayraktar,
Christoph Czichowsky,
Leonid Dolinskyi,
Yan Dolinsky
Abstract:
The aim of this short note is to establish a limit theorem for the optimal trading strategies in the setup of the utility maximization problem with proportional transaction costs. This limit theorem resolves the open question from [4]. The main idea of our proof is to establish a uniqueness result for the optimal strategy. The proof of the uniqueness is heavily based on the dual approach which was…
▽ More
The aim of this short note is to establish a limit theorem for the optimal trading strategies in the setup of the utility maximization problem with proportional transaction costs. This limit theorem resolves the open question from [4]. The main idea of our proof is to establish a uniqueness result for the optimal strategy. The proof of the uniqueness is heavily based on the dual approach which was developed recently in [6,7,8].
△ Less
Submitted 25 September, 2021; v1 submitted 4 July, 2021;
originally announced July 2021.
-
Graphon particle system: Uniform-in-time concentration bounds
Authors:
Erhan Bayraktar,
Ruoyu Wu
Abstract:
In this paper, we consider graphon particle systems with heterogeneous mean-field type interactions and the associated finite particle approximations. Under suitable growth (resp. convexity) assumptions, we obtain uniform-in-time concentration estimates, over finite (resp. infinite) time horizon, for the Wasserstein distance between the empirical measure and its limit, extending the work of Bolley…
▽ More
In this paper, we consider graphon particle systems with heterogeneous mean-field type interactions and the associated finite particle approximations. Under suitable growth (resp. convexity) assumptions, we obtain uniform-in-time concentration estimates, over finite (resp. infinite) time horizon, for the Wasserstein distance between the empirical measure and its limit, extending the work of Bolley--Guillin--Villani.
△ Less
Submitted 20 October, 2022; v1 submitted 23 May, 2021;
originally announced May 2021.
-
A Central Limit Theorem for Diffusion in Sparse Random Graphs
Authors:
Hamed Amini,
Erhan Bayraktar,
Suman Chakraborty
Abstract:
We consider bootstrap percolation and diffusion in sparse random graphs with fixed degrees, constructed by configuration model. Every node has two states: it is either active or inactive. We assume that to each node is assigned a nonnegative (integer) threshold. The diffusion process is initiated by a subset of nodes with threshold zero which consists of initially activated nodes, whereas every ot…
▽ More
We consider bootstrap percolation and diffusion in sparse random graphs with fixed degrees, constructed by configuration model. Every node has two states: it is either active or inactive. We assume that to each node is assigned a nonnegative (integer) threshold. The diffusion process is initiated by a subset of nodes with threshold zero which consists of initially activated nodes, whereas every other node is inactive. Subsequently, in each round, if an inactive node with threshold $θ$ has at least $θ$ of its neighbours activated, then it also becomes active and remains so forever. This is repeated until no more nodes become activated. The main result of this paper provides a central limit theorem for the final size of activated nodes. Namely, under suitable assumptions on the degree and threshold distributions, we show that the final size of activated nodes has asymptotically Gaussian fluctuations.
△ Less
Submitted 25 September, 2022; v1 submitted 27 February, 2021;
originally announced March 2021.
-
Solvability of Infinite horizon McKean-Vlasov FBSDEs in Mean Field Control Problems and Games
Authors:
Erhan Bayraktar,
Xin Zhang
Abstract:
In this paper, we show existence and uniqueness of solutions of the infinite horizon McKean-Vlasov FBSDEs using two different methods, which lead to two different sets of assumptions. We use these results to solve the infinite horizon mean field type control problems and mean field games.
In this paper, we show existence and uniqueness of solutions of the infinite horizon McKean-Vlasov FBSDEs using two different methods, which lead to two different sets of assumptions. We use these results to solve the infinite horizon mean field type control problems and mean field games.
△ Less
Submitted 6 October, 2022; v1 submitted 18 February, 2021;
originally announced February 2021.
-
Optimal Investment and Consumption under a Habit-Formation Constraint
Authors:
Bahman Angoshtari,
Erhan Bayraktar,
Virginia R. Young
Abstract:
We formulate an infinite-horizon optimal investment and consumption problem, in which an individual forms a habit based on the exponentially weighted average of her past consumption rate, and in which she invests in a Black-Scholes market. The individual is constrained to consume at a rate higher than a certain proportion $α$ of her consumption habit. Our habit-formation model allows for both addi…
▽ More
We formulate an infinite-horizon optimal investment and consumption problem, in which an individual forms a habit based on the exponentially weighted average of her past consumption rate, and in which she invests in a Black-Scholes market. The individual is constrained to consume at a rate higher than a certain proportion $α$ of her consumption habit. Our habit-formation model allows for both addictive ($α=1$) and nonaddictive ($0<α<1$) habits. The optimal investment and consumption policies are derived explicitly in terms of the solution of a system of differential equations with free boundaries, which is analyzed in detail. If the wealth-to-habit ratio is below (resp. above) a critical level $x^*$, the individual consumes at (resp. above) the minimum rate and invests more (resp. less) aggressively in the risky asset. Numerical results show that the addictive habit formation requires significantly more wealth to support the same consumption rate compared to a moderately nonaddictive habit. Furthermore, an individual with a more addictive habit invests less in the risky asset compared to an individual with a less addictive habit but with the same wealth-to-habit ratio and risk aversion, which provides an explanation for the equity-premium puzzle.
△ Less
Submitted 25 November, 2021; v1 submitted 5 February, 2021;
originally announced February 2021.
-
Path-dependent Hamilton-Jacobi equations with super-quadratic growth in the gradient and the vanishing viscosity method
Authors:
Erhan Bayraktar,
Christian Keller
Abstract:
The non-exponential Schilder-type theorem in Backhoff-Veraguas, Lacker and Tangpi [Ann. Appl. Probab., 30 (2020), pp. 1321-1367] is expressed as a convergence result for path-dependent partial differential equations with appropriate notions of generalized solutions. This entails a non-Markovian counterpart to the vanishing viscosity method.
We show uniqueness of maximal subsolutions for path-dep…
▽ More
The non-exponential Schilder-type theorem in Backhoff-Veraguas, Lacker and Tangpi [Ann. Appl. Probab., 30 (2020), pp. 1321-1367] is expressed as a convergence result for path-dependent partial differential equations with appropriate notions of generalized solutions. This entails a non-Markovian counterpart to the vanishing viscosity method.
We show uniqueness of maximal subsolutions for path-dependent viscous Hamilton-Jacobi equations related to convex super-quadratic backward stochastic differential equations.
We establish well-posedness for the Hamilton-Jacobi-Bellman equation associated to a Bolza problem of the calculus of variations with path-dependent terminal cost. In particular, uniqueness among lower semi-continuous solutions holds and state constraints are admitted.
△ Less
Submitted 27 February, 2022; v1 submitted 29 January, 2021;
originally announced February 2021.
-
K-core in percolated dense graph sequences
Authors:
Erhan Bayraktar,
Suman Chakraborty,
Xin Zhang
Abstract:
We determine the size of $k$-core in a large class of dense graph sequences. Let $G_n$ be a sequence of undirected, $n$-vertex graphs with edge weights $\{a^n_{i,j}\}_{i,j \in [n]}$ that converges to a kernel $W:[0,1]^2\to [0,+\infty)$ in the cut metric. Kee** an edge $(i,j)$ of $G_n$ with probability $\min \{ {a^n_{i,j}}/{n},1 \}$ independently, we obtain a sequence of random graphs…
▽ More
We determine the size of $k$-core in a large class of dense graph sequences. Let $G_n$ be a sequence of undirected, $n$-vertex graphs with edge weights $\{a^n_{i,j}\}_{i,j \in [n]}$ that converges to a kernel $W:[0,1]^2\to [0,+\infty)$ in the cut metric. Kee** an edge $(i,j)$ of $G_n$ with probability $\min \{ {a^n_{i,j}}/{n},1 \}$ independently, we obtain a sequence of random graphs $G_n(\frac{1}{n})$. Denote by $\mathcal{A}$ the property of a branching process that the initial particle has at least $k$ children, each of which has at least $k-1$ children, each of which has at least $k-1$ children, and so on. Using branching process and the theory of dense graph limits, under mild assumptions we obtain the size of $k$-core of random graphs $G_n(\frac{1}{n})$, \begin{align*} \text{size of $k$-core of } G_n\left(\frac{1}{n}\right) =n \mathbb{P}_{X^W}\left(\mathcal{A}\right) +o_p(n). \end{align*} Our result can also be used to obtain the threshold of appearance of a $k$-core of order $n$.
△ Less
Submitted 10 May, 2022; v1 submitted 17 December, 2020;
originally announced December 2020.
-
Finite state mean field games with Wright Fisher common noise as limits of $N$-player weighted games
Authors:
Erhan Bayraktar,
Alekos Cecchin,
Asaf Cohen,
François Delarue
Abstract:
Forcing finite state mean field games by a relevant form of common noise is a subtle issue, which has been addressed only recently. Among others, one possible way is to subject the simplex valued dynamics of an equilibrium by a so-called Wright-Fisher noise, very much in the spirit of stochastic models in population genetics. A key feature is that such a random forcing preserves the structure of t…
▽ More
Forcing finite state mean field games by a relevant form of common noise is a subtle issue, which has been addressed only recently. Among others, one possible way is to subject the simplex valued dynamics of an equilibrium by a so-called Wright-Fisher noise, very much in the spirit of stochastic models in population genetics. A key feature is that such a random forcing preserves the structure of the simplex, which is nothing but, in this setting, the probability space over the state space of the game. The purpose of this article is hence to elucidate the finite player version and, accordingly, to prove that $N$-player equilibria indeed converge towards the solution of such a kind of Wright-Fisher mean field game. Whilst part of the analysis is made easier by the fact that the corresponding master equation has already been proved to be uniquely solvable under the presence of the common noise, it becomes however more subtle than in the standard setting because the mean field interaction between the players now occurs through a weighted empirical measure. In other words, each player carries its own weight, which hence may differ from $1/N$ and which, most of all, evolves with the common noise.
△ Less
Submitted 1 November, 2021; v1 submitted 8 December, 2020;
originally announced December 2020.
-
Optimal Consumption under a Habit-Formation Constraint: the Deterministic Case
Authors:
Bahman Angoshtari,
Erhan Bayraktar,
Virginia R. Young
Abstract:
We formulate and solve a deterministic optimal consumption problem to maximize the discounted CRRA utility of an individual's consumption-to-habit process assuming she only invests in a riskless market and that she is unwilling to consume at a rate below a certain proportion $α\in(0,1]$ of her consumption habit. Increasing $α$, increases the degree of addictiveness of habit formation, with $α=0$ (…
▽ More
We formulate and solve a deterministic optimal consumption problem to maximize the discounted CRRA utility of an individual's consumption-to-habit process assuming she only invests in a riskless market and that she is unwilling to consume at a rate below a certain proportion $α\in(0,1]$ of her consumption habit. Increasing $α$, increases the degree of addictiveness of habit formation, with $α=0$ (respectively, $α=1$) corresponding to non-addictive (respectively, completely addictive) model. We derive the optimal consumption policies explicitly in terms of the solution of a nonlinear free-boundary problem, which we analyze in detail. Impatient individuals (or, equivalently, those with more addictive habits) always consume above the minimum rate; thus, they eventually attain the minimum wealth-to-habit ratio. Patient individuals (or, equivalently, those with less addictive habits) consume at the minimum rate if their wealth-to-habit ratio is below a threshold, and above it otherwise. By consuming patiently, these individuals maintain a wealth-to-habit ratio that is greater than the minimum acceptable level. Additionally, we prove that the optimal consumption path is hump-shaped if the initial wealth-to-habit ratio is either: (1) larger than a high threshold; or (2) below a low threshold and the agent is more risk seeking (that is, less risk averse). Thus, we provide a simple explanation for the consumption hump observed by various empirical studies.
△ Less
Submitted 18 October, 2022; v1 submitted 3 December, 2020;
originally announced December 2020.
-
Optimal Stop** with Expectation Constraints
Authors:
Erhan Bayraktar,
Song Yao
Abstract:
We analyze an optimal stop** problem with a series of inequality-type and equality-type expectation constraints in a general non-Markovian framework. We show that the optimal stop** problem with expectation constraints (OSEC) in an arbitrary probability setting is equivalent to the constrained problem in weak formulation (optimization over joint laws of stop** rules with Brownian motion and…
▽ More
We analyze an optimal stop** problem with a series of inequality-type and equality-type expectation constraints in a general non-Markovian framework. We show that the optimal stop** problem with expectation constraints (OSEC) in an arbitrary probability setting is equivalent to the constrained problem in weak formulation (optimization over joint laws of stop** rules with Brownian motion and state dynamics on an enlarged canonical space) and thus the OSEC value. Using a martingale-problem formulation, we make an equivalent characterization of the probability classes in weak formulation, which implies that the OSEC value function s upper semi-analytic. Then we exploit a measurable selection argument to establish a dynamic programming principle in weak formulation for the OSEC value function, in which the conditional expected costs act as additional states for constraint levels at the intermediate horizon.
△ Less
Submitted 8 February, 2023; v1 submitted 9 November, 2020;
originally announced November 2020.
-
Prediction against a limited adversary
Authors:
Erhan Bayraktar,
Ibrahim Ekren,
Xin Zhang
Abstract:
We study the problem of prediction with expert advice with adversarial corruption where the adversary can at most corrupt one expert. Using tools from viscosity theory, we characterize the long-time behavior of the value function of the game between the forecaster and the adversary. We provide lower and upper bounds for the growth rate of regret without relying on a comparison result. We show that…
▽ More
We study the problem of prediction with expert advice with adversarial corruption where the adversary can at most corrupt one expert. Using tools from viscosity theory, we characterize the long-time behavior of the value function of the game between the forecaster and the adversary. We provide lower and upper bounds for the growth rate of regret without relying on a comparison result. We show that depending on the description of regret, the limiting behavior of the game can significantly differ.
△ Less
Submitted 1 March, 2021; v1 submitted 30 October, 2020;
originally announced November 2020.
