-
Conditional Generators for Limit Order Book Environments: Explainability, Challenges, and Robustness
Authors:
Andrea Coletta,
Joseph Jerome,
Rahul Savani,
Svitlana Vyetrenko
Abstract:
Limit order books are a fundamental and widespread market mechanism. This paper investigates the use of conditional generative models for order book simulation. For develo** a trading agent, this approach has drawn recent attention as an alternative to traditional backtesting due to its ability to react to the presence of the trading agent. Using a state-of-the-art CGAN (from Coletta et al. (202…
▽ More
Limit order books are a fundamental and widespread market mechanism. This paper investigates the use of conditional generative models for order book simulation. For develo** a trading agent, this approach has drawn recent attention as an alternative to traditional backtesting due to its ability to react to the presence of the trading agent. Using a state-of-the-art CGAN (from Coletta et al. (2022)), we explore its dependence upon input features, which highlights both strengths and weaknesses. To do this, we use "adversarial attacks" on the model's features and its mechanism. We then show how these insights can be used to improve the CGAN, both in terms of its realism and robustness. We finish by laying out a roadmap for future work.
△ Less
Submitted 22 June, 2023;
originally announced June 2023.
-
Model-based gym environments for limit order book trading
Authors:
Joseph Jerome,
Leandro Sanchez-Betancourt,
Rahul Savani,
Martin Herdegen
Abstract:
Within the mathematical finance literature there is a rich catalogue of mathematical models for studying algorithmic trading problems -- such as market-making and optimal execution -- in limit order books. This paper introduces \mbtgym, a Python module that provides a suite of gym environments for training reinforcement learning (RL) agents to solve such model-based trading problems. The module is…
▽ More
Within the mathematical finance literature there is a rich catalogue of mathematical models for studying algorithmic trading problems -- such as market-making and optimal execution -- in limit order books. This paper introduces \mbtgym, a Python module that provides a suite of gym environments for training reinforcement learning (RL) agents to solve such model-based trading problems. The module is set up in an extensible way to allow the combination of different aspects of different models. It supports highly efficient implementations of vectorized environments to allow faster training of RL agents. In this paper, we motivate the challenge of using RL to solve such model-based limit order book problems in mathematical finance, we explain the design of our gym environment, and then demonstrate its use in solving standard and non-standard problems from the literature. Finally, we lay out a roadmap for further development of our module, which we provide as an open source repository on GitHub so that it can serve as a focal point for RL research in model-based algorithmic trading.
△ Less
Submitted 16 September, 2022;
originally announced September 2022.
-
Market Making with Scaled Beta Policies
Authors:
Joseph Jerome,
Gregory Palmer,
Rahul Savani
Abstract:
This paper introduces a new representation for the actions of a market maker in an order-driven market. This representation uses scaled beta distributions, and generalises three approaches taken in the artificial intelligence for market making literature: single price-level selection, ladder strategies and "market making at the touch". Ladder strategies place uniform volume across an interval of c…
▽ More
This paper introduces a new representation for the actions of a market maker in an order-driven market. This representation uses scaled beta distributions, and generalises three approaches taken in the artificial intelligence for market making literature: single price-level selection, ladder strategies and "market making at the touch". Ladder strategies place uniform volume across an interval of contiguous prices. Scaled beta distribution based policies generalise these, allowing volume to be skewed across the price interval. We demonstrate that this flexibility is useful for inventory management, one of the key challenges faced by a market maker.
In this paper, we conduct three main experiments: first, we compare our more flexible beta-based actions with the special case of ladder strategies; then, we investigate the performance of simple fixed distributions; and finally, we devise and evaluate a simple and intuitive dynamic control policy that adjusts actions in a continuous manner depending on the signed inventory that the market maker has acquired. All empirical evaluations use a high-fidelity limit order book simulator based on historical data with 50 levels on each side.
△ Less
Submitted 27 September, 2022; v1 submitted 7 July, 2022;
originally announced July 2022.
-
Proper solutions for Epstein-Zin Stochastic Differential Utility
Authors:
Martin Herdegen,
David Hobson,
Joseph Jerome
Abstract:
In this article, we consider the optimal investment-consumption problem for an agent with preferences governed by Epstein--Zin stochastic differential utility (EZ-SDU) who invests in a constant-parameter Black-Scholes-Merton market over the infinite horizon. The parameter combinations that we consider in this paper are such that the risk aversion parameter $R$ and the elasticity of intertemporal c…
▽ More
In this article, we consider the optimal investment-consumption problem for an agent with preferences governed by Epstein--Zin stochastic differential utility (EZ-SDU) who invests in a constant-parameter Black-Scholes-Merton market over the infinite horizon. The parameter combinations that we consider in this paper are such that the risk aversion parameter $R$ and the elasticity of intertemporal complementarity $S$ satisfy $θ=\frac{1-R}{1-S}>1$. In this sense, this paper is complementary to Herdegen, Hobson and Jerome [arXiv:2107.06593].
The main novelty of the case $θ>1$ (as opposed to $θ\in(0,1)$) is that there is an infinite family of utility processes associated to every nonzero consumption stream. To deal with this issue, we introduce the economically motivated notion of a proper utility process, where, roughly speaking, a utility process is proper if it is nonzero whenever future consumption is nonzero.
We then proceed to show that for a very wide class of consumption streams $C$, there exists a proper utility process $V$ associated to $C$. Furthermore, for a wide class of consumption streams $C$, the proper utility process $V$ is unique. Finally, we solve the optimal investment-consumption problem in a constant parameter financial market, where we optimise over the right-continuous attainable consumption streams that have a unique proper utility process associated to them.
△ Less
Submitted 13 December, 2021;
originally announced December 2021.
-
The Infinite Horizon Investment-Consumption Problem for Epstein-Zin Stochastic Differential Utility
Authors:
David Hobson,
Martin Herdegen,
Joseph Jerome
Abstract:
In this article we consider the optimal investment-consumption problem for an agent with preferences governed by Epstein-Zin stochastic differential utility who invests in a constant-parameter Black-Scholes-Merton market.
The paper has three main goals: first, to provide a detailed introduction to infinite-horizon Epstein-Zin stochastic differential utility, including a discussion of which param…
▽ More
In this article we consider the optimal investment-consumption problem for an agent with preferences governed by Epstein-Zin stochastic differential utility who invests in a constant-parameter Black-Scholes-Merton market.
The paper has three main goals: first, to provide a detailed introduction to infinite-horizon Epstein-Zin stochastic differential utility, including a discussion of which parameter combinations lead to a well-formulated problem; second, to prove existence and uniqueness of infinite horizon Epstein-Zin stochastic differential utility under a restriction on the parameters governing the agent's risk aversion and temporal variance aversion; and third, to provide a verification argument for the candidate optimal solution to the investment-consumption problem among all admissible consumption streams.
To achieve these goals, we introduce a slightly different formulation of Epstein-Zin stochastic differential utility to that which is traditionally used in the literature. This formulation highlights the necessity and appropriateness of certain restrictions on the parameters governing the stochastic differential utility function.
△ Less
Submitted 14 July, 2021;
originally announced July 2021.
-
An elementary approach to the Merton problem
Authors:
Martin Herdegen,
David Hobson,
Joseph Jerome
Abstract:
In this article we consider the infinite-horizon Merton investment-consumption problem in a constant-parameter Black - Scholes - Merton market for an agent with constant relative risk aversion R. The classical primal approach is to write down a candidate value function and to use a verification argument to prove that this is the solution to the problem. However, features of the problem take it out…
▽ More
In this article we consider the infinite-horizon Merton investment-consumption problem in a constant-parameter Black - Scholes - Merton market for an agent with constant relative risk aversion R. The classical primal approach is to write down a candidate value function and to use a verification argument to prove that this is the solution to the problem. However, features of the problem take it outside the standard settings of stochastic control, and the existing primal verification proofs rely on parameter restrictions (especially, but not only, R<1), restrictions on the space of admissible strategies, or intricate approximation arguments.
The purpose of this paper is to show that these complications can be overcome using a simple and elegant argument involving a stochastic perturbation of the utility function.
△ Less
Submitted 30 March, 2021; v1 submitted 9 June, 2020;
originally announced June 2020.
