-
Variational inequalities and smooth-fit principle for singular stochastic control problems in Hilbert spaces
Authors:
Salvatore Federico,
Giorgio Ferrari,
Frank Riedel,
Michael Röckner
Abstract:
We consider a class of infinite-dimensional singular stochastic control problems. These can be thought of as spatial monotone follower problems and find applications in spatial models of production and climate transition. Let $(D,\mathcal{M},μ)$ be a finite measure space and consider the Hilbert space $H:=L^2(D,\mathcal{M},μ; \mathbb{R})$. Let then $X$ be an $H$-valued stochastic process on a suit…
▽ More
We consider a class of infinite-dimensional singular stochastic control problems. These can be thought of as spatial monotone follower problems and find applications in spatial models of production and climate transition. Let $(D,\mathcal{M},μ)$ be a finite measure space and consider the Hilbert space $H:=L^2(D,\mathcal{M},μ; \mathbb{R})$. Let then $X$ be an $H$-valued stochastic process on a suitable complete probability space, whose evolution is determined through an SPDE driven by a self-adjoint linear operator $\mathcal{A}$ and affected by a cylindrical Brownian motion. The evolution of $X$ is controlled linearly via an $H$-valued control consisting of the direction and the intensity of action, a real-valued nondecreasing right-continuous stochastic process, adapted to the underlying filtration. The goal is to minimize a discounted convex cost-functional over an infinite time-horizon. By combining properties of semiconcave functions and techniques from viscosity theory, we first show that the value function of the problem $V$ is a $C^{1,Lip}(H)$-viscosity solution to the corresponding dynamic programming equation, which here takes the form of a variational inequality with gradient constraint. Then, by allowing the decision maker to choose only the intensity of the control and requiring that the given control direction $\hat{n}$ is an eigenvector of the linear operator $\mathcal{A}$, we establish that the directional derivative $V_{\hat{n}}$ is of class $C^1(H)$, hence a second-order smooth-fit principle in the controlled direction holds for $V$. This result is obtained by exploiting a connection to optimal stop** and combining results and techniques from convex analysis and viscosity theory.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
Cooperation, Correlation and Competition in Ergodic $N$-player Games and Mean-field Games of Singular Controls: A Case Study
Authors:
Federico Cannerozzi,
Giorgio Ferrari
Abstract:
We consider ergodic symmetric $N$-player and mean-field games of singular control in both cooperative and competitive settings. The state process dynamics of a representative player follow geometric Brownian motion, controlled additively through a nondecreasing process. Agents aim to maximize a long-time average reward functional with instantaneous profit of power type. The game shows strategic co…
▽ More
We consider ergodic symmetric $N$-player and mean-field games of singular control in both cooperative and competitive settings. The state process dynamics of a representative player follow geometric Brownian motion, controlled additively through a nondecreasing process. Agents aim to maximize a long-time average reward functional with instantaneous profit of power type. The game shows strategic complementarities, in that the marginal profit function is increasing with respect to the dynamic average of the states of the other players, when $N<\infty$, or with respect to the stationary mean of the players' distribution, in the mean-field case. In the mean-field formulation, we explicitly construct the solution to the mean-field control problem associated with central planner optimization, as well as Nash and coarse correlated equilibria (with singular and regular recommendations). Among our findings, we show that coarse correlated equilibria may exist even when Nash equilibria do not. Additionally, we show that a coarse correlated equilibrium with a regular (absolutely continuous) recommendation can outperform a Nash equilibrium where the equilibrium policy is of reflecting type (thus singularly continuous). Furthermore, we prove that the constructed mean-field control and mean-field equilibria can approximate the cooperative and competitive equilibria, respectively, in the corresponding game with $N$ players when $N$ is sufficiently large. To the best of our knowledge, this paper is the first to characterize coarse correlated equilibria, construct the explicit solution to an ergodic mean-field control problem, and provide approximation results for the related $N$-player game in the context of singular control games.
△ Less
Submitted 23 April, 2024;
originally announced April 2024.
-
A mean-field model of optimal investment
Authors:
Alessandro Calvia,
Salvatore Federico,
Giorgio Ferrari,
Fausto Gozzi
Abstract:
We establish the existence and uniqueness of the equilibrium for a stochastic mean-field game of optimal investment. The analysis covers both finite and infinite time horizons, and the mean-field interaction of the representative company with a mass of identical and indistinguishable firms is modeled through the time-dependent price at which the produced good is sold. At equilibrium, this price is…
▽ More
We establish the existence and uniqueness of the equilibrium for a stochastic mean-field game of optimal investment. The analysis covers both finite and infinite time horizons, and the mean-field interaction of the representative company with a mass of identical and indistinguishable firms is modeled through the time-dependent price at which the produced good is sold. At equilibrium, this price is given in terms of a nonlinear function of the expected (optimally controlled) production capacity of the representative company at each time. The proof of the existence and uniqueness of the mean-field equilibrium relies on a priori estimates and the study of nonlinear integral equations, but employs different techniques for the finite and infinite horizon cases. Additionally, we investigate the deterministic counterpart of the mean-field game under study.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
Multiple equilibria in mean-field game models for large oligopolies with strategic complementarities
Authors:
Jodi Dianetti,
Salvatore Federico,
Giorgio Ferrari,
Giuseppe Floccari
Abstract:
We consider continuous-time mean-field stochastic games with strategic complementarities. The interaction between the representative productive firm and the population of rivals comes through the price at which the produced good is sold and the intensity of interaction is measured by a so-called "strenght parameter" $ξ$. Via lattice-theoretic arguments we first prove existence of equilibria and pr…
▽ More
We consider continuous-time mean-field stochastic games with strategic complementarities. The interaction between the representative productive firm and the population of rivals comes through the price at which the produced good is sold and the intensity of interaction is measured by a so-called "strenght parameter" $ξ$. Via lattice-theoretic arguments we first prove existence of equilibria and provide comparative statics results when varying $ξ$. A careful numerical study based on iterative schemes converging to suitable maximal and minimal equilibria allows then to study in relevant financial examples how the emergence of multiple equilibria is related to the strenght of the strategic interaction.
△ Less
Submitted 12 February, 2024; v1 submitted 30 January, 2024;
originally announced January 2024.
-
A new mathematical model for cell motility with nonlocal repulsion from saturated areas
Authors:
Carlo Giambiagi Ferrari,
Francisco Guillen-Gonzalez,
Mayte Perez-Llanos,
Antonio Suarez
Abstract:
The main purpose of this work is the modelling of large single populations of cells under different interactions among themselves, in balance with natural random diffusion. We focus on cell-cell adhesion mechanisms for one single population confined in isolated domains. Our most relevant contribution is the proposal of a mathematical model, that includes a nonlocal saturation coefficient multiplyi…
▽ More
The main purpose of this work is the modelling of large single populations of cells under different interactions among themselves, in balance with natural random diffusion. We focus on cell-cell adhesion mechanisms for one single population confined in isolated domains. Our most relevant contribution is the proposal of a mathematical model, that includes a nonlocal saturation coefficient multiplying an appropriate nonlocal drift term, that can even induce repulsion effects from saturated areas.
△ Less
Submitted 8 May, 2024; v1 submitted 23 January, 2024;
originally announced January 2024.
-
Numerical approximation of Dynkin games with asymmetric information
Authors:
Ľubomír Baňas,
Giorgio Ferrari,
Tsiry Avisoa Randrianasolo
Abstract:
We propose an implementable, feedforward neural network-based structure preserving probabilistic numerical approximation for a generalized obstacle problem describing the value of a zero-sum differential game of optimal stop** with asymmetric information. The target solution depends on three variables: the time, the spatial (or state) variable, and a variable from a standard $(I-1)$-simplex whic…
▽ More
We propose an implementable, feedforward neural network-based structure preserving probabilistic numerical approximation for a generalized obstacle problem describing the value of a zero-sum differential game of optimal stop** with asymmetric information. The target solution depends on three variables: the time, the spatial (or state) variable, and a variable from a standard $(I-1)$-simplex which represents the probabilities with which the $I$ possible configurations of the game are played. The proposed numerical approximation preserves the convexity of the continuous solution as well as the lower and upper obstacle bounds. We show convergence of the fully-discrete scheme to the unique viscosity solution of the continuous problem and present a range of numerical studies to demonstrate its applicability.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Optimal Retirement Choice under Age-dependent Force of Mortality
Authors:
Giorgio Ferrari,
Shihao Zhu
Abstract:
This paper examines the retirement decision, optimal investment, and consumption strategies under an age-dependent force of mortality. We formulate the optimization problem as a combined stochastic control and optimal stop** problem with a random time horizon, featuring three state variables: wealth, labor income, and force of mortality. To address this problem, we transform it into its dual for…
▽ More
This paper examines the retirement decision, optimal investment, and consumption strategies under an age-dependent force of mortality. We formulate the optimization problem as a combined stochastic control and optimal stop** problem with a random time horizon, featuring three state variables: wealth, labor income, and force of mortality. To address this problem, we transform it into its dual form, which is a finite time horizon, three-dimensional degenerate optimal stop** problem with interconnected dynamics. We establish the existence of an optimal retirement boundary that splits the state space into continuation and stop** regions. Regularity of the optimal stop** value function is derived and the boundary is proved to be Lipschitz continuous, and it is characterized as the unique solution to a nonlinear integral equation, which we compute numerically. In the original coordinates, the agent thus retires whenever her wealth exceeds an age-, labor income- and mortality-dependent transformed version of the optimal stop** boundary. We also provide numerical illustrations of the optimal strategies, including the sensitivities of the optimal retirement boundary concerning the relevant model's parameters.
△ Less
Submitted 20 November, 2023;
originally announced November 2023.
-
Irreversible reinsurance: Minimization of Capital Injections in Presence of a Fixed Cost
Authors:
Salvatore Federico,
Giorgio Ferrari,
Maria-Laura Torrente
Abstract:
We propose a model in which, in exchange to the payment of a fixed transaction cost, an insurance company can choose the retention level as well as the time at which subscribing a perpetual reinsurance contract. The surplus process of the insurance company evolves according to the diffusive approximation of the Cramér-Lundberg model, claims arrive at a fixed constant rate, and the distribution of…
▽ More
We propose a model in which, in exchange to the payment of a fixed transaction cost, an insurance company can choose the retention level as well as the time at which subscribing a perpetual reinsurance contract. The surplus process of the insurance company evolves according to the diffusive approximation of the Cramér-Lundberg model, claims arrive at a fixed constant rate, and the distribution of their sizes is general. Furthermore, we do not specify any specific functional form of the retention level. The aim of the company is to take actions in order to minimize the sum of the expected value of the total discounted flow of capital injections needed to avoid bankruptcy and of the fixed activation cost of the reinsurance contract. We provide an explicit solution to this problem, which involves the resolution of a static nonlinear optimization problem and of an optimal stop** problem for a reflected diffusion. We then illustrate the theoretical results in the case of proportional and excess-of-loss reinsurance, by providing a numerical study of the dependency of the optimal solution with respect to the model's parameters.
△ Less
Submitted 11 February, 2024; v1 submitted 28 September, 2023;
originally announced September 2023.
-
Singular Control in a Cash Management Model with Ambiguity
Authors:
Arnon Archankul,
Giorgio Ferrari,
Tobias Hellmann,
Jacco J. J. Thijssen
Abstract:
We consider a singular control model of cash reserve management, driven by a diffusion under ambiguity. The manager is assumed to have maxmin preferences over a set of priors characterized by $κ$-ignorance. A verification theorem is established to determine the firm's cost function and the optimal cash policy; the latter taking the form of a control barrier policy. In a model driven by arithmetic…
▽ More
We consider a singular control model of cash reserve management, driven by a diffusion under ambiguity. The manager is assumed to have maxmin preferences over a set of priors characterized by $κ$-ignorance. A verification theorem is established to determine the firm's cost function and the optimal cash policy; the latter taking the form of a control barrier policy. In a model driven by arithmetic Brownian motion, we numerically show that an increase in ambiguity leads to higher expected costs under the worst-case prior and a narrower inaction region. The latter effect can be used to provide an ambiguity-driven explanation for observed cash management behavior.
△ Less
Submitted 21 September, 2023;
originally announced September 2023.
-
Ergodic Mean-Field Games of Singular Control with Regime-Switching (Extended Version)
Authors:
Jodi Dianetti,
Giorgio Ferrari,
Ioannis Tzouanas
Abstract:
This paper studies a class of stationary mean-field games of singular stochastic control with regime-switching. The representative agent adjusts the dynamics of a Markov-modulated Itô-diffusion via a two-sided singular stochastic control and faces a long-time-average expected profit criterion. The mean-field interaction is of scalar type and it is given through the stationary distribution of the p…
▽ More
This paper studies a class of stationary mean-field games of singular stochastic control with regime-switching. The representative agent adjusts the dynamics of a Markov-modulated Itô-diffusion via a two-sided singular stochastic control and faces a long-time-average expected profit criterion. The mean-field interaction is of scalar type and it is given through the stationary distribution of the population. Via a constructive approach, we prove the existence and uniqueness of the stationary mean-field equilibrium. Furthermore, we show that this realizes a symmetric $\varepsilon_N$-Nash equilibrium for a suitable ergodic $N$-player game with singular controls. The proof hinges on the characterization of the optimal solution to the representative player's ergodic singular stochastic control problem with regime switching, which is of independent interest and appears here for the first time.
△ Less
Submitted 22 July, 2023;
originally announced July 2023.
-
A Stationary Mean-Field Equilibrium Model of Irreversible Investment in a Two-Regime Economy
Authors:
René Aid,
Matteo Basei,
Giorgio Ferrari
Abstract:
We consider a mean-field model of firms competing à la Cournot on a commodity market, where the commodity price is given in terms of a power inverse demand function of the industry-aggregate production. Investment is irreversible and production capacity depreciates at a constant rate. Production is subject to Gaussian productivity shocks, while large non-anticipated macroeconomic events driven by…
▽ More
We consider a mean-field model of firms competing à la Cournot on a commodity market, where the commodity price is given in terms of a power inverse demand function of the industry-aggregate production. Investment is irreversible and production capacity depreciates at a constant rate. Production is subject to Gaussian productivity shocks, while large non-anticipated macroeconomic events driven by a two-state continuous-time Markov chain can change the volatility of the shocks, as well as the price function. Firms wish to maximize expected discounted revenues of production, net of investment and operational costs. Investment decisions are based on the long-run stationary price of the commodity. We prove existence, uniqueness and characterization of the stationary mean-field equilibrium of the model. The equilibrium investment strategy is of barrier-type and it is triggered by a couple of endogenously determined investment thresholds, one per state of the economy. We provide a quasi-closed form expression of the stationary density of the state and we show that our model can produce Pareto distribution of firms' size. This is a feature that is consistent both with observations at the aggregate level of industries and at the level of a particular industry. We establish a relation between economic instability and market concentration and we show how macroeconomic instability can harm firms' profitability more than productivity fluctuations.
△ Less
Submitted 30 April, 2023;
originally announced May 2023.
-
Uncertainty over Uncertainty in Environmental Policy Adoption: Bayesian Learning of Unpredictable Socioeconomic Costs
Authors:
Matteo Basei,
Giorgio Ferrari,
Neofytos Rodosthenous
Abstract:
The socioeconomic impact of pollution naturally comes with uncertainty due to, e.g., current new technological developments in emissions' abatement or demographic changes. On top of that, the trend of the future costs of the environmental damage is unknown: Will global warming dominate or technological advancements prevail? The truth is that we do not know which scenario will be realised and the s…
▽ More
The socioeconomic impact of pollution naturally comes with uncertainty due to, e.g., current new technological developments in emissions' abatement or demographic changes. On top of that, the trend of the future costs of the environmental damage is unknown: Will global warming dominate or technological advancements prevail? The truth is that we do not know which scenario will be realised and the scientific debate is still open. This paper captures those two layers of uncertainty by develo** a real-options-like model in which a decision maker aims at adopting a once-and-for-all costly reduction in the current emissions rate, when the stochastic dynamics of the socioeconomic costs of pollution are subject to Brownian shocks and the drift is an unobservable random variable. By kee** track of the actual evolution of the costs, the decision maker is able to learn the unknown drift and to form a posterior dynamic belief of its true value. The resulting decision maker's timing problem boils down to a truly two-dimensional optimal stop** problem which we address via probabilistic free-boundary methods and a state-space transformation. We completely characterise the solution by showing that the optimal timing for implementing the emissions reduction policy is the first time that the learning process has become ``decisive'' enough; that is, when it exceeds a time-dependent percentage. This is given in terms of an endogenously determined threshold function, which solves uniquely a nonlinear integral equation. We numerically illustrate our results, discuss the implications of the optimal policy and also perform comparative statics to understand the role of the relevant model's parameters in the optimal policy.
△ Less
Submitted 26 February, 2024; v1 submitted 20 April, 2023;
originally announced April 2023.
-
On a Merton Problem with Irreversible Healthcare Investment
Authors:
Giorgio Ferrari,
Shihao Zhu
Abstract:
We propose a tractable dynamic framework for the joint determination of optimal consumption, portfolio choice, and healthcare irreversible investment. Our model is based on a Merton's portfolio and consumption problem, where, in addition, the agent can choose the time at which undertaking a costly lump sum health investment decision. Health depreciates with age and directly affects the agent's mor…
▽ More
We propose a tractable dynamic framework for the joint determination of optimal consumption, portfolio choice, and healthcare irreversible investment. Our model is based on a Merton's portfolio and consumption problem, where, in addition, the agent can choose the time at which undertaking a costly lump sum health investment decision. Health depreciates with age and directly affects the agent's mortality force, so that investment into healthcare reduces the agent's mortality risk. The resulting optimization problem is formulated as a stochastic control-stop** problem with a random time-horizon and state-variables given by the agent's wealth and health capital. We transform this problem into its dual version, which is now a two-dimensional optimal stop** problem with interconnected dynamics and finite time-horizon. Regularity of the optimal stop** value function is derived and the related free boundary surface is proved to be Lipschitz continuous, and it is characterized as the unique solution to a nonlinear integral equation, which we compute numerically. In the original coordinates, the agent thus invests into healthcare whenever her wealth exceeds an age- and health-dependent transformed version of the optimal stop** boundary. We also provide the numerical illustrations of the optimal strategies and some financial implications are discussed.
△ Less
Submitted 22 December, 2023; v1 submitted 10 December, 2022;
originally announced December 2022.
-
Optimal Vaccination in a SIRS Epidemic Model
Authors:
Salvatore Federico,
Giorgio Ferrari,
Maria-Laura Torrente
Abstract:
We propose and solve an optimal vaccination problem within a deterministic compartmental model of SIRS type: the immunized population can become susceptible again, e.g.\ because of a not complete immunization power of the vaccine. A social planner thus aims at reducing the number of susceptible individuals via a vaccination campaign, while minimizing the social and economic costs related to the in…
▽ More
We propose and solve an optimal vaccination problem within a deterministic compartmental model of SIRS type: the immunized population can become susceptible again, e.g.\ because of a not complete immunization power of the vaccine. A social planner thus aims at reducing the number of susceptible individuals via a vaccination campaign, while minimizing the social and economic costs related to the infectious disease. As a theoretical contribution, we provide a technical non-smooth verification theorem, guaranteeing that a semiconcave viscosity solution to the Hamilton-Jacobi-Bellman equation identifies with the minimal cost function, provided that the closed-loop equation admits a solution. Conditions under which the closed-loop equation is well-posed are then derived by borrowing results from the theory of \emph{Regular Lagrangian Flows}. From the applied point of view, we provide a numerical implementation of the model in a case study with quadratic instantaneous costs. Amongst other conclusions, we observe that in the long-run the optimal vaccination policy is able to keep the percentage of infected to zero, at least when the natural reproduction number and the reinfection rate are small.
△ Less
Submitted 7 June, 2022;
originally announced June 2022.
-
A unifying framework for submodular mean field games
Authors:
Jodi Dianetti,
Giorgio Ferrari,
Markus Fischer,
Max Nendel
Abstract:
We provide an abstract framework for submodular mean field games and identify verifiable sufficient conditions that allow to prove existence and approximation of strong mean field equilibria in models where data may not be continuous with respect to the measure parameter and common noise is allowed. The setting is general enough to encompass qualitatively different problems, such as mean field gam…
▽ More
We provide an abstract framework for submodular mean field games and identify verifiable sufficient conditions that allow to prove existence and approximation of strong mean field equilibria in models where data may not be continuous with respect to the measure parameter and common noise is allowed. The setting is general enough to encompass qualitatively different problems, such as mean field games for discrete time finite space Markov chains, singularly controlled and reflected diffusions, and mean field games of optimal timing. Our analysis hinges on Tarski's fixed point theorem, along with technical results on lattices of flows of probability and sub-probability measures.
△ Less
Submitted 19 January, 2022;
originally announced January 2022.
-
Optimal Dividends under Markov-Modulated Bankruptcy Level
Authors:
Giorgio Ferrari,
Patrick Schuhmann,
Shihao Zhu
Abstract:
This paper proposes and studies an optimal dividend problem in which a two-state regime-switching environment affects the dynamics of the company's cash surplus and, as a novel feature, also the bankruptcy level. The aim is to maximize the total expected profits from dividends until bankruptcy. The company's optimal dividend payout is therefore influenced by four factors simultaneously: Brownian f…
▽ More
This paper proposes and studies an optimal dividend problem in which a two-state regime-switching environment affects the dynamics of the company's cash surplus and, as a novel feature, also the bankruptcy level. The aim is to maximize the total expected profits from dividends until bankruptcy. The company's optimal dividend payout is therefore influenced by four factors simultaneously: Brownian fluctuations in the cash surplus, as well as regime changes in drift, volatility and bankruptcy levels. In particular, the average profitability can assume different signs in the two regimes. We find a rich structure of the optimal strategy, which, depending on the interaction of the model's parameters, can be either of barrier-type or of liquidation-barrier type. Furthermore, we provide explicit expressions of the optimal policies and value functions. Finally, we complement our theoretical results by a detailed numerical study, where also a thorough analysis of the sensitivities of the optimal dividend policy with respect to the problem's parameters is performed.
△ Less
Submitted 9 June, 2022; v1 submitted 5 November, 2021;
originally announced November 2021.
-
Nonlocal approximations to anisotropic Sobolev norms
Authors:
Ivan Cinelli,
Gianluca Ferrari,
Marco Squassina
Abstract:
We obtain some nonlocal characterizations for a class of variable exponent Sobolev spaces arising in nonlinear elasticity, in the theory of electrorheological fluids as well as in image processing for the regions where the variable exponent $p(x)$ reaches the value $1$.
We obtain some nonlocal characterizations for a class of variable exponent Sobolev spaces arising in nonlinear elasticity, in the theory of electrorheological fluids as well as in image processing for the regions where the variable exponent $p(x)$ reaches the value $1$.
△ Less
Submitted 26 October, 2021;
originally announced October 2021.
-
Nonlinear Filtering of Partially Observed Systems arising in Singular Stochastic Optimal Control
Authors:
Alessandro Calvia,
Giorgio Ferrari
Abstract:
This paper deals with a nonlinear filtering problem in which a multi-dimensional signal process is additively affected by a process $ν$ whose components have paths of bounded variation. The presence of the process $ν$ prevents from directly applying classical results and novel estimates need to be derived. By making use of the so-called reference probability measure approach, we derive the Zakai e…
▽ More
This paper deals with a nonlinear filtering problem in which a multi-dimensional signal process is additively affected by a process $ν$ whose components have paths of bounded variation. The presence of the process $ν$ prevents from directly applying classical results and novel estimates need to be derived. By making use of the so-called reference probability measure approach, we derive the Zakai equation satisfied by the unnormalized filtering process, and then we deduce the corresponding Kushner-Stratonovich equation. Under the condition that the jump times of the process $ν$ do not accumulate over the considered time horizon, we show that the unnormalized filtering process is the unique solution to the Zakai equation, in the class of measure-valued processes having a square-integrable density. Our analysis paves the way to the study of stochastic control problems where a decision maker can exert singular controls in order to adjust the dynamics of an unobservable Itô-process.
△ Less
Submitted 8 June, 2021;
originally announced June 2021.
-
Stationary Discounted and Ergodic Mean Field Games of Singular Control
Authors:
Haoyang Cao,
Jodi Dianetti,
Giorgio Ferrari
Abstract:
We study stationary mean field games with singular controls in which the representative player interacts with a long-time weighted average of the population through a discounted and an ergodic performance criterion. This class of games finds natural applications in the context of optimal productivity expansion in dynamic oligopolies. We prove existence and uniqueness of the mean field equilibria,…
▽ More
We study stationary mean field games with singular controls in which the representative player interacts with a long-time weighted average of the population through a discounted and an ergodic performance criterion. This class of games finds natural applications in the context of optimal productivity expansion in dynamic oligopolies. We prove existence and uniqueness of the mean field equilibria, which are completely characterized through nonlinear equations. Furthermore, we relate the mean field equilibria for the discounted and the ergodic games by showing the validity of an Abelian limit. The latter allows also to approximate Nash equilibria of - so far unexplored - symmetric N-player ergodic singular control games through the mean field equilibrium of the discounted game. Numerical examples finally illustrate in a case study the dependency of the mean field equilibria with respect to the parameters of the games.
△ Less
Submitted 15 May, 2021;
originally announced May 2021.
-
Multidimensional singular control and related Skorokhod problem: sufficient conditions for the characterization of optimal controls
Authors:
Jodi Dianetti,
Giorgio Ferrari
Abstract:
We characterize the optimal control for a class of singular stochastic control problems as the unique solution to a related Skorokhod reflection problem. The considered optimization problems concern the minimization of a discounted cost functional over an infinite time-horizon through a process of bounded variation affecting an Itô-diffusion. The setting is multidimensional, the drift of the state…
▽ More
We characterize the optimal control for a class of singular stochastic control problems as the unique solution to a related Skorokhod reflection problem. The considered optimization problems concern the minimization of a discounted cost functional over an infinite time-horizon through a process of bounded variation affecting an Itô-diffusion. The setting is multidimensional, the drift of the state equation and the costs are convex, the volatility matrix can be constant or linear in the state. We prove that the optimal control acts only when the underlying diffusion attempts to exit the so-called waiting region, and that the direction of this action is prescribed by the derivative of the value function. Our approach is based on the study of a suitable monotonicity property of the derivative of the value function through its interpretation as the value of an optimal stop** game. Such a monotonicity allows to construct nearly optimal policies which reflect the underlying diffusion at the boundary of approximating waiting regions. The limit of this approximation scheme then provides the desired characterization. Our result applies to a relevant class of linear-quadratic models, among others. Furthermore, it allows to construct the optimal control in degenerate and non degenerate settings considered in the literature, where this important aspect was only partially addressed.
△ Less
Submitted 19 May, 2023; v1 submitted 15 March, 2021;
originally announced March 2021.
-
On an Irreversible Investment Problem with Two-Factor Uncertainty
Authors:
Felix Dammann,
Giorgio Ferrari
Abstract:
We consider a real options model for the optimal irreversible investment problem of a profit maximizing company. The company has the opportunity to invest into a production plant capable of producing two products, of which the prices follow two independent geometric Brownian motions. After paying a constant sunk investment cost, the company sells the products on the market and thus receives a cont…
▽ More
We consider a real options model for the optimal irreversible investment problem of a profit maximizing company. The company has the opportunity to invest into a production plant capable of producing two products, of which the prices follow two independent geometric Brownian motions. After paying a constant sunk investment cost, the company sells the products on the market and thus receives a continuous stochastic revenue-flow. This investment problem is set as a two-dimensional optimal stop** problem. We find that the optimal investment decision is triggered by a convex curve, which we characterize as the unique continuous solution to a nonlinear integral equation. Furthermore, we provide analytical and numerical comparative statics results of the dependency of the project's value and investment decision with respect to the model's parameters.
△ Less
Submitted 8 July, 2021; v1 submitted 15 March, 2021;
originally announced March 2021.
-
Two-sided Singular Control of an Inventory with Unknown Demand Trend (Extended Version)
Authors:
Salvatore Federico,
Giorgio Ferrari,
Neofytos Rodosthenous
Abstract:
We study the problem of optimally managing an inventory with unknown demand trend. Our formulation leads to a stochastic control problem under partial observation, in which a Brownian motion with non-observable drift can be singularly controlled in both an upward and downward direction. We first derive the equivalent separated problem under full information, with state-space components given by th…
▽ More
We study the problem of optimally managing an inventory with unknown demand trend. Our formulation leads to a stochastic control problem under partial observation, in which a Brownian motion with non-observable drift can be singularly controlled in both an upward and downward direction. We first derive the equivalent separated problem under full information, with state-space components given by the Brownian motion and the filtering estimate of its unknown drift, and we then completely solve this latter problem. Our approach uses the transition amongst three different but equivalent problem formulations, links between two-dimensional bounded-variation stochastic control problems and games of optimal stop**, and probabilistic methods in combination with refined viscosity theory arguments. We show substantial regularity of (a transformed version of) the value function, we construct an optimal control rule, and we show that the free boundaries delineating (transformed) action and inaction regions are bounded globally Lipschitz continuous functions. To our knowledge this is the first time that such a problem has been solved in the literature.
△ Less
Submitted 24 November, 2022; v1 submitted 23 February, 2021;
originally announced February 2021.
-
Nonlocal characterizations of variable exponent Sobolev spaces
Authors:
Gianluca Ferrari,
Marco Squassina
Abstract:
We obtain some nonlocal characterizations for a class of variable exponent Sobolev spaces arising in nonlinear elasticity theory and in the theory of electrorheological fluids. We also get a singular limit formula extending Nguyen results to the anisotropic case.
We obtain some nonlocal characterizations for a class of variable exponent Sobolev spaces arising in nonlinear elasticity theory and in the theory of electrorheological fluids. We also get a singular limit formula extending Nguyen results to the anisotropic case.
△ Less
Submitted 1 December, 2020;
originally announced December 2020.
-
Optimal Consumption with Intertemporal Substitution under Knightian Uncertainty
Authors:
Giorgio Ferrari,
Hanwu Li,
Frank Riedel
Abstract:
We study an intertemporal consumption and portfolio choice problem under Knightian uncertainty in which agent's preferences exhibit local intertemporal substitution. We also allow for market frictions in the sense that the pricing functional is nonlinear. We prove existence and uniqueness of the optimal consumption plan, and we derive a set of sufficient first-order conditions for optimality. With…
▽ More
We study an intertemporal consumption and portfolio choice problem under Knightian uncertainty in which agent's preferences exhibit local intertemporal substitution. We also allow for market frictions in the sense that the pricing functional is nonlinear. We prove existence and uniqueness of the optimal consumption plan, and we derive a set of sufficient first-order conditions for optimality. With the help of a backward equation, we are able to determine the structure of optimal consumption plans. We obtain explicit solutions in a stationary setting in which the financial market has different risk premia for short and long positions.
△ Less
Submitted 8 November, 2020;
originally announced November 2020.
-
Taming the spread of an epidemics by lockdown policies
Authors:
Salvatore Federico,
Giorgio Ferrari
Abstract:
We study the problem of a policymaker who aims at taming the spread of an epidemic while minimizing its associated social costs. The main feature of our model lies in the fact that the disease's transmission rate is a diffusive stochastic process whose trend can be adjusted via costly confinement policies. We provide a complete theoretical analysis, as well as numerical experiments illustrating th…
▽ More
We study the problem of a policymaker who aims at taming the spread of an epidemic while minimizing its associated social costs. The main feature of our model lies in the fact that the disease's transmission rate is a diffusive stochastic process whose trend can be adjusted via costly confinement policies. We provide a complete theoretical analysis, as well as numerical experiments illustrating the structure of the optimal lockdown policy. In all our experiments the latter is characterized by three distinct periods: the epidemic is first let freely evolve, then vigorously tamed, and finally a less stringent containment should be adopted. Moreover, the optimal containment policy is such that the product "reproduction number x percentage of susceptible" is kept after a certain date strictly below the critical level of one, although the reproduction number is let oscillate above one in the last more relaxed phase of lockdown. Finally, an increase in the fluctuations of the transmission rate is shown to give rise to an earlier beginning of the optimal lockdown policy, which is also diluted over a longer period of time.
△ Less
Submitted 2 November, 2020; v1 submitted 21 July, 2020;
originally announced July 2020.
-
Optimal Dividend Payout under Stochastic Discounting
Authors:
Elena Bandini,
Tiziano De Angelis,
Giorgio Ferrari,
Fausto Gozzi
Abstract:
Adopting a probabilistic approach we determine the optimal dividend payout policy of a firm whose surplus process follows a controlled arithmetic Brownian motion and whose cash-flows are discounted at a stochastic dynamic rate. Dividends can be paid to shareholders at unrestricted rates so that the problem is cast as one of singular stochastic control. The stochastic interest rate is modelled by a…
▽ More
Adopting a probabilistic approach we determine the optimal dividend payout policy of a firm whose surplus process follows a controlled arithmetic Brownian motion and whose cash-flows are discounted at a stochastic dynamic rate. Dividends can be paid to shareholders at unrestricted rates so that the problem is cast as one of singular stochastic control. The stochastic interest rate is modelled by a Cox-Ingersoll-Ross (CIR) process and the firm's objective is to maximize the total expected flow of discounted dividends until a possible insolvency time. We find an optimal dividend payout policy which is such that the surplus process is kept below an endogenously determined stochastic threshold expressed as a decreasing continuous function $r \mapsto b(r)$ of the current interest rate value. We also prove that the value function of the singular control problem solves a variational inequality associated to a second-order, non-degenerate elliptic operator, with a gradient constraint.
△ Less
Submitted 21 June, 2021; v1 submitted 23 May, 2020;
originally announced May 2020.
-
A Knightian Irreversible Investment Problem
Authors:
Giorgio Ferrari,
Hanwu Li,
Frank Riedel
Abstract:
In this paper, we study an irreversible investment problem under Knightian uncertainty. In a general framework, in which Knightian uncertainty is modeled through a set of multiple priors, we prove existence and uniqueness of the optimal investment plan, and derive necessary and sufficient conditions for optimality. This allows us to construct the optimal policy in terms of the solution to a stocha…
▽ More
In this paper, we study an irreversible investment problem under Knightian uncertainty. In a general framework, in which Knightian uncertainty is modeled through a set of multiple priors, we prove existence and uniqueness of the optimal investment plan, and derive necessary and sufficient conditions for optimality. This allows us to construct the optimal policy in terms of the solution to a stochastic backward equation under the worst-case scenario. In a time-homogeneous setting - where risk is driven by a geometric Brownian motion and Knightian uncertainty is realized through a so-called "k-ignorance" - we are able to provide the explicit form of the optimal irreversible investment plan.
△ Less
Submitted 6 April, 2020; v1 submitted 31 March, 2020;
originally announced March 2020.
-
Numerical approximation of the value of a stochastic differential game with asymmetric information
Authors:
Ľubomír Baňas,
Giorgio Ferrari,
Tsiry A. Randrianasolo
Abstract:
We consider a convexity constrained Hamilton-Jacobi-Bellman-type obstacle problem for the value function of a zero-sum differential game with asymmetric information. We propose a convexity-preserving probabilistic numerical scheme for the approximation of the value function which is discrete w.r.t. the time and convexity variables, and show that the scheme converges to the unique viscosity solutio…
▽ More
We consider a convexity constrained Hamilton-Jacobi-Bellman-type obstacle problem for the value function of a zero-sum differential game with asymmetric information. We propose a convexity-preserving probabilistic numerical scheme for the approximation of the value function which is discrete w.r.t. the time and convexity variables, and show that the scheme converges to the unique viscosity solution of the considered problem. Furthermore, we generalize the semi-discrete scheme to obtain an implementable fully discrete numerical approximation of the value function and present numerical experiments to demonstrate the properties of the proposed numerical scheme.
△ Less
Submitted 4 October, 2020; v1 submitted 31 December, 2019;
originally announced December 2019.
-
A Singular Stochastic Control Problem with Interconnected Dynamics
Authors:
Salvatore Federico,
Giorgio Ferrari,
Patrick Schuhmann
Abstract:
In this paper we study a Markovian two-dimensional bounded-variation stochastic control problem whose state process consists of a diffusive mean-reverting component and of a purely controlled one. The main problem's characteristic lies in the interaction of the two components of the state process: the mean-reversion level of the diffusive component is an affine function of the current value of the…
▽ More
In this paper we study a Markovian two-dimensional bounded-variation stochastic control problem whose state process consists of a diffusive mean-reverting component and of a purely controlled one. The main problem's characteristic lies in the interaction of the two components of the state process: the mean-reversion level of the diffusive component is an affine function of the current value of the purely controlled one. By relying on a combination of techniques from viscosity theory and free-boundary analysis, we provide the structure of the value function and we show that it satisfies a second-order smooth-fit principle. Such a regularity is then exploited in order to determine a system of functional equations solved by the two monotone continuous curves (free boundaries) that split the control problem's state space in three connected regions. Further properties of the free boundaries are also obtained.
△ Less
Submitted 19 April, 2020; v1 submitted 26 September, 2019;
originally announced September 2019.
-
Submodular Mean Field Games: Existence and Approximation of Solutions
Authors:
Jodi Dianetti,
Giorgio Ferrari,
Markus Fischer,
Max Nendel
Abstract:
We study mean field games with scalar It{ô}-type dynamics and costs that are submodular with respect to a suitable order relation on the state and measure space. The submodularity assumption has a number of interesting consequences. Firstly, it allows us to prove existence of solutions via an application of Tarski's fixed point theorem, covering cases with discontinuous dependence on the measure v…
▽ More
We study mean field games with scalar It{ô}-type dynamics and costs that are submodular with respect to a suitable order relation on the state and measure space. The submodularity assumption has a number of interesting consequences. Firstly, it allows us to prove existence of solutions via an application of Tarski's fixed point theorem, covering cases with discontinuous dependence on the measure variable. Secondly, it ensures that the set of solutions enjoys a lattice structure: in particular, there exist a minimal and a maximal solution. Thirdly, it guarantees that those two solutions can be obtained through a simple learning procedure based on the iterations of the best-response-map. The mean field game is first defined over ordinary stochastic controls, then extended to relaxed controls. Our approach allows also to treat a class of submodular mean field games with common noise in which the representative player at equilibrium interacts with the (conditional) mean of its state's distribution.
△ Less
Submitted 25 July, 2019;
originally announced July 2019.
-
On a Class of Infinite-Dimensional Singular Stochastic Control Problems
Authors:
Salvatore Federico,
Giorgio Ferrari,
Frank Riedel,
Michael Röckner
Abstract:
We study a class of infinite-dimensional singular stochastic control problems with applications in economic theory and finance. The control process linearly affects an abstract evolution equation on a suitable partially-ordered infinite-dimensional space X, it takes values in the positive cone of X, and it has right-continuous and nondecreasing paths. We first provide a rigorous formulation of the…
▽ More
We study a class of infinite-dimensional singular stochastic control problems with applications in economic theory and finance. The control process linearly affects an abstract evolution equation on a suitable partially-ordered infinite-dimensional space X, it takes values in the positive cone of X, and it has right-continuous and nondecreasing paths. We first provide a rigorous formulation of the problem by properly defining the controlled dynamics and integrals with respect to the control process. We then exploit the concave structure of our problem and derive necessary and sufficient first-order conditions for optimality. The latter are finally exploited in a specification of the model where we find an explicit expression of the optimal control. The techniques used are those of semigroup theory, vector-valued integration, convex analysis, and general theory of stochastic processes.
△ Less
Submitted 25 April, 2019;
originally announced April 2019.
-
Optimal Reduction of Public Debt under Partial Observation of the Economic Growth
Authors:
Giorgia Callegaro,
Claudia Ceci,
Giorgio Ferrari
Abstract:
We consider a government that aims at reducing the debt-to-gross domestic product (GDP) ratio of a country. The government observes the level of the debt-to-GDP ratio and an indicator of the state of the economy, but does not directly observe the development of the underlying macroeconomic conditions. The government's criterion is to minimize the sum of the total expected costs of holding debt and…
▽ More
We consider a government that aims at reducing the debt-to-gross domestic product (GDP) ratio of a country. The government observes the level of the debt-to-GDP ratio and an indicator of the state of the economy, but does not directly observe the development of the underlying macroeconomic conditions. The government's criterion is to minimize the sum of the total expected costs of holding debt and of debt's reduction policies. We model this problem as a singular stochastic control problem under partial observation. The contribution of the paper is twofold. Firstly, we provide a general formulation of the model in which the level of debt-to-GDP ratio and the value of the macroeconomic indicator evolve as a diffusion and a jump-diffusion, respectively, with coefficients depending on the regimes of the economy. These are described through a finite-state continuous-time Markov chain. We reduce via filtering techniques the original problem to an equivalent one with full information (the so-called separated problem), and we provide a general verification result in terms of a related optimal stop** problem under full information. Secondly, we specialize to a case study in which the economy faces only two regimes, and the macroeconomic indicator has a suitable diffusive dynamics. In this setting we provide the optimal debt reduction policy. This is given in terms of the continuous free boundary arising in an auxiliary fully two-dimensional optimal stop** problem.
△ Less
Submitted 25 January, 2019; v1 submitted 24 January, 2019;
originally announced January 2019.
-
Nonzero-Sum Submodular Monotone-Follower Games: Existence and Approximation of Nash Equilibria
Authors:
Jodi Dianetti,
Giorgio Ferrari
Abstract:
We consider a class of N-player stochastic games of multi-dimensional singular control, in which each player faces a minimization problem of monotone-follower type with submodular costs. We call these games "monotone-follower games". In a not necessarily Markovian setting, we establish the existence of Nash equilibria. Moreover, we introduce a sequence of approximating games by restricting, for ea…
▽ More
We consider a class of N-player stochastic games of multi-dimensional singular control, in which each player faces a minimization problem of monotone-follower type with submodular costs. We call these games "monotone-follower games". In a not necessarily Markovian setting, we establish the existence of Nash equilibria. Moreover, we introduce a sequence of approximating games by restricting, for each natural number n, the players' admissible strategies to the set of Lipschitz processes with Lipschitz constant bounded by n. We prove that, for each n, there exists a Nash equilibrium of the approximating game and that the sequence of Nash equilibria converges, in the Meyer-Zheng sense, to a weak (distributional) Nash equilibrium of the original game of singular control. As a byproduct, such a convergence also provides approximation results of the equilibrium values across the two classes of games. We finally show how our findings can be employed to prove existence of open-loop Nash equilibria in an N-player stochastic differential game with singular controls, and we propose an algorithm to determine a Nash equilibrium for the monotone-follower game.
△ Less
Submitted 1 February, 2019; v1 submitted 24 December, 2018;
originally announced December 2018.
-
An Optimal Extraction Problem with Price Impact
Authors:
Giorgio Ferrari,
Torben Koch
Abstract:
A price-maker company extracts an exhaustible commodity from a reservoir, and sells it instantaneously in the spot market. In absence of any actions of the company, the commodity's spot price evolves either as a drifted Brownian motion or as an Ornstein-Uhlenbeck process. While extracting, the company affects the market price of the commodity, and its actions have an impact on the dynamics of the…
▽ More
A price-maker company extracts an exhaustible commodity from a reservoir, and sells it instantaneously in the spot market. In absence of any actions of the company, the commodity's spot price evolves either as a drifted Brownian motion or as an Ornstein-Uhlenbeck process. While extracting, the company affects the market price of the commodity, and its actions have an impact on the dynamics of the commodity's spot price. The company aims at maximizing the total expected profits from selling the commodity, net of the total expected proportional costs of extraction. We model this problem as a two-dimensional degenerate singular stochastic control problem with finite fuel. To determine its solution, we construct an explicit solution to the associated Hamilton-Jacobi-Bellman equation, and then verify its actual optimality through a verification theorem. On the one hand, when the (uncontrolled) price is a drifted Brownian motion, it is optimal to extract whenever the current price level is larger or equal than an endogenously determined constant threshold. On the other hand, when the (uncontrolled) price evolves as an Ornstein-Uhlenbeck process, we show that the optimal extraction rule is triggered by a curve depending on the current level of the reservoir. Such a curve is a strictly decreasing $C^{\infty}$-function for which we are able to provide an explicit expression. Finally, our study is complemented by a theoretical and numerical analysis of the dependency of the optimal extraction strategy and value function on the model's parameters.
△ Less
Submitted 4 December, 2018;
originally announced December 2018.
-
Optimal Control of Debt-to-GDP Ratio in an N-state Regime Switching Economy
Authors:
Giorgio Ferrari,
Neofytos Rodosthenous
Abstract:
We solve an infinite time-horizon bounded-variation stochastic control problem with regime switching between $N$ states. This is motivated by the problem of a government that wants to control the country's debt-to-GDP (gross domestic product) ratio. In our formulation, the debt-to-GDP ratio evolves stochastically in continuous time, and its drift -- given by the interest rate on government debt, n…
▽ More
We solve an infinite time-horizon bounded-variation stochastic control problem with regime switching between $N$ states. This is motivated by the problem of a government that wants to control the country's debt-to-GDP (gross domestic product) ratio. In our formulation, the debt-to-GDP ratio evolves stochastically in continuous time, and its drift -- given by the interest rate on government debt, net of the growth rate of GDP -- is affected by an exogenous macroeconomic risk process modelled by a continuous-time Markov chain with $N$ states. The government can act on the public debt by increasing or decreasing its level, and it aims at minimising a net expected regime-dependent cost functional. Without relying on a guess-and-verify approach, but performing a direct probabilistic study, we show that it is optimal to keep the debt-to-GDP ratio in an interval, whose boundaries depend on the states of the risk process. These boundaries are given through a zero-sum optimal stop** game with regime switching with $N$ states and are characterised through a system of nonlinear algebraic equations with constraints. To the best of our knowledge, such a result appears here for the first time. Finally, we put in practice our methodology in a case study of a Markov chain with $N=2$ states; we provide a thorough analysis and we complement our theoretical results by a detailed numerical study on the sensitivity of the optimal debt ratio management policy with respect to the problem's parameters.
△ Less
Submitted 9 December, 2019; v1 submitted 4 August, 2018;
originally announced August 2018.
-
An Optimal Dividend Problem with Capital Injections over a Finite Horizon
Authors:
Giorgio Ferrari,
Patrick Schuhmann
Abstract:
In this paper we propose and solve an optimal dividend problem with capital injections over a finite time horizon. The surplus dynamics obeys a linearly controlled drifted Brownian motion that is reflected at the origin, dividends give rise to time-dependent instantaneous marginal profits, whereas capital injections are subject to time-dependent instantaneous marginal costs. The aim is to maximize…
▽ More
In this paper we propose and solve an optimal dividend problem with capital injections over a finite time horizon. The surplus dynamics obeys a linearly controlled drifted Brownian motion that is reflected at the origin, dividends give rise to time-dependent instantaneous marginal profits, whereas capital injections are subject to time-dependent instantaneous marginal costs. The aim is to maximize the sum of a liquidation value at terminal time and of the total expected profits from dividends, net of the total expected costs for capital injections. Inspired by the study of El Karoui and Karatzas (1989) on reflected follower problems, we relate the optimal dividend problem with capital injections to an optimal stop** problem for a drifted Brownian motion that is absorbed at the origin. We show that whenever the optimal stop** rule is triggered by a time-dependent boundary, the value function of the optimal stop** problem gives the derivative of the value function of the optimal dividend problem. Moreover, the optimal dividend strategy is also triggered by the moving boundary of the associated stop** problem. The properties of this boundary are then investigated in a case study in which instantaneous marginal profits and costs from dividends and capital injections are constants discounted at a constant rate.
△ Less
Submitted 21 May, 2019; v1 submitted 13 April, 2018;
originally announced April 2018.
-
On the Singular Control of Exchange Rates
Authors:
Giorgio Ferrari,
Tiziano Vargiolu
Abstract:
Consider the problem of a central bank that wants to manage the exchange rate between its domestic currency and a foreign one. The central bank can purchase and sell the foreign currency, and each intervention on the exchange market leads to a proportional cost whose instantaneous marginal value depends on the current level of the exchange rate. The central bank aims at minimizing the total expect…
▽ More
Consider the problem of a central bank that wants to manage the exchange rate between its domestic currency and a foreign one. The central bank can purchase and sell the foreign currency, and each intervention on the exchange market leads to a proportional cost whose instantaneous marginal value depends on the current level of the exchange rate. The central bank aims at minimizing the total expected costs of interventions on the exchange market, plus a total expected holding cost. We formulate this problem as an infinite time-horizon stochastic control problem with controls that have paths which are locally of bounded variation. The exchange rate evolves as a general linearly controlled one-dimensional diffusion, and the two nondecreasing processes giving the minimal decomposition of a bounded-variation control model the cumulative amount of foreign currency that has been purchased and sold by the central bank. We provide a complete solution to this problem by finding the explicit expression of the value function and a complete characterization of the optimal control. At each instant of time, the optimally controlled exchange rate is kept within a band whose size is endogenously determined as part of the solution to the problem. We also study the expected exit time from the band, and the sensitivity of the width of the band with respect to the model's parameters in the case when the exchange rate evolves (in absence of any intervention) as an Ornstein-Uhlenbeck process, and the marginal costs of controls are constant. The techniques employed in the paper are those of the theory of singular stochastic control and of one-dimensional diffusions.
△ Less
Submitted 6 December, 2017;
originally announced December 2017.
-
On a Class of Singular Stochastic Control Problems for Reflected Diffusions
Authors:
Giorgio Ferrari
Abstract:
Reflected diffusions naturally arise in many problems from applications ranging from economics and mathematical biology to queueing theory. In this paper we consider a class of infinite time-horizon singular stochastic control problems for a general one-dimensional diffusion that is reflected at zero. We assume that exerting control leads to a state-dependent instantaneous reward, whereas reflecti…
▽ More
Reflected diffusions naturally arise in many problems from applications ranging from economics and mathematical biology to queueing theory. In this paper we consider a class of infinite time-horizon singular stochastic control problems for a general one-dimensional diffusion that is reflected at zero. We assume that exerting control leads to a state-dependent instantaneous reward, whereas reflecting the diffusion at zero gives rise to a proportional cost with constant marginal value. The aim is to maximize the total expected reward, minus the total expected cost of reflection. We show that depending on the properties of the state-dependent instantaneous reward we can have qualitatively different kinds of optimal strategies. The techniques employed are those of stochastic control and of the theory of linear diffusions.
△ Less
Submitted 10 November, 2017;
originally announced November 2017.
-
A note on a new existence result for reflected BSDEs with interconnected obstacles
Authors:
Tiziano De Angelis,
Giorgio Ferrari,
Saïd Hamadène
Abstract:
In this note we prove existence of a solution to a system of Markovian BSDEs with interconnected obstacles. A key feature of our system, and the main novelty of this paper, is that we allow for the driver $f_i$ of the $i$-th component of the $Y$-process to depend on all components of the $Z$-process. This extends the existing theory on reflected BSDEs, which only addresses problems where $f_i$ dep…
▽ More
In this note we prove existence of a solution to a system of Markovian BSDEs with interconnected obstacles. A key feature of our system, and the main novelty of this paper, is that we allow for the driver $f_i$ of the $i$-th component of the $Y$-process to depend on all components of the $Z$-process. This extends the existing theory on reflected BSDEs, which only addresses problems where $f_i$ depends on $Z^i$.
△ Less
Submitted 6 October, 2017;
originally announced October 2017.
-
On a Strategic Model of Pollution Control
Authors:
Giorgio Ferrari,
Torben Koch
Abstract:
This paper proposes a strategic model of pollution control. A firm, representative of the productive sector of a country, aims at maximizing its profits by expanding its production. Assuming that the output of production is proportional to the level of pollutants' emissions, the firm increases the level of pollution. The government of the country aims at minimizing the social costs due to the poll…
▽ More
This paper proposes a strategic model of pollution control. A firm, representative of the productive sector of a country, aims at maximizing its profits by expanding its production. Assuming that the output of production is proportional to the level of pollutants' emissions, the firm increases the level of pollution. The government of the country aims at minimizing the social costs due to the pollution, and introduces regulatory constraints on the emissions' level, which then effectively cap the output of production. Supposing that the firm and the government face both proportional and fixed costs in order to adopt their policies, we model the previous problem as a stochastic impulse two-person nonzero-sum game. The state variable of the game is the level of the output of production which evolves as a general linearly controlled one-dimensional Ito-diffusion. Following an educated guess, we first construct a pair of candidate equilibrium policies and of corresponding equilibrium values, and we then provide a set of sufficient conditions under which they indeed realize an equilibrium. Our results are complemented by a numerical study when the (uncontrolled) output of production evolves as a geometric Brownian motion, and the firm's operating profit and the government's running cost functions are of power type. An analysis of the dependency of the equilibrium policies and values on the model parameters yields interesting new behaviors that we explain as a consequence of the strategic interaction between the firm and the government.
△ Less
Submitted 7 June, 2018; v1 submitted 11 July, 2017;
originally announced July 2017.
-
On the Optimal Management of Public Debt: a Singular Stochastic Control Problem
Authors:
Giorgio Ferrari
Abstract:
Consider the problem of a government that wants to reduce the debt-to-GDP (gross domestic product) ratio of a country. The government aims at choosing a debt reduction policy which minimises the total expected cost of having debt, plus the total expected cost of interventions on the debt ratio. We model this problem as a singular stochastic control problem over an infinite time-horizon. In a gener…
▽ More
Consider the problem of a government that wants to reduce the debt-to-GDP (gross domestic product) ratio of a country. The government aims at choosing a debt reduction policy which minimises the total expected cost of having debt, plus the total expected cost of interventions on the debt ratio. We model this problem as a singular stochastic control problem over an infinite time-horizon. In a general not necessarily Markovian framework, we first show by probabilistic arguments that the optimal debt reduction policy can be expressed in terms of the optimal stop** rule of an auxiliary optimal stop** problem. We then exploit such link to characterise the optimal control in a two-dimensional Markovian setting in which the state variables are the level of the debt-to-GDP ratio and the current inflation rate of the country. The latter follows uncontrolled Ornstein-Uhlenbeck dynamics and affects the growth rate of the debt ratio. We show that it is optimal for the government to adopt a policy that keeps the debt-to-GDP ratio under an inflation-dependent ceiling. This curve is given in terms of the solution of a nonlinear integral equation arising in the study of a fully two-dimensional optimal stop** problem.
△ Less
Submitted 27 December, 2017; v1 submitted 14 July, 2016;
originally announced July 2016.
-
On an Optimal Extraction Problem with Regime Switching
Authors:
Giorgio Ferrari,
Shuzhen Yang
Abstract:
This paper studies a finite-fuel two-dimensional degenerate singular stochastic control problem under regime switching that is motivated by the optimal irreversible extraction problem of an exhaustible commodity. A company extracts a natural resource from a reserve with finite capacity, and sells it in the market at a spot price that evolves according to a Brownian motion with volatility modulated…
▽ More
This paper studies a finite-fuel two-dimensional degenerate singular stochastic control problem under regime switching that is motivated by the optimal irreversible extraction problem of an exhaustible commodity. A company extracts a natural resource from a reserve with finite capacity, and sells it in the market at a spot price that evolves according to a Brownian motion with volatility modulated by a two-state Markov chain. In this setting, the company aims at finding the extraction rule that maximizes its expected discounted cash flow, net of the costs of extraction and maintenance of the reserve. We provide expressions both for the value function and for the optimal control. On the one hand, if the running cost for the maintenance of the reserve is a convex function of the reserve level, the optimal extraction rule prescribes a Skorokhod reflection of the (optimally) controlled state process at a certain state and price dependent threshold. On the other hand, in presence of a concave running cost function it is optimal to instantaneously deplete the reserve at the time at which the commodity's price exceeds an endogenously determined critical level. In both cases, the threshold triggering the optimal control is given in terms of the optimal stop** boundary of an auxiliary family of perpetual optimal selling problems with regime switching.
△ Less
Submitted 27 December, 2017; v1 submitted 22 February, 2016;
originally announced February 2016.
-
Optimal Entry to an Irreversible Investment Plan with Non Convex Costs
Authors:
Tiziano De Angelis,
Giorgio Ferrari,
Randall Martyr,
John Moriarty
Abstract:
A problem of optimally purchasing electricity at a real-valued spot price (that is, with potentially negative cost) has been recently addressed in De Angelis, Ferrari and Moriarty (2015) [SIAM J. Control Optim. 53(3)]. This problem can be considered one of irreversible investment with a cost functional which is non convex with respect to the control variable. In this paper we study the optimal ent…
▽ More
A problem of optimally purchasing electricity at a real-valued spot price (that is, with potentially negative cost) has been recently addressed in De Angelis, Ferrari and Moriarty (2015) [SIAM J. Control Optim. 53(3)]. This problem can be considered one of irreversible investment with a cost functional which is non convex with respect to the control variable. In this paper we study the optimal entry into this investment plan. The optimal entry policy can have an irregular boundary arising from this non convexity, with a kinked shape.
△ Less
Submitted 9 February, 2016;
originally announced February 2016.
-
Stochastic nonzero-sum games: a new connection between singular control and optimal stop**
Authors:
Tiziano De Angelis,
Giorgio Ferrari
Abstract:
In this paper we establish a new connection between a class of 2-player nonzero-sum games of optimal stop** and certain $2$-player nonzero-sum games of singular control. We show that whenever a Nash equilibrium in the game of stop** is attained by hitting times at two separate boundaries, then such boundaries also trigger a Nash equilibrium in the game of singular control. Moreover a different…
▽ More
In this paper we establish a new connection between a class of 2-player nonzero-sum games of optimal stop** and certain $2$-player nonzero-sum games of singular control. We show that whenever a Nash equilibrium in the game of stop** is attained by hitting times at two separate boundaries, then such boundaries also trigger a Nash equilibrium in the game of singular control. Moreover a differential link between the players' value functions holds across the two games.
△ Less
Submitted 27 December, 2017; v1 submitted 21 January, 2016;
originally announced January 2016.
-
Nash equilibria of threshold type for two-player nonzero-sum games of stop**
Authors:
Tiziano De Angelis,
Giorgio Ferrari,
John Moriarty
Abstract:
This paper analyses two-player nonzero-sum games of optimal stop** on a class of linear regular diffusions with not non-singular boundary behaviour (in the sense of Itô and McKean (1974), p.\ 108). We provide sufficient conditions under which Nash equilibria are realised by each player stop** the diffusion at one of the two boundary points of an interval. The boundaries of this interval solve…
▽ More
This paper analyses two-player nonzero-sum games of optimal stop** on a class of linear regular diffusions with not non-singular boundary behaviour (in the sense of Itô and McKean (1974), p.\ 108). We provide sufficient conditions under which Nash equilibria are realised by each player stop** the diffusion at one of the two boundary points of an interval. The boundaries of this interval solve a system of algebraic equations. We also provide conditions sufficient for the uniqueness of the equilibrium in this class.
△ Less
Submitted 2 August, 2017; v1 submitted 17 August, 2015;
originally announced August 2015.
-
A solvable two-dimensional singular stochastic control problem with non convex costs
Authors:
Tiziano De Angelis,
Giorgio Ferrari,
John Moriarty
Abstract:
In this paper we provide a complete theoretical analysis of a two-dimensional degenerate non convex singular stochastic control problem. The optimisation is motivated by a storage-consumption model in an electricity market, and features a stochastic real-valued spot price modelled by Brownian motion. We find analytical expressions for the value function, the optimal control and the boundaries of t…
▽ More
In this paper we provide a complete theoretical analysis of a two-dimensional degenerate non convex singular stochastic control problem. The optimisation is motivated by a storage-consumption model in an electricity market, and features a stochastic real-valued spot price modelled by Brownian motion. We find analytical expressions for the value function, the optimal control and the boundaries of the action and inaction regions. The optimal policy is characterised in terms of two monotone and discontinuous repelling free boundaries, although part of one boundary is constant and the smooth fit condition holds there.
△ Less
Submitted 28 October, 2015; v1 submitted 10 November, 2014;
originally announced November 2014.
-
Irreversible Investment under Lévy Uncertainty: an Equation for the Optimal Boundary
Authors:
Giorgio Ferrari,
Paavo Salminen
Abstract:
We derive a new equation for the optimal investment boundary of a general irreversible investment problem under exponential Lévy uncertainty. The problem is set as an infinite time-horizon, two-dimensional degenerate singular stochastic control problem. In line with the results recently obtained in a diffusive setting, we show that the optimal boundary is intimately linked to the unique optional s…
▽ More
We derive a new equation for the optimal investment boundary of a general irreversible investment problem under exponential Lévy uncertainty. The problem is set as an infinite time-horizon, two-dimensional degenerate singular stochastic control problem. In line with the results recently obtained in a diffusive setting, we show that the optimal boundary is intimately linked to the unique optional solution of an appropriate Bank-El Karoui representation problem. Such a relation and the Wiener Hopf factorization allow us to derive an integral equation for the optimal investment boundary. In case the underlying Lévy process hits any real point with positive probability we show that the integral equation for the investment boundary is uniquely satisfied by the unique solution of another equation which is easier to handle. As a remarkable by-product we prove the continuity of the optimal investment boundary. The paper is concluded with explicit results for profit functions of (i) Cobb-Douglas type and (ii) CES type. In the first case the function is separable and in the second case non-separable.
△ Less
Submitted 10 November, 2014;
originally announced November 2014.
-
Optimal Dynamic Procurement Policies for a Storable Commodity with Lévy Prices and Convex Holding Costs
Authors:
Maria B. Chiarolla,
Giorgio Ferrari,
Gabriele Stabile
Abstract:
In this paper we study a continuous time stochastic inventory model for a commodity traded in the spot market and whose supply purchase is affected by price and demand uncertainty. A firm aims at meeting a random demand of the commodity at a random time by maximizing total expected profits. We model the firm's optimal procurement problem as a singular stochastic control problem in which controls a…
▽ More
In this paper we study a continuous time stochastic inventory model for a commodity traded in the spot market and whose supply purchase is affected by price and demand uncertainty. A firm aims at meeting a random demand of the commodity at a random time by maximizing total expected profits. We model the firm's optimal procurement problem as a singular stochastic control problem in which controls are nondecreasing processes and represent the cumulative investment made by the firm in the spot market (a so-called stochastic "monotone follower problem"). We assume a general exponential Lévy process for the commodity's spot price, rather than the commonly used geometric Brownian motion, and general convex holding costs.
We obtain necessary and sufficient first order conditions for optimality and we provide the optimal procurement policy in terms of a "base inventory" process; that is, a minimal time-dependent desirable inventory level that the firm's manager must reach at any time. In particular, in the case of linear holding costs and exponentially distributed demand, we are also able to obtain the explicit analytic form of the optimal policy and a probabilistic representation of the optimal revenue. The paper is completed by some computer drawings of the optimal inventory when spot prices are given by a geometric Brownian motion and by an exponential jump-diffusion process. In the first case we also make a numerical comparison between the value function and the revenue associated to the classical static "newsvendor" strategy.
△ Less
Submitted 11 June, 2015; v1 submitted 2 September, 2014;
originally announced September 2014.
-
Optimal Boundary Surface for Irreversible Investment with Stochastic Costs
Authors:
Tiziano De Angelis,
Salvatore Federico,
Giorgio Ferrari
Abstract:
This paper examines a Markovian model for the optimal irreversible investment problem of a firm aiming at minimizing total expected costs of production. We model market uncertainty and the cost of investment per unit of production capacity as two independent one-dimensional regular diffusions, and we consider a general convex running cost function. The optimization problem is set as a three-dimens…
▽ More
This paper examines a Markovian model for the optimal irreversible investment problem of a firm aiming at minimizing total expected costs of production. We model market uncertainty and the cost of investment per unit of production capacity as two independent one-dimensional regular diffusions, and we consider a general convex running cost function. The optimization problem is set as a three-dimensional degenerate singular stochastic control problem.
We provide the optimal control as the solution of a Skorohod reflection problem at a suitable boundary surface. Such boundary arises from the analysis of a family of two-dimensional parameter-dependent optimal stop** problems and it is characterized in terms of the family of unique continuous solutions to parameter-dependent nonlinear integral equations of Fredholm type.
△ Less
Submitted 8 January, 2017; v1 submitted 17 June, 2014;
originally announced June 2014.
-
A Non Convex Singular Stochastic Control Problem and its Related Optimal Stop** Boundaries
Authors:
Tiziano De Angelis,
Giorgio Ferrari,
John Moriarty
Abstract:
Equivalences are known between problems of singular stochastic control (SSC) with convex performance criteria and related questions of optimal stop**, see for example Karatzas and Shreve [SIAM J. Control Optim. 22 (1984)]. The aim of this paper is to investigate how far connections of this type generalise to a non convex problem of purchasing electricity. Where the classical equivalence breaks d…
▽ More
Equivalences are known between problems of singular stochastic control (SSC) with convex performance criteria and related questions of optimal stop**, see for example Karatzas and Shreve [SIAM J. Control Optim. 22 (1984)]. The aim of this paper is to investigate how far connections of this type generalise to a non convex problem of purchasing electricity. Where the classical equivalence breaks down we provide alternative connections to optimal stop** problems.
We consider a non convex infinite time horizon SSC problem whose state consists of an uncontrolled diffusion representing a real-valued commodity price, and a controlled increasing bounded process representing an inventory. We analyse the geometry of the action and inaction regions by characterising their (optimal) boundaries. Unlike the case of convex SSC problems we find that the optimal boundaries may be both reflecting and repelling and it is natural to interpret the problem as one of SSC with discretionary stop**.
△ Less
Submitted 12 November, 2014; v1 submitted 10 May, 2014;
originally announced May 2014.