Showing 1–20 of 20 results for author: Zariphopoulou, T

Decision Making under Costly Sequential Information Acquisition: the Paradigm of Reversible and Irreversible Decisions

Authors: Renyuan Xu, Thaleia Zariphopoulou, Luhao Zhang

Abstract: Decision making in modern stochastic systems, including e-commerce platforms, financial markets, and healthcare systems, has evolved into a multifaceted process that involves information acquisition and adaptive information sources. This paper initiates a study on this integrated process, where these elements are not only fundamental but also interact in a complex and dynamically intertwined manne… ▽ More Decision making in modern stochastic systems, including e-commerce platforms, financial markets, and healthcare systems, has evolved into a multifaceted process that involves information acquisition and adaptive information sources. This paper initiates a study on this integrated process, where these elements are not only fundamental but also interact in a complex and dynamically intertwined manner. We introduce a relatively simple model, which, however, captures the novel elements we consider. Specifically, a decision maker (DM) can choose between an established product $A$ with a known value and a new product $B$ with an unknown value. The DM can observe signals about the unknown value of product $B$ and can also opt to exchange it for product $A$ if $B$ is initially chosen. Mathematically, the model gives rise to a sequential optimal stop** problem with two different informational regimes (before and after buying product $B$), differentiated by the initial, coarser signal and the subsequent, finer one. We analyze the underlying problems using predominantly viscosity solution techniques, differing from the existing literature on information acquisition which is based on traditional optimal stop** techniques. Additionally, our modeling approach offers a novel framework for develo** more complex interactions among decisions, information sources, and information costs through a sequence of nested obstacles. △ Less

Submitted 10 January, 2024; v1 submitted 31 December, 2023; originally announced January 2024.

Representation of forward performance criteria with random endowment via FBSDE and application to forward optimized certainty equivalent

Authors: Gechun Liang, Yifan Sun, Thaleia Zariphopoulou

Abstract: We extend the notion of forward performance criteria to settings with random endowment in incomplete markets. Building on these results, we introduce and develop the novel concept of forward optimized certainty equivalent (forward OCE), which offers a genuinely dynamic valuation mechanism that accommodates progressively adaptive market model updates, stochastic risk preferences, and incoming claim… ▽ More We extend the notion of forward performance criteria to settings with random endowment in incomplete markets. Building on these results, we introduce and develop the novel concept of forward optimized certainty equivalent (forward OCE), which offers a genuinely dynamic valuation mechanism that accommodates progressively adaptive market model updates, stochastic risk preferences, and incoming claims with arbitrary maturities. In parallel, we develop a new methodology to analyze the emerging stochastic optimization problems by directly studying the candidate optimal control processes for both the primal and dual problems. Specifically, we derive two new systems of forward-backward stochastic differential equations (FBSDEs) and establish necessary and sufficient conditions for optimality, and various equivalences between the two problems. This new approach is general and complements the existing one based on backward stochastic partial differential equations (backward SPDEs) for the related value functions. We, also, consider representative examples for both forward performance criteria with random endowment and forward OCE, and for the case of exponential criteria, we investigate the connection between forward OCE and forward entropic risk measures. △ Less

Submitted 29 December, 2023; originally announced January 2024.

Comments: 50 pages

MSC Class: 91G10; 91G80; 60H30

$N$-player and Mean-field Games in Itô-diffusion Markets with Competitive or Homophilous Interaction

Authors: Ruimeng Hu, Thaleia Zariphopoulou

Abstract: In Itô-diffusion environments, we introduce and analyze $N$-player and common-noise mean-field games in the context of optimal portfolio choice in a common market. The players invest in a finite horizon and also interact, driven either by competition or homophily. We study an incomplete market model in which the players have constant individual risk tolerance coefficients (CARA utilities). We also… ▽ More In Itô-diffusion environments, we introduce and analyze $N$-player and common-noise mean-field games in the context of optimal portfolio choice in a common market. The players invest in a finite horizon and also interact, driven either by competition or homophily. We study an incomplete market model in which the players have constant individual risk tolerance coefficients (CARA utilities). We also consider the general case of random individual risk tolerances and analyze the related games in a complete market setting. This randomness makes the problem substantially more complex as it leads to ($N$ or a continuum of) auxiliary ''individual'' Itô-diffusion markets. For all cases, we derive explicit or closed-form solutions for the equilibrium stochastic processes, the optimal state processes, and the values of the games. △ Less

Submitted 14 June, 2021; v1 submitted 1 June, 2021; originally announced June 2021.

Competition in Fund Management and Forward Relative Performance Criteria

Authors: Michail Anthropelos, Tianran Geng, Thaleia Zariphopoulou

Abstract: In an Ito-diffusion market, two fund managers trade under relative performance concerns. For both the asset specialization and diversification settings, we analyze the passive and competitive cases. We measure the performance of the managers' strategies via forward relative performance criteria, leading to the respective notions of forward best-response criterion and forward Nash equilibrium. The… ▽ More In an Ito-diffusion market, two fund managers trade under relative performance concerns. For both the asset specialization and diversification settings, we analyze the passive and competitive cases. We measure the performance of the managers' strategies via forward relative performance criteria, leading to the respective notions of forward best-response criterion and forward Nash equilibrium. The motivation to develop such criteria comes from the need to relax various crucial, but quite stringent, existing assumptions -- such as, the a priori choices of both the market model and the investment horizon, the commonality of the latter for both managers as well as the full a priori knowledge of the competitor's policies for the best-response case. We focus on locally riskless criteria and deduce the random forward equations. We solve the CRRA cases, thus also extending the related results in the classical setting. An important by-product of the work herein is the development of forward performance criteria for investment problems in Ito-diffusion markets under the presence of correlated random endowment process for both the perfectly and the incomplete market cases. △ Less

Submitted 2 November, 2020; originally announced November 2020.

Entropy Regularization for Mean Field Games with Learning

Authors: Xin Guo, Renyuan Xu, Thaleia Zariphopoulou

Abstract: Entropy regularization has been extensively adopted to improve the efficiency, the stability, and the convergence of algorithms in reinforcement learning. This paper analyzes both quantitatively and qualitatively the impact of entropy regularization for Mean Field Game (MFG) with learning in a finite time horizon. Our study provides a theoretical justification that entropy regularization yields ti… ▽ More Entropy regularization has been extensively adopted to improve the efficiency, the stability, and the convergence of algorithms in reinforcement learning. This paper analyzes both quantitatively and qualitatively the impact of entropy regularization for Mean Field Game (MFG) with learning in a finite time horizon. Our study provides a theoretical justification that entropy regularization yields time-dependent policies and, furthermore, helps stabilizing and accelerating convergence to the game equilibrium. In addition, this study leads to a policy-gradient algorithm for exploration in MFG. Under this algorithm, agents are able to learn the optimal exploration scheduling, with stable and fast convergence to the game equilibrium. △ Less

Submitted 8 December, 2021; v1 submitted 30 September, 2020; originally announced October 2020.

On the analyticity of the value function in optimal investment and stochastically dominant markets

Authors: Oleskii Mostovyi, Mihai Sîrbu, Thaleia Zariphopoulou

Abstract: We study the analyticity of the value function in optimal investment with expected utility from terminal wealth and the relation to stochastically dominant financial models. We identify both a class of utilities and a class of semi-martingale models for which we establish analyticity. Specifically, these utilities have completely monotonic inverse marginals, while the market models have a maximal… ▽ More We study the analyticity of the value function in optimal investment with expected utility from terminal wealth and the relation to stochastically dominant financial models. We identify both a class of utilities and a class of semi-martingale models for which we establish analyticity. Specifically, these utilities have completely monotonic inverse marginals, while the market models have a maximal element in the sense of infinite-order stochastic dominance. We construct two counterexamples, themselves of independent interest, which show that analyticity fails if either the utility or the market model does not belong to the respective special class. We also provide explicit formulas for the derivatives, of all orders, of the value functions as well as their optimizers. Finally, we show that for the set of supermartingale deflators, stochastic dominance of infinite order is equivalent to the apparently stronger dominance of second order. △ Less

Submitted 3 June, 2021; v1 submitted 3 February, 2020; originally announced February 2020.

Comments: 40 pages

MSC Class: 91G10; 93E20

Personalized Robo-Advising: Enhancing Investment through Client Interaction

Authors: Agostino Capponi, Sveinn Olafsson, Thaleia Zariphopoulou

Abstract: Automated investment managers, or robo-advisors, have emerged as an alternative to traditional financial advisors. The viability of robo-advisors crucially depends on their ability to offer personalized financial advice. We introduce a novel framework, in which a robo-advisor interacts with a client to solve an adaptive mean-variance portfolio optimization problem. The risk-return tradeoff adapts… ▽ More Automated investment managers, or robo-advisors, have emerged as an alternative to traditional financial advisors. The viability of robo-advisors crucially depends on their ability to offer personalized financial advice. We introduce a novel framework, in which a robo-advisor interacts with a client to solve an adaptive mean-variance portfolio optimization problem. The risk-return tradeoff adapts to the client's risk profile, which depends on idiosyncratic characteristics, market returns, and economic conditions. We show that the optimal investment strategy includes both myopic and intertemporal hedging terms which are impacted by the dynamics of the client's risk profile. We characterize the optimal portfolio personalization via a tradeoff faced by the robo-advisor between receiving client information in a timely manner and mitigating behavioral biases in the risk profile communicated by the client. We argue that the optimal portfolio's Sharpe ratio and return distribution improve if the robo-advisor counters the client's tendency to reduce market exposure during economic contractions when the market risk-return tradeoff is more favorable. △ Less

Submitted 24 November, 2020; v1 submitted 4 November, 2019; originally announced November 2019.

Forward Rank-Dependent Performance Criteria: Time-Consistent Investment Under Probability Distortion

Authors: Xue Dong He, Moris S. Strub, Thaleia Zariphopoulou

Abstract: We introduce the concept of forward rank-dependent performance processes, extending the original notion to forward criteria that incorporate probability distortions. A fundamental challenge is how to reconcile the time-consistent nature of forward performance criteria with the time-inconsistency stemming from probability distortions. For this, we first propose two distinct definitions, one based o… ▽ More We introduce the concept of forward rank-dependent performance processes, extending the original notion to forward criteria that incorporate probability distortions. A fundamental challenge is how to reconcile the time-consistent nature of forward performance criteria with the time-inconsistency stemming from probability distortions. For this, we first propose two distinct definitions, one based on the preservation of performance value and the other on the time-consistency of policies and, in turn, establish their equivalence. We then fully characterize the viable class of probability distortion processes, providing a bifurcation-type result. Specifically, it is either the case that the probability distortions are degenerate in the sense that the investor would never invest in the risky assets, or the marginal probability distortion equals to a normalized power of the quantile function of the pricing kernel. We also characterize the optimal wealth process, whose structure motivates the introduction of a new, distorted measure and a related market. We then build a striking correspondence between the forward rank-dependent criteria in the original market and forward criteria without probability distortions in the auxiliary market. This connection also provides a direct construction method for forward rank-dependent criteria. A byproduct of our work are some new results on the so-called dynamic utilities and on time-inconsistent problems in the classical (backward) setting. △ Less

Submitted 2 April, 2019; originally announced April 2019.

Exploration versus exploitation in reinforcement learning: a stochastic control approach

Authors: Haoran Wang, Thaleia Zariphopoulou, Xunyu Zhou

Abstract: We consider reinforcement learning (RL) in continuous time and study the problem of achieving the best trade-off between exploration of a black box environment and exploitation of current knowledge. We propose an entropy-regularized reward function involving the differential entropy of the distributions of actions, and motivate and devise an exploratory formulation for the feature dynamics that ca… ▽ More We consider reinforcement learning (RL) in continuous time and study the problem of achieving the best trade-off between exploration of a black box environment and exploitation of current knowledge. We propose an entropy-regularized reward function involving the differential entropy of the distributions of actions, and motivate and devise an exploratory formulation for the feature dynamics that captures repetitive learning under exploration. The resulting optimization problem is a revitalization of the classical relaxed stochastic control. We carry out a complete analysis of the problem in the linear--quadratic (LQ) setting and deduce that the optimal feedback control distribution for balancing exploitation and exploration is Gaussian. This in turn interprets and justifies the widely adopted Gaussian exploration in RL, beyond its simplicity for sampling. Moreover, the exploitation and exploration are captured, respectively and mutual-exclusively, by the mean and variance of the Gaussian distribution. We also find that a more random environment contains more learning opportunities in the sense that less exploration is needed. We characterize the cost of exploration, which, for the LQ case, is shown to be proportional to the entropy regularization weight and inversely proportional to the discount rate. Finally, as the weight of exploration decays to zero, we prove the convergence of the solution of the entropy-regularized LQ problem to the one of the classical LQ problem. △ Less

Submitted 13 February, 2019; v1 submitted 4 December, 2018; originally announced December 2018.

Optimal contract for a fund manager, with capital injections and endogenous trading constraints

Authors: Sergey Nadtochiy, Thaleia Zariphopoulou

Abstract: In this paper, we construct a solution to the optimal contract problem for delegated portfolio management of the fist-best (risk-sharing) type. The novelty of our result is (i) in the robustness of the optimal contract with respect to perturbations of the wealth process (interpreted as capital injections), and (ii) in the more general form of principals objective function, which is allowed to depe… ▽ More In this paper, we construct a solution to the optimal contract problem for delegated portfolio management of the fist-best (risk-sharing) type. The novelty of our result is (i) in the robustness of the optimal contract with respect to perturbations of the wealth process (interpreted as capital injections), and (ii) in the more general form of principals objective function, which is allowed to depend directly on the agents strategy, as opposed to being a function of the generated wealth only. In particular, the latter feature allows us to incorporate endogenous trading constraints in the contract. We reduce the optimal contract problem to the following inverse problem: for a given portfolio (defined in a feedback form, as a random field), construct a stochastic utility whose optimal portfolio coincides with the given one. We characterize the solution to this problem through a Stochastic Partial Differential Equation (SPDE), prove its well-posedness, and compute the solution explicitly in the Black-Scholes model. △ Less

Submitted 26 February, 2018; originally announced February 2018.

An approximation scheme for semilinear parabolic PDEs with convex and coercive Hamiltonians

Authors: Shuo Huang, Gechun Liang, Thaleia Zariphopoulou

Abstract: We propose an approximation scheme for a class of semilinear parabolic equations that are convex and coercive in their gradients. Such equations arise often in pricing and portfolio management in incomplete markets and, more broadly, are directly connected to the representation of solutions to backward stochastic differential equations. The proposed scheme is based on splitting the equation in two… ▽ More We propose an approximation scheme for a class of semilinear parabolic equations that are convex and coercive in their gradients. Such equations arise often in pricing and portfolio management in incomplete markets and, more broadly, are directly connected to the representation of solutions to backward stochastic differential equations. The proposed scheme is based on splitting the equation in two parts, the first corresponding to a linear parabolic equation and the second to a Hamilton-Jacobi equation. The solutions of these two equations are approximated using, respectively, the Feynman-Kac and the Hopf-Lax formulae. We establish the convergence of the scheme and determine the convergence rate, combining Krylov's shaking coefficients technique and Barles-Jakobsen's optimal switching approximation. △ Less

Submitted 4 November, 2019; v1 submitted 2 January, 2018; originally announced January 2018.

Comments: 24 pages

MSC Class: 35K65; 65M12; 93E20

On the Black's equation for the risk tolerance function

Authors: Sigrid Källblad, Thaleia Zariphopoulou

Abstract: We analyze a nonlinear equation proposed by F. Black (1968) for the optimal portfolio function in a log-normal model. We cast it in terms of the risk tolerance function and provide, for general utility functions, existence, uniqueness and regularity results, and we also examine various monotonicity, concavity/convexity and S-shape properties. Stronger results are derived for utilities whose invers… ▽ More We analyze a nonlinear equation proposed by F. Black (1968) for the optimal portfolio function in a log-normal model. We cast it in terms of the risk tolerance function and provide, for general utility functions, existence, uniqueness and regularity results, and we also examine various monotonicity, concavity/convexity and S-shape properties. Stronger results are derived for utilities whose inverse marginal belongs to a class of completely monotonic functions. △ Less

Submitted 21 May, 2017; originally announced May 2017.

Mean field and n-agent games for optimal investment under relative performance criteria

Authors: Daniel Lacker, Thaleia Zariphopoulou

Abstract: We analyze a family of portfolio management problems under relative performance criteria, for fund managers having CARA or CRRA utilities and trading in a common investment horizon in log-normal markets. We construct explicit constant equilibrium strategies for both the finite population games and the corresponding mean field games, which we show are unique in the class of constant equilibria. In… ▽ More We analyze a family of portfolio management problems under relative performance criteria, for fund managers having CARA or CRRA utilities and trading in a common investment horizon in log-normal markets. We construct explicit constant equilibrium strategies for both the finite population games and the corresponding mean field games, which we show are unique in the class of constant equilibria. In the CARA case, competition drives agents to invest more in the risky asset than they would otherwise, while in the CRRA case competitive agents may over- or under-invest, depending on their levels of risk tolerance. △ Less

Submitted 29 June, 2018; v1 submitted 22 March, 2017; originally announced March 2017.

Temporal and Spatial Turnpike-Type Results Under Forward Time-Monotone Performance Criteria

Authors: Tianran Geng, Thaleia Zariphopoulou

Abstract: We present turnpike-type results for the risk tolerance function in an incomplete market setting under time-monotone forward performance criteria. We show that, contrary to the classical case, the temporal and spatial limits do not coincide. We also show that they depend directly on the left- and right-end of the support of an underlying measure, which is used to construct the forward performance… ▽ More We present turnpike-type results for the risk tolerance function in an incomplete market setting under time-monotone forward performance criteria. We show that, contrary to the classical case, the temporal and spatial limits do not coincide. We also show that they depend directly on the left- and right-end of the support of an underlying measure, which is used to construct the forward performance criterion. We provide examples with discrete and continuous measures, and discuss the asymptotic behavior of the risk tolerance for each case. △ Less

Submitted 18 February, 2017; originally announced February 2017.

Predictable Forward Performance Processes: The Binomial Case

Authors: Bahman Angoshtari, Thaleia Zariphopoulou, Xun Yu Zhou

Abstract: We introduce a new class of forward performance processes that are endogenous and predictable with regards to an underlying market information set and, furthermore, are updated at discrete times. We analyze in detail a binomial model whose parameters are random and updated dynamically as the market evolves. We show that the key step in the construction of the associated predictable forward perform… ▽ More We introduce a new class of forward performance processes that are endogenous and predictable with regards to an underlying market information set and, furthermore, are updated at discrete times. We analyze in detail a binomial model whose parameters are random and updated dynamically as the market evolves. We show that the key step in the construction of the associated predictable forward performance process is to solve a single-period inverse investment problem, namely, to determine, period-by-period and conditionally on the current market information, the end-time utility function from a given initial-time value function. We reduce this inverse problem to solving a functional equation and establish conditions for the existence and uniqueness of its solutions in the class of inverse marginal functions. △ Less

Submitted 19 March, 2019; v1 submitted 14 November, 2016; originally announced November 2016.

An ergodic BSDE approach to forward entropic risk measures: representation and large-maturity behavior

Authors: Wing Fung Chong, Ying Hu, Gechun Liang, Thaleia Zariphopoulou

Abstract: Using elements from the theory of ergodic backward stochastic differential equations (BSDE), we study the behavior of forward entropic risk measures. We provide their general representation results (via both BSDE and convex duality) and examine their behavior for risk positions of long maturities. We show that forward entropic risk measures converge to some constant exponentially fast. We also com… ▽ More Using elements from the theory of ergodic backward stochastic differential equations (BSDE), we study the behavior of forward entropic risk measures. We provide their general representation results (via both BSDE and convex duality) and examine their behavior for risk positions of long maturities. We show that forward entropic risk measures converge to some constant exponentially fast. We also compare them with their classical counterparts and derive a parity result. △ Less

Submitted 17 April, 2017; v1 submitted 8 July, 2016; originally announced July 2016.

Representation of homothetic forward performance processes in stochastic factor models via ergodic and infinite horizon BSDE

Authors: Gechun Liang, Thaleia Zariphopoulou

Abstract: In an incomplete market, with incompleteness stemming from stochastic factors imperfectly correlated with the underlying stocks, we derive representations of homothetic (power, exponential and logarithmic) forward performance processes in factor-form using ergodic BSDE. We also develop a connection between the forward processes and infinite horizon BSDE, and, moreover, with risk-sensitive optimiza… ▽ More In an incomplete market, with incompleteness stemming from stochastic factors imperfectly correlated with the underlying stocks, we derive representations of homothetic (power, exponential and logarithmic) forward performance processes in factor-form using ergodic BSDE. We also develop a connection between the forward processes and infinite horizon BSDE, and, moreover, with risk-sensitive optimization. In addition, we develop a connection, for large time horizons, with a family of classical homothetic value function processes with random endowments. △ Less

Submitted 16 November, 2016; v1 submitted 16 November, 2015; originally announced November 2015.

Comments: 34 pages

Asymptotic analysis of forward performance processes in incomplete markets and their ill-posed HJB equations

Authors: Mykhaylo Shkolnikov, Ronnie Sircar, Thaleia Zariphopoulou

Abstract: We consider the problem of optimal portfolio selection under forward investment performance criteria in an incomplete market. The dynamics of the prices of the traded assets depend on a pair of stochastic factors, namely, a slow factor (e.g. a macroeconomic indicator) and a fast factor (e.g. stochastic volatility). We analyze the associated forward performance SPDE and provide explicit formulae fo… ▽ More We consider the problem of optimal portfolio selection under forward investment performance criteria in an incomplete market. The dynamics of the prices of the traded assets depend on a pair of stochastic factors, namely, a slow factor (e.g. a macroeconomic indicator) and a fast factor (e.g. stochastic volatility). We analyze the associated forward performance SPDE and provide explicit formulae for the leading order and first order correction terms for the forward investment process and the optimal feedback portfolios. They both depend on the investor's initial preferences and the dynamically changing investment opportunities. The leading order terms resemble their time-monotone counterparts, but with the appropriate stochastic time changes resulting from averaging phenomena. The first-order terms compile the reaction of the investor to both the changes in the market input and his recent performance. Our analysis is based on an expansion of the underlying ill-posed HJB equation, and it is justified by means of an appropriate remainder estimate. △ Less

Submitted 23 September, 2015; v1 submitted 13 April, 2015; originally announced April 2015.

Comments: 26 pages

MSC Class: 91G10; 91G80; 49L99; 47J06

Time--consistent investment under model uncertainty: the robust forward criteria

Authors: Sigrid Kallblad, Jan Obloj, Thaleia Zariphopoulou

Abstract: We combine forward investment performance processes and ambiguity averse portfolio selection. We introduce the notion of robust forward criteria which addresses the issues of ambiguity in model specification and in preferences and investment horizon specification. It describes the evolution of time-consistent ambiguity averse preferences. We first focus on establishing dual characterizations of… ▽ More We combine forward investment performance processes and ambiguity averse portfolio selection. We introduce the notion of robust forward criteria which addresses the issues of ambiguity in model specification and in preferences and investment horizon specification. It describes the evolution of time-consistent ambiguity averse preferences. We first focus on establishing dual characterizations of the robust forward criteria. This offers various advantages as the dual problem amounts to a search for an infimum whereas the primal problem features a saddle-point. Our approach is based on ideas developed in Schied (2007) and Zitkovic (2009). We then study in detail non-volatile criteria. In particular, we solve explicitly the example of an investor who starts with a logarithmic utility and applies a quadratic penalty function. The investor builds a dynamical estimate of the market price of risk $\hat λ$ and updates her stochastic utility in accordance with the so-perceived elapsed market opportunities. We show that this leads to a time-consistent optimal investment policy given by a fractional Kelly strategy associated with $\hat λ$. The leverage is proportional to the investor's confidence in her estimate $\hat λ$. △ Less

Submitted 13 November, 2014; v1 submitted 14 November, 2013; originally announced November 2013.

MSC Class: 91G10; 91B16

Maturity-independent risk measures

Authors: Thaleia Zariphopoulou, Gordan Zitkovic

Abstract: The new notion of maturity-independent risk measures is introduced and contrasted with the existing risk measurement concepts. It is shown, by means of two examples, one set on a finite probability space and the other in a diffusion framework, that, surprisingly, some of the widely utilized risk measures cannot be used to build maturity-independent counterparts. We construct a large class of mat… ▽ More The new notion of maturity-independent risk measures is introduced and contrasted with the existing risk measurement concepts. It is shown, by means of two examples, one set on a finite probability space and the other in a diffusion framework, that, surprisingly, some of the widely utilized risk measures cannot be used to build maturity-independent counterparts. We construct a large class of maturity-independent risk measures and give representative examples in both continuous- and discrete-time financial models. △ Less

Submitted 4 August, 2008; v1 submitted 20 October, 2007; originally announced October 2007.