-
Risk Quadrangle and Robust Optimization Based on $\varphi$-Divergence
Authors:
Cheng Peng,
Anton Malandii,
Stan Uryasev
Abstract:
This paper studies robust and distributionally robust optimization based on the extended $\varphi$-divergence under the Fundamental Risk Quadrangle framework. We present the primal and dual representations of the quadrangle elements: risk, deviation, regret, error, and statistic. The framework provides an interpretation of portfolio optimization, classification and regression as robust optimizatio…
▽ More
This paper studies robust and distributionally robust optimization based on the extended $\varphi$-divergence under the Fundamental Risk Quadrangle framework. We present the primal and dual representations of the quadrangle elements: risk, deviation, regret, error, and statistic. The framework provides an interpretation of portfolio optimization, classification and regression as robust optimization. We furnish illustrative examples demonstrating that many common problems are included in this framework. The $\varphi$-divergence risk measure used in distributionally robust optimization is a special case. We conduct a case study to visualize the risk envelope.
△ Less
Submitted 16 March, 2024;
originally announced March 2024.
-
Divergence Based Quadrangle and Applications
Authors:
Anton Malandii,
Siddhartha Gupte,
Cheng Peng,
Stan Uryasev
Abstract:
This paper introduces a novel framework for assessing risk and decision-making in the presence of uncertainty, the \emph{$\varphi$-Divergence Quadrangle}. This approach expands upon the traditional Risk Quadrangle, a model that quantifies uncertainty through four key components: \emph{risk, deviation, regret}, and \emph{error}. The $\varphi$-Divergence Quadrangle incorporates the $\varphi$-diverge…
▽ More
This paper introduces a novel framework for assessing risk and decision-making in the presence of uncertainty, the \emph{$\varphi$-Divergence Quadrangle}. This approach expands upon the traditional Risk Quadrangle, a model that quantifies uncertainty through four key components: \emph{risk, deviation, regret}, and \emph{error}. The $\varphi$-Divergence Quadrangle incorporates the $\varphi$-divergence as a measure of the difference between probability distributions, thereby providing a more nuanced understanding of risk. Importantly, the $\varphi$-Divergence Quadrangle is closely connected with the distributionally robust optimization based on the $\varphi$-divergence approach through the duality theory of convex functionals. To illustrate its practicality and versatility, several examples of the $\varphi$-Divergence Quadrangle are provided, including the Quantile Quadrangle. The final portion of the paper outlines a case study implementing regression with the Entropic Value-at-Risk Quadrangle. The proposed $\varphi$-Divergence Quadrangle presents a refined methodology for understanding and managing risk, contributing to the ongoing development of risk assessment and management strategies.
△ Less
Submitted 12 July, 2023; v1 submitted 28 June, 2023;
originally announced June 2023.
-
Expectile Quadrangle and Applications
Authors:
Viktor Kuzmenko,
Anton Malandii,
Stan Uryasev
Abstract:
The paper explores the concept of the \emph{expectile risk measure} within the framework of the Fundamental Risk Quadrangle (FRQ) theory. According to the FRQ theory, a quadrangle comprises four stochastic functions associated with a random variable: ``error'', ``regret'', ``risk'', and ``deviation''. These functions are interconnected through a stochastic function known as the ``statistic''. Expe…
▽ More
The paper explores the concept of the \emph{expectile risk measure} within the framework of the Fundamental Risk Quadrangle (FRQ) theory. According to the FRQ theory, a quadrangle comprises four stochastic functions associated with a random variable: ``error'', ``regret'', ``risk'', and ``deviation''. These functions are interconnected through a stochastic function known as the ``statistic''. Expectile is a risk measure that, similar to VaR (quantile) and CVaR (superquantile), can be employed in risk management. While quadrangles based on VaR and CVaR statistics are well-established and widely used, the paper focuses on the recently proposed quadrangles based on expectile. The aim of this paper is to rigorously examine the properties of these Expectile Quadrangles, with particular emphasis on a quadrangle that encompasses expectile as both a statistic and a measure of risk.
△ Less
Submitted 12 July, 2023; v1 submitted 28 June, 2023;
originally announced June 2023.
-
Mixture Quantiles Estimated by Constrained Linear Regression
Authors:
Cheng Peng,
Yizhou Li,
Stan Uryasev
Abstract:
The paper considers the problem of modeling a univariate random variable. Main contributions: (i) Suggested a new family of distributions with quantile defined by a linear combination of some basis quantiles. This family of distributions has a high shape flexibility and covers commonly used distributions. (ii) Proposed an efficient estimation method by constrained linear regression (linearity with…
▽ More
The paper considers the problem of modeling a univariate random variable. Main contributions: (i) Suggested a new family of distributions with quantile defined by a linear combination of some basis quantiles. This family of distributions has a high shape flexibility and covers commonly used distributions. (ii) Proposed an efficient estimation method by constrained linear regression (linearity with respect to the parameters). Various types of constraints and regularizations are readily available to reduce model flexibility and improve out-of-sample performance for small datasets . (iii) Proved that the estimator is asymptotically a minimum Wasserstein distance estimator and is asymptotically normal. The estimation method can also be viewed as the best fit in quantile-quantile plot. (iv) Case study demonstrated numerical efficiency of the approach (estimated distribution of historical drawdowns of SP500 Index).
△ Less
Submitted 28 April, 2023;
originally announced May 2023.
-
Factor Model of Mixtures
Authors:
Cheng Peng,
Stanislav Uryasev
Abstract:
This paper proposes a new approach to estimating the distribution of a response variable conditioned on observing some factors. The proposed approach possesses desirable properties of flexibility, interpretability, tractability and extendability. The conditional quantile function is modeled by a mixture (weighted sum) of basis quantile functions, with the weights depending on factors. The calibrat…
▽ More
This paper proposes a new approach to estimating the distribution of a response variable conditioned on observing some factors. The proposed approach possesses desirable properties of flexibility, interpretability, tractability and extendability. The conditional quantile function is modeled by a mixture (weighted sum) of basis quantile functions, with the weights depending on factors. The calibration problem is formulated as a convex optimization problem. It can be viewed as conducting quantile regressions for all confidence levels simultaneously while avoiding quantile crossing by definition. The calibration problem is equivalent to minimizing the continuous ranked probability score (CRPS). Based on the canonical polyadic (CP) decomposition of tensors, we propose a dimensionality reduction method that reduces the rank of the parameter tensor and propose an alternating algorithm for estimation. Additionally, based on Risk Quadrangle framework, we generalize the approach to conditional distributions defined by Conditional Value-at-Risk (CVaR), expectile and other functions of uncertainty measures. Although this paper focuses on using splines as the weight functions, it can be extended to neural networks. Numerical experiments demonstrate the effectiveness of our approach.
△ Less
Submitted 14 March, 2023; v1 submitted 31 January, 2023;
originally announced January 2023.
-
Support Vector Regression: Risk Quadrangle Framework
Authors:
Anton Malandii,
Stan Uryasev
Abstract:
This paper investigates Support Vector Regression (SVR) in the context of the fundamental risk quadrangle theory, which links optimization, risk management, and statistical estimation. It is shown that both formulations of SVR, $\varepsilon$-SVR and $ν$-SVR, correspond to the minimization of equivalent error measures (Vapnik error and CVaR norm, respectively) with a regularization penalty. These e…
▽ More
This paper investigates Support Vector Regression (SVR) in the context of the fundamental risk quadrangle theory, which links optimization, risk management, and statistical estimation. It is shown that both formulations of SVR, $\varepsilon$-SVR and $ν$-SVR, correspond to the minimization of equivalent error measures (Vapnik error and CVaR norm, respectively) with a regularization penalty. These error measures, in turn, define the corresponding risk quadrangles. By constructing the fundamental risk quadrangle, which corresponds to SVR, we show that SVR is the asymptotically unbiased estimator of the average of two symmetric conditional quantiles. Further, we prove the equivalence of the $\varepsilon$-SVR and $ν$-SVR in a general stochastic setting. Additionally, SVR is formulated as a regular deviation minimization problem with a regularization penalty. Finally, the dual formulation of SVR in the risk quadrangle framework is derived.
△ Less
Submitted 30 September, 2023; v1 submitted 18 December, 2022;
originally announced December 2022.
-
Looper: An end-to-end ML platform for product decisions
Authors:
Igor L. Markov,
Hanson Wang,
Nitya Kasturi,
Shaun Singh,
Sze Wai Yuen,
Mia Garrard,
Sarah Tran,
Yin Huang,
Zehui Wang,
Igor Glotov,
Tanvi Gupta,
Boshuang Huang,
Peng Chen,
Xiaowen Xie,
Michael Belkin,
Sal Uryasev,
Sam Howie,
Eytan Bakshy,
Norm Zhou
Abstract:
Modern software systems and products increasingly rely on machine learning models to make data-driven decisions based on interactions with users, infrastructure and other systems. For broader adoption, this practice must (i) accommodate product engineers without ML backgrounds, (ii) support finegrain product-metric evaluation and (iii) optimize for product goals. To address shortcomings of prior p…
▽ More
Modern software systems and products increasingly rely on machine learning models to make data-driven decisions based on interactions with users, infrastructure and other systems. For broader adoption, this practice must (i) accommodate product engineers without ML backgrounds, (ii) support finegrain product-metric evaluation and (iii) optimize for product goals. To address shortcomings of prior platforms, we introduce general principles for and the architecture of an ML platform, Looper, with simple APIs for decision-making and feedback collection. Looper covers the end-to-end ML lifecycle from collecting training data and model training to deployment and inference, and extends support to personalization, causal evaluation with heterogenous treatment effects, and Bayesian tuning for product goals. During the 2021 production deployment Looper simultaneously hosted 440-1,000 ML models that made 4-6 million real-time decisions per second. We sum up experiences of platform adopters and describe their learning curve.
△ Less
Submitted 21 June, 2022; v1 submitted 14 October, 2021;
originally announced October 2021.
-
Portfolio Optimization with Expectile and Omega Functions
Authors:
Alexander Wagner,
Stan Uryasev
Abstract:
This paper proves equivalences of portfolio optimization problems with negative expectile and omega ratio. We derive subgradients for the negative expectile as a function of the portfolio from a known dual representation of expectile and general theory about subgradients of risk measures. We also give an elementary derivation of the gradient of negative expectile under some assumptions and provide…
▽ More
This paper proves equivalences of portfolio optimization problems with negative expectile and omega ratio. We derive subgradients for the negative expectile as a function of the portfolio from a known dual representation of expectile and general theory about subgradients of risk measures. We also give an elementary derivation of the gradient of negative expectile under some assumptions and provide an example where negative expectile is demonstrably not differentiable. We conducted a case study and solved portfolio optimization problems with negative expectile objective and constraint.
△ Less
Submitted 30 October, 2019;
originally announced October 2019.
-
Calculating CVaR and bPOE for Common Probability Distributions With Application to Portfolio Optimization and Density Estimation
Authors:
Matthew Norton,
Valentyn Khokhlov,
Stan Uryasev
Abstract:
Conditional Value-at-Risk (CVaR) and Value-at-Risk (VaR), also called the superquantile and quantile, are frequently used to characterize the tails of probability distribution's and are popular measures of risk. Buffered Probability of Exceedance (bPOE) is a recently introduced characterization of the tail which is the inverse of CVaR, much like the CDF is the inverse of the quantile. These quanti…
▽ More
Conditional Value-at-Risk (CVaR) and Value-at-Risk (VaR), also called the superquantile and quantile, are frequently used to characterize the tails of probability distribution's and are popular measures of risk. Buffered Probability of Exceedance (bPOE) is a recently introduced characterization of the tail which is the inverse of CVaR, much like the CDF is the inverse of the quantile. These quantities can prove very useful as the basis for a variety of risk-averse parametric engineering approaches. Their use, however, is often made difficult by the lack of well-known closed-form equations for calculating these quantities for commonly used probability distribution's. In this paper, we derive formulas for the superquantile and bPOE for a variety of common univariate probability distribution's. Besides providing a useful collection within a single reference, we use these formulas to incorporate the superquantile and bPOE into parametric procedures. In particular, we consider two: portfolio optimization and density estimation. First, when portfolio returns are assumed to follow particular distribution families, we show that finding the optimal portfolio via minimization of bPOE has advantages over superquantile minimization. We show that, given a fixed threshold, a single portfolio is the minimal bPOE portfolio for an entire class of distribution's simultaneously. Second, we apply our formulas to parametric density estimation and propose the method of superquantile's (MOS), a simple variation of the method of moment's (MM) where moment's are replaced by superquantile's at different confidence levels. With the freedom to select various combinations of confidence levels, MOS allows the user to focus the fitting procedure on different portions of the distribution, such as the tail when fitting heavy-tailed asymmetric data.
△ Less
Submitted 17 February, 2019; v1 submitted 27 November, 2018;
originally announced November 2018.
-
Yet Another Convex Sets Subtraction with Application in Nondifferentiable Optimization
Authors:
Evgeni Nurminski,
Stan Uryasev
Abstract:
This paper introduces a new subtraction operation for convex sets, which defines their difference as a collection of inclusion-minimal convex sets with appropriate definitions of linear operations on them. With these operations the set of collections becomes a linear vector space with common zero and possibility to invert Minkowski summation. As the demonstration of usability of this concept the L…
▽ More
This paper introduces a new subtraction operation for convex sets, which defines their difference as a collection of inclusion-minimal convex sets with appropriate definitions of linear operations on them. With these operations the set of collections becomes a linear vector space with common zero and possibility to invert Minkowski summation. As the demonstration of usability of this concept the Lipschitz continuity of \(ε\)-subdifferentials of convex analysis is proved in a novel way.
△ Less
Submitted 15 June, 2018; v1 submitted 21 January, 2018;
originally announced January 2018.
