-
Regret-based budgeted decision rules under severe uncertainty
Authors:
Nawapon Nakharutai,
Sébastien Destercke,
Matthias C. M. Troffaes
Abstract:
One way to make decisions under uncertainty is to select an optimal option from a possible range of options, by maximizing the expected utilities derived from a probability model. However, under severe uncertainty, identifying precise probabilities is hard. For this reason, imprecise probability models uncertainty through convex sets of probabilities, and considers decision rules that can return m…
▽ More
One way to make decisions under uncertainty is to select an optimal option from a possible range of options, by maximizing the expected utilities derived from a probability model. However, under severe uncertainty, identifying precise probabilities is hard. For this reason, imprecise probability models uncertainty through convex sets of probabilities, and considers decision rules that can return multiple options to reflect insufficient information. Many well-founded decision rules have been studied in the past, but none of those standard rules are able to control the number of returned alternatives. This can be a problem for large decision problems, due to the cognitive burden decision makers have to face when presented with a large number of alternatives. Our contribution proposes regret-based ideas to construct new decision rules which return a bounded number of options, where the limit on the number of options is set in advance by the decision maker as an expression of their cognitive limitation. We also study their consistency and numerical behaviour.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Improving and benchmarking of algorithms for $Γ$-maximin, $Γ$-maximax and interval dominance
Authors:
Nawapon Nakharutai,
Matthias C. M. Troffaes,
Camila C. S. Caiado
Abstract:
$Γ$-maximin, $Γ…
▽ More
$Γ$-maximin, $Γ$-maximax and inteval dominance are familiar decision criteria for making decisions under severe uncertainty, when probability distributions can only be partially identified. One can apply these three criteria by solving sequences of linear programs. In this study, we present new algorithms for these criteria and compare their performance to existing standard algorithms. Specifically, we use efficient ways, based on previous work, to find common initial feasible points for these algorithms. Exploiting these initial feasible points, we develop early stop** criteria to determine whether gambles are either $Γ$-maximin, $Γ$-maximax or interval dominant. We observe that the primal-dual interior point method benefits considerably from these improvements. In our simulation, we find that our proposed algorithms outperform the standard algorithms when the size of the domain of lower previsions is less or equal to the sizes of decisions and outcomes. However, our proposed algorithms do not outperform the standard algorithms in the case that the size of the domain of lower previsions is much larger than the sizes of decisions and outcomes.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Improving and benchmarking of algorithms for decision making with lower previsions
Authors:
Nawapon Nakharutai,
Matthias C. M. Troffaes,
Camila C. S. Caiado
Abstract:
Maximality, interval dominance, and E-admissibility are three well-known criteria for decision making under severe uncertainty using lower previsions. We present a new fast algorithm for finding maximal gambles. We compare its performance to existing algorithms, one proposed by Troffaes and Hable (2014), and one by Jansen, Augustin, and Schollmeyer (2017). To do so, we develop a new method for gen…
▽ More
Maximality, interval dominance, and E-admissibility are three well-known criteria for decision making under severe uncertainty using lower previsions. We present a new fast algorithm for finding maximal gambles. We compare its performance to existing algorithms, one proposed by Troffaes and Hable (2014), and one by Jansen, Augustin, and Schollmeyer (2017). To do so, we develop a new method for generating random decision problems with pre-specified ratios of maximal and interval dominant gambles. Based on earlier work, we present efficient ways to find common feasible starting points in these algorithms. We then exploit these feasible starting points to develop early stop** criteria for the primal-dual interior point method, further improving efficiency. We find that the primal-dual interior point method works best. We also investigate the use of interval dominance to eliminate non-maximal gambles. This can make the problem smaller, and we observe that this benefits Jansen et al.'s algorithm, but perhaps surprisingly, not the other two algorithms. We find that our algorithm, without using interval dominance, outperforms all other algorithms in all scenarios in our benchmarking.
△ Less
Submitted 28 June, 2019;
originally announced June 2019.
-
Evaluating betting odds and free coupons using desirability
Authors:
Nawapon Nakharutai,
Camila C. S. Caiado,
Matthias C. M. Troffaes
Abstract:
In the UK betting market, bookmakers often offer a free coupon to new customers. These free coupons allow the customer to place extra bets, at lower risk, in combination with the usual betting odds. We are interested in whether a customer can exploit these free coupons in order to make a sure gain, and if so, how the customer can achieve this. To answer this question, we evaluate the odds and free…
▽ More
In the UK betting market, bookmakers often offer a free coupon to new customers. These free coupons allow the customer to place extra bets, at lower risk, in combination with the usual betting odds. We are interested in whether a customer can exploit these free coupons in order to make a sure gain, and if so, how the customer can achieve this. To answer this question, we evaluate the odds and free coupons as a set of desirable gambles for the bookmaker. We show that we can use the Choquet integral to check whether this set of desirable gambles incurs sure loss for the bookmaker, and hence, results in a sure gain for the customer. In the latter case, we also show how a customer can determine the combination of bets that make the best possible gain, based on complementary slackness. As an illustration, we look at some actual betting odds in the market and find that, without free coupons, the set of desirable gambles derived from those odds avoids sure loss. However, with free coupons, we identify some combinations of bets that customers could place in order to make a guaranteed gain.
△ Less
Submitted 7 January, 2019;
originally announced January 2019.
-
Improved linear programming methods for checking avoiding sure loss
Authors:
Nawapon Nakharutai,
Matthias C. M. Troffaes,
Camila C. S. Caiado
Abstract:
We review the simplex method and two interior-point methods (the affine scaling and the primal-dual) for solving linear programming problems for checking avoiding sure loss, and propose novel improvements. We exploit the structure of these problems to reduce their size. We also present an extra stop** criterion, and direct ways to calculate feasible starting points in almost all cases. For bench…
▽ More
We review the simplex method and two interior-point methods (the affine scaling and the primal-dual) for solving linear programming problems for checking avoiding sure loss, and propose novel improvements. We exploit the structure of these problems to reduce their size. We also present an extra stop** criterion, and direct ways to calculate feasible starting points in almost all cases. For benchmarking, we present algorithms for generating random sets of desirable gambles that either avoid or do not avoid sure loss. We test our improvements on these linear programming methods by measuring the computational time on these generated sets. We assess the relative performance of the three methods as a function of the number of desirable gambles and the number of outcomes. Overall, the affine scaling and primal-dual methods benefit from the improvements, and they both outperform the simplex method in most scenarios. We conclude that the simplex method is not a good choice for checking avoiding sure loss. If problems are small, then there is no tangible difference in performance between all methods. For large problems, our improved primal-dual method performs at least three times faster than any of the other methods.
△ Less
Submitted 9 August, 2018;
originally announced August 2018.
-
Decision making under uncertainty using imprecise probabilities
Authors:
Matthias C. M. Troffaes
Abstract:
Various ways for decision making with imprecise probabilities (admissibility, maximal expected utility, maximality, E-admissibility, $Γ$-maximax, $Γ$-maximin, all of which are well-known from the literature) are discussed and compared. We generalize a well-known sufficient condition for existence of optimal decisions. A simple numerical example shows how these criteria can work in practice, and de…
▽ More
Various ways for decision making with imprecise probabilities (admissibility, maximal expected utility, maximality, E-admissibility, $Γ$-maximax, $Γ$-maximin, all of which are well-known from the literature) are discussed and compared. We generalize a well-known sufficient condition for existence of optimal decisions. A simple numerical example shows how these criteria can work in practice, and demonstrates their differences. Finally, we suggest an efficient approach to calculate optimal decisions under these decision criteria.
△ Less
Submitted 9 July, 2018;
originally announced July 2018.
-
Imprecise Monte Carlo simulation and iterative importance sampling for the estimation of lower previsions
Authors:
Matthias C. M. Troffaes
Abstract:
We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We link consistency of these estimators to Glivenko-Cantelli classes, and for the sub-Gaussian case we show how the correlation structure of this process can be used…
▽ More
We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We link consistency of these estimators to Glivenko-Cantelli classes, and for the sub-Gaussian case we show how the correlation structure of this process can be used to bound the bias and prove consistency. We also propose a new upper estimator, which can be used along with the standard lower estimator, in order to provide a simple confidence interval. As a case study of this framework, we then discuss how importance sampling can be exploited to provide accurate numerical estimates of lower previsions. We propose an iterative importance sampling method to drastically improve the performance of imprecise importance sampling. We demonstrate our results on the imprecise Dirichlet model.
△ Less
Submitted 27 June, 2018;
originally announced June 2018.
-
A geometric and game-theoretic study of the conjunction of possibility measures
Authors:
Enrique Miranda,
Matthias C. M. Troffaes,
Sebastien Destercke
Abstract:
In this paper, we study the conjunction of possibility measures when they are interpreted as coherent upper probabilities, that is, as upper bounds for some set of probability measures. We identify conditions under which the minimum of two possibility measures remains a possibility measure. We provide graphical way to check these conditions, by means of a zero-sum game formulation of the problem.…
▽ More
In this paper, we study the conjunction of possibility measures when they are interpreted as coherent upper probabilities, that is, as upper bounds for some set of probability measures. We identify conditions under which the minimum of two possibility measures remains a possibility measure. We provide graphical way to check these conditions, by means of a zero-sum game formulation of the problem. This also gives us a nice way to adjust the initial possibility measures so their minimum is guaranteed to be a possibility measure. Finally, we identify conditions under which the minimum of two possibility measures is a coherent upper probability, or in other words, conditions under which the minimum of two possibility measures is an exact upper bound for the intersection of the credal sets of those two possibility measures.
△ Less
Submitted 15 September, 2014;
originally announced September 2014.
-
A robust Bayesian approach to modelling epistemic uncertainty in common-cause failure models
Authors:
Matthias C. M. Troffaes,
Gero Walter,
Dana Kelly
Abstract:
In a standard Bayesian approach to the alpha-factor model for common-cause failure, a precise Dirichlet prior distribution models epistemic uncertainty in the alpha-factors. This Dirichlet prior is then updated with observed data to obtain a posterior distribution, which forms the basis for further inferences.
In this paper, we adapt the imprecise Dirichlet model of Walley to represent epistemic…
▽ More
In a standard Bayesian approach to the alpha-factor model for common-cause failure, a precise Dirichlet prior distribution models epistemic uncertainty in the alpha-factors. This Dirichlet prior is then updated with observed data to obtain a posterior distribution, which forms the basis for further inferences.
In this paper, we adapt the imprecise Dirichlet model of Walley to represent epistemic uncertainty in the alpha-factors. In this approach, epistemic uncertainty is expressed more cautiously via lower and upper expectations for each alpha-factor, along with a learning parameter which determines how quickly the model learns from observed data. For this application, we focus on elicitation of the learning parameter, and find that values in the range of 1 to 10 seem reasonable. The approach is compared with Kelly and Atwood's minimally informative Dirichlet prior for the alpha-factor model, which incorporated precise mean values for the alpha-factors, but which was otherwise quite diffuse.
Next, we explore the use of a set of Gamma priors to model epistemic uncertainty in the marginal failure rate, expressed via a lower and upper expectation for this rate, again along with a learning parameter. As zero counts are generally less of an issue here, we find that the choice of this learning parameter is less crucial.
Finally, we demonstrate how both epistemic uncertainty models can be combined to arrive at lower and upper expectations for all common-cause failure rates. Thereby, we effectively provide a full sensitivity analysis of common-cause failure rates, properly reflecting epistemic uncertainty of the analyst on all levels of the common-cause failure model.
△ Less
Submitted 3 January, 2013;
originally announced January 2013.
-
Identifying subtree perfectness in decision trees
Authors:
Nathan Huntley,
Matthias C. M. Troffaes
Abstract:
In decision problems, often, utilities and probabilities are hard to determine. In such cases, one can resort to so-called choice functions. They provide a means to determine which options in a particular set are optimal, and allow incomparability among any number of options. Applying choice functions in sequential decision problems can be highly non-trivial, as the usual properties of maximising…
▽ More
In decision problems, often, utilities and probabilities are hard to determine. In such cases, one can resort to so-called choice functions. They provide a means to determine which options in a particular set are optimal, and allow incomparability among any number of options. Applying choice functions in sequential decision problems can be highly non-trivial, as the usual properties of maximising expected utility may no longer be satisfied. In this paper, we study one of these properties: we revisit and reinterpret Selten's concept of subgame perfectness in the context of decision trees, leading us to the concept of subtree perfectness, which basically says that the optimal solution of a decision tree should not depend on any larger tree it may be embedded in. In other words, subtree perfectness excludes counterfactual reasoning, and therefore may be desirable from some philosophical points of view. Subtree perfectness is also desirable from a practical point of view, because it admits efficient algorithms for solving decision trees, such as backward induction. The main contribution of this paper is a very simple non-technical criterion for determining whether any given choice function will satisfy subtree perfectness or not. We demonstrate the theorem and illustrate subtree perfectness, or the lack thereof, through numerous examples, for a wide variety of choice functions, where incomparability amongst strategies can be caused by imprecision in either probabilities or utilities. We find that almost no choice function, except for maximising expected utility, satisfies it in general. We also find that choice functions other than maximising expected utility can satisfy it, provided that we restrict either the structure of the tree, or the structure of the choice function.
△ Less
Submitted 6 August, 2012;
originally announced August 2012.
-
Robust detection of exotic infectious diseases in animal herds: A comparative study of three decision methodologies under severe uncertainty
Authors:
Matthias C. M. Troffaes,
John Paul Gosling
Abstract:
When animals are transported and pass through customs, some of them may have dangerous infectious diseases. Typically, due to the cost of testing, not all animals are tested: a reasonable selection must be made. How to test effectively whilst avoiding costly disease outbreaks? First, we extend a model proposed in the literature for the detection of invasive species to suit our purpose. Secondly, w…
▽ More
When animals are transported and pass through customs, some of them may have dangerous infectious diseases. Typically, due to the cost of testing, not all animals are tested: a reasonable selection must be made. How to test effectively whilst avoiding costly disease outbreaks? First, we extend a model proposed in the literature for the detection of invasive species to suit our purpose. Secondly, we explore and compare three decision methodologies on the problem at hand, namely, Bayesian statistics, info-gap theory and imprecise probability theory, all of which are designed to handle severe uncertainty. We show that, under rather general conditions, every info-gap solution is maximal with respect to a suitably chosen imprecise probability model, and that therefore, perhaps surprisingly, the set of maximal options can be inferred at least partly---and sometimes entirely---from an info-gap analysis.
△ Less
Submitted 5 March, 2012; v1 submitted 8 December, 2011;
originally announced December 2011.
-
Subtree perfectness, backward induction, and normal-extensive form equivalence for single agent sequential decision making under arbitrary choice functions
Authors:
Nathan Huntley,
Matthias C. M. Troffaes
Abstract:
We revisit and reinterpret Selten's concept of subgame perfectness in the context of single agent normal form sequential decision making, which leads us to the concept of subtree perfectness. Thereby, we extend Hammond's characterization of extensive form consequentialist consistent behaviour norms to the normal form and to arbitrary choice functions under very few assumptions. In particular, we d…
▽ More
We revisit and reinterpret Selten's concept of subgame perfectness in the context of single agent normal form sequential decision making, which leads us to the concept of subtree perfectness. Thereby, we extend Hammond's characterization of extensive form consequentialist consistent behaviour norms to the normal form and to arbitrary choice functions under very few assumptions. In particular, we do not need to assume probabilities on any event or utilities on any reward. We show that subtree perfectness is equivalent to normal-extensive form equivalence, and is sufficient, but, perhaps surprisingly, not necessary, for backward induction to work.
△ Less
Submitted 16 September, 2011;
originally announced September 2011.
-
Normal form backward induction for decision trees with coherent lower previsions
Authors:
Nathan Huntley,
Matthias C. M. Troffaes
Abstract:
We examine normal form solutions of decision trees under typical choice functions induced by lower previsions. For large trees, finding such solutions is hard as very many strategies must be considered. In an earlier paper, we extended backward induction to arbitrary choice functions, yielding far more efficient solutions, and we identified simple necessary and sufficient conditions for this to wo…
▽ More
We examine normal form solutions of decision trees under typical choice functions induced by lower previsions. For large trees, finding such solutions is hard as very many strategies must be considered. In an earlier paper, we extended backward induction to arbitrary choice functions, yielding far more efficient solutions, and we identified simple necessary and sufficient conditions for this to work. In this paper, we show that backward induction works for maximality and E-admissibility, but not for interval dominance and Gamma-maximin. We also show that, in some situations, a computationally cheap approximation of a choice function can be used, even if the approximation violates the conditions for backward induction; for instance, interval dominance with backward induction will yield at least all maximal normal form solutions.
△ Less
Submitted 23 March, 2012; v1 submitted 1 April, 2011;
originally announced April 2011.
-
On the connection between probability boxes and possibility measures
Authors:
Matthias C. M. Troffaes,
Enrique Miranda,
Sebastien Destercke
Abstract:
We explore the relationship between possibility measures (supremum preserving normed measures) and p-boxes (pairs of cumulative distribution functions) on totally preordered spaces, extending earlier work in this direction by De Cooman and Aeyels, among others. We start by demonstrating that only those p-boxes who have 0-1-valued lower or upper cumulative distribution function can be possibility m…
▽ More
We explore the relationship between possibility measures (supremum preserving normed measures) and p-boxes (pairs of cumulative distribution functions) on totally preordered spaces, extending earlier work in this direction by De Cooman and Aeyels, among others. We start by demonstrating that only those p-boxes who have 0-1-valued lower or upper cumulative distribution function can be possibility measures, and we derive expressions for their natural extension in this case. Next, we establish necessary and sufficient conditions for a p-box to be a possibility measure. Finally, we show that almost every possibility measure can be modelled by a p-box. Whence, any techniques for p-boxes can be readily applied to possibility measures. We demonstrate this by deriving joint possibility measures from marginals, under varying assumptions of independence, using a technique known for p-boxes. Doing so, we arrive at a new rule of combination for possibility measures, for the independent case.
△ Less
Submitted 29 March, 2011;
originally announced March 2011.
-
Probability boxes on totally preordered spaces for multivariate modelling
Authors:
Matthias C. M. Troffaes,
Sebastien Destercke
Abstract:
A pair of lower and upper cumulative distribution functions, also called probability box or p-box, is among the most popular models used in imprecise probability theory. They arise naturally in expert elicitation, for instance in cases where bounds are specified on the quantiles of a random variable, or when quantiles are specified only at a finite number of points. Many practical and formal resul…
▽ More
A pair of lower and upper cumulative distribution functions, also called probability box or p-box, is among the most popular models used in imprecise probability theory. They arise naturally in expert elicitation, for instance in cases where bounds are specified on the quantiles of a random variable, or when quantiles are specified only at a finite number of points. Many practical and formal results concerning p-boxes already exist in the literature. In this paper, we provide new efficient tools to construct multivariate p-boxes and develop algorithms to draw inferences from them. For this purpose, we formalise and extend the theory of p-boxes using Walley's behavioural theory of imprecise probabilities, and heavily rely on its notion of natural extension and existing results about independence modeling. In particular, we allow p-boxes to be defined on arbitrary totally preordered spaces, hence thereby also admitting multivariate p-boxes via probability bounds over any collection of nested sets. We focus on the cases of independence (using the factorization property), and of unknown dependence (using the Fréchet bounds), and we show that our approach extends the probabilistic arithmetic of Williamson and Downs. Two design problems---a damped oscillator, and a river dike---demonstrate the practical feasibility of our results.
△ Less
Submitted 29 March, 2011; v1 submitted 9 March, 2011;
originally announced March 2011.
-
n-Monotone exact functionals
Authors:
Gert de Cooman,
Matthias C. M. Troffaes,
Enrique Miranda
Abstract:
We study n-monotone functionals, which constitute a generalisation of n-monotone set functions. We investigate their relation to the concepts of exactness and natural extension, which generalise the notions of coherence and natural extension in the behavioural theory of imprecise probabilities. We improve upon a number of results in the literature, and prove among other things a representation r…
▽ More
We study n-monotone functionals, which constitute a generalisation of n-monotone set functions. We investigate their relation to the concepts of exactness and natural extension, which generalise the notions of coherence and natural extension in the behavioural theory of imprecise probabilities. We improve upon a number of results in the literature, and prove among other things a representation result for exact n-monotone functionals in terms of Choquet integrals.
△ Less
Submitted 13 January, 2008;
originally announced January 2008.
