Eliciting Informative Priors by Modelling Expert Decision Making
Authors:
Julia R. Falconer,
Eibe Frank,
Devon L. L. Polaschek,
Chaitanya Joshi
Abstract:
This article introduces a new method for eliciting prior distributions from experts. The method models an expert decision-making process to infer a prior probability distribution for a rare event $A$. More specifically, assuming there exists a decision-making process closely related to $A$ which forms a decision $Y$, where a history of decisions have been collected. By modelling the data observed…
▽ More
This article introduces a new method for eliciting prior distributions from experts. The method models an expert decision-making process to infer a prior probability distribution for a rare event $A$. More specifically, assuming there exists a decision-making process closely related to $A$ which forms a decision $Y$, where a history of decisions have been collected. By modelling the data observed to make the historic decisions, using a Bayesian model, an analyst can infer a distribution for the parameters of the random variable $Y$. This distribution can be used to approximate the prior distribution for the parameters of the random variable for event $A$. This method is novel in the field of prior elicitation and has the potential of improving upon current methods by using real-life decision-making processes, that can carry real-life consequences, and, because it does not require an expert to have statistical knowledge. Future decision making can be improved upon using this method, as it highlights variables that are impacting the decision making process. An application for eliciting a prior distribution of recidivism, for an individual, is used to explain this method further.
△ Less
Submitted 13 July, 2023;
originally announced July 2023.
Methods for Eliciting Informative Prior Distributions: A Critical Review
Authors:
Julia R. Falconer,
Eibe Frank,
Devon L. L. Polaschek,
Chaitanya Joshi
Abstract:
Eliciting informative prior distributions for Bayesian inference can often be complex and challenging. While popular methods rely on asking experts probability based questions to quantify uncertainty, these methods are not without their drawbacks and many alternative elicitation methods exist. This paper explores methods for eliciting informative priors categorized by type and briefly discusses th…
▽ More
Eliciting informative prior distributions for Bayesian inference can often be complex and challenging. While popular methods rely on asking experts probability based questions to quantify uncertainty, these methods are not without their drawbacks and many alternative elicitation methods exist. This paper explores methods for eliciting informative priors categorized by type and briefly discusses their strengths and limitations. Most of the review literature in this field focuses on a particular type of elicitation approach. The primary aim of this work, however, is to provide a more complete yet macro view of the state of the art by highlighting new (and old) approaches in one clear, easy to read article. Two representative applications are used throughout to explore the suitability, or lack thereof, of the existing methods; one of which, highlights a challenge that has not been addressed in the literature yet. We identify some of the gaps in the present work and discuss directions for future research.
△ Less
Submitted 9 March, 2022; v1 submitted 13 December, 2021;
originally announced December 2021.
