-
On the Ubiquity of Information Inconsistency for Conjugate Priors
Authors:
Joris Mulder,
James O. Berger,
Víctor Peña,
M. J. Bayarri
Abstract:
Informally, "Information Inconsistency" is the property that has been observed in many Bayesian hypothesis testing and model selection procedures whereby the Bayesian conclusion does not become definitive when the data seems to become definitive. An example is that, when performing a t-test using standard conjugate priors, the Bayes factor of the alternative hypothesis to the null hypothesis remai…
▽ More
Informally, "Information Inconsistency" is the property that has been observed in many Bayesian hypothesis testing and model selection procedures whereby the Bayesian conclusion does not become definitive when the data seems to become definitive. An example is that, when performing a t-test using standard conjugate priors, the Bayes factor of the alternative hypothesis to the null hypothesis remains bounded as the t statistic grows to infinity. This paper shows that information inconsistency is ubiquitous in Bayesian hypothesis testing under conjugate priors. Yet the title does not fully describe the paper, since we also show that theoretically recommended priors, including scale mixtures of conjugate priors and adaptive priors, are information consistent. Hence the paper is simply a forceful warning that use of conjugate priors in testing and model selection is highly problematical, and should be replaced by the information consistent alternatives.
△ Less
Submitted 26 October, 2017;
originally announced October 2017.
-
Rejection Odds and Rejection Ratios: A Proposal for Statistical Practice in Testing Hypotheses
Authors:
M. J. Bayarri,
Daniel J. Benjamin,
James O. Berger,
Thomas M. Sellke
Abstract:
Much of science is (rightly or wrongly) driven by hypothesis testing. Even in situations where the hypothesis testing paradigm is correct, the common practice of basing inferences solely on p-values has been under intense criticism for over 50 years. We propose, as an alternative, the use of the odds of a correct rejection of the null hypothesis to incorrect rejection. Both pre-experimental versio…
▽ More
Much of science is (rightly or wrongly) driven by hypothesis testing. Even in situations where the hypothesis testing paradigm is correct, the common practice of basing inferences solely on p-values has been under intense criticism for over 50 years. We propose, as an alternative, the use of the odds of a correct rejection of the null hypothesis to incorrect rejection. Both pre-experimental versions (involving the power and Type I error) and post-experimental versions (depending on the actual data) are considered. Implementations are provided that range from depending only on the p-value to consideration of full Bayesian analysis. A surprise is that all implementations -- even the full Bayesian analysis -- have complete frequentist justification. Versions of our proposal can be implemented that require only minor modifications to existing practices yet overcome some of their most severe shortcomings.
△ Less
Submitted 28 December, 2015;
originally announced December 2015.
-
Criteria for Bayesian model choice with application to variable selection
Authors:
M. J. Bayarri,
J. O. Berger,
A. Forte,
G. García-Donato
Abstract:
In objective Bayesian model selection, no single criterion has emerged as dominant in defining objective prior distributions. Indeed, many criteria have been separately proposed and utilized to propose differing prior choices. We first formalize the most general and compelling of the various criteria that have been suggested, together with a new criterion. We then illustrate the potential of these…
▽ More
In objective Bayesian model selection, no single criterion has emerged as dominant in defining objective prior distributions. Indeed, many criteria have been separately proposed and utilized to propose differing prior choices. We first formalize the most general and compelling of the various criteria that have been suggested, together with a new criterion. We then illustrate the potential of these criteria in determining objective model selection priors by considering their application to the problem of variable selection in normal linear models. This results in a new model selection objective prior with a number of compelling properties.
△ Less
Submitted 24 September, 2012;
originally announced September 2012.
-
SiPMs coated with TPB : coating protocol and characterization for NEXT
Authors:
V. Álvarez,
J. Agramunt,
M. Ball,
M. Batallé,
J. Bayarri,
F. I. G. Borges,
H. Bolink,
H. Brine,
S. Cárcel,
J. M. Carmona,
J. Castel,
J. M. Catalá,
S. Cebrián,
A. Cervera,
D. Chan,
C. A. N. Conde,
T. Dafni,
T. H. V. T. Dias,
J. Díaz,
R. Esteve,
P. Evtoukhovitch,
J. Ferrando,
L. M. P. Fernandes,
P. Ferrario,
A. L. Ferreira
, et al. (69 additional authors not shown)
Abstract:
Silicon photomultipliers (SiPM) are the photon detectors chosen for the tracking readout in NEXT, a neutrinoless ββ decay experiment which uses a high pressure gaseous xenon time projection chamber (TPC). The reconstruction of event track and topology in this gaseous detector is a key handle for background rejection. Among the commercially available sensors that can be used for tracking, SiPMs off…
▽ More
Silicon photomultipliers (SiPM) are the photon detectors chosen for the tracking readout in NEXT, a neutrinoless ββ decay experiment which uses a high pressure gaseous xenon time projection chamber (TPC). The reconstruction of event track and topology in this gaseous detector is a key handle for background rejection. Among the commercially available sensors that can be used for tracking, SiPMs offer important advantages, mainly high gain, ruggedness, cost-effectiveness and radio-purity. Their main drawback, however, is their non sensitivity in the emission spectrum of the xenon scintillation (peak at 175 nm). This is overcome by coating these sensors with the organic wavelength shifter tetraphenyl butadienne (TPB). In this paper we describe the protocol developed for coating the SiPMs with TPB and the measurements performed for characterizing the coatings as well as the performance of the coated sensors in the UV-VUV range.
△ Less
Submitted 10 January, 2012;
originally announced January 2012.
-
The NEXT-100 experiment for neutrinoless double beta decay searches (Conceptual Design Report)
Authors:
NEXT Collaboration,
V. Álvarez,
M. Ball,
M. Batallé,
J. Bayarri,
F. I. G. Borges,
S. Cárcel,
J. M. Carmona,
J. Castel,
J. M. Catalá,
S. Cebrián,
A. Cervera-Villanueva,
D. Chan,
C. A. N. Conde,
T. Dafni,
T. H. V. T. Dias,
J. Díaz,
R. Esteve,
P. Evtoukhovitch,
L. M. P. Fernandes,
P. Ferrario,
E. Ferrer-Ribas,
A. L. Ferreira,
E. D. C. Freitas,
A. Gil
, et al. (58 additional authors not shown)
Abstract:
We propose an EASY (Electroluminescent ApparatuS of high Yield) and SOFT (Separated Optimized FuncTion) time-projection chamber for the NEXT experiment, that will search for neutrinoless double beta decay (bb0nu) in Xe-136. Our experiment must be competitive with the new generation of bb0nu searches already in operation or in construction. This requires a detector with very good energy resolution…
▽ More
We propose an EASY (Electroluminescent ApparatuS of high Yield) and SOFT (Separated Optimized FuncTion) time-projection chamber for the NEXT experiment, that will search for neutrinoless double beta decay (bb0nu) in Xe-136. Our experiment must be competitive with the new generation of bb0nu searches already in operation or in construction. This requires a detector with very good energy resolution (<1%), very low background con- tamination (1E-4 counts/(keV \bullet kg \bullet y)) and large target mass. In addition, it needs to be operational as soon as possible. The design described here optimizes energy resolution thanks to the use of proportional electroluminescent amplification (EL); it is compact, as the Xe gas is under high pressure; and it allows the measurement of the topological signature of the event to further reduce the background contamination. The SOFT design uses different sensors for tracking and calorimetry. We propose the use of SiPMs (MPPCs) coated with a suitable wavelength shifter for the tracking, and the use of radiopure photomultipliers for the measurement of the energy and the primary scintillation needed to estimate the t0. This design provides the best possible energy resolution compared with other NEXT designs based on avalanche gain devices. The baseline design is an Asymmetric Neutrino Gas EL apparatus (ANGEL), which was already outlined in the NEXT LOI. ANGEL is conceived to be easy to fabricate. It requires very little R&D and most of the proposed solutions have already been tested in the NEXT-1 prototypes. Therefore, the detector can be ready by 2013. In this Conceptual Design Report (CDR) we discuss first the physics case, present a full design of the detector, describe the NEXT-1 EL prototypes and their initial results, and outline a project to build a detector with 100 kg of enriched xenon to be installed in the Canfranc Underground Laboratory in 2013.
△ Less
Submitted 18 June, 2011;
originally announced June 2011.
-
Objective Bayes testing of Poisson versus inflated Poisson models
Authors:
M. J. Bayarri,
James O. Berger,
Gauri S. Datta
Abstract:
The Poisson distribution is often used as a standard model for count data. Quite often, however, such data sets are not well fit by a Poisson model because they have more zeros than are compatible with this model. For these situations, a zero-inflated Poisson (ZIP) distribution is often proposed. This article addresses testing a Poisson versus a ZIP model, using Bayesian methodology based on sui…
▽ More
The Poisson distribution is often used as a standard model for count data. Quite often, however, such data sets are not well fit by a Poisson model because they have more zeros than are compatible with this model. For these situations, a zero-inflated Poisson (ZIP) distribution is often proposed. This article addresses testing a Poisson versus a ZIP model, using Bayesian methodology based on suitable objective priors. Specific choices of objective priors are justified and their properties investigated. The methodology is extended to include covariates in regression models. Several applications are given.
△ Less
Submitted 21 May, 2008;
originally announced May 2008.
-
Rejoinder: Bayesian Checking of the Second Levels of Hierarchical Models
Authors:
M. J. Bayarri,
M. E. Castellanos
Abstract:
Rejoinder: Bayesian Checking of the Second Levels of Hierarchical Models [arXiv:0802.0743]
Rejoinder: Bayesian Checking of the Second Levels of Hierarchical Models [arXiv:0802.0743]
△ Less
Submitted 6 February, 2008;
originally announced February 2008.
-
Bayesian Checking of the Second Levels of Hierarchical Models
Authors:
M. J. Bayarri,
M. E. Castellanos
Abstract:
Hierarchical models are increasingly used in many applications. Along with this increased use comes a desire to investigate whether the model is compatible with the observed data. Bayesian methods are well suited to eliminate the many (nuisance) parameters in these complicated models; in this paper we investigate Bayesian methods for model checking. Since we contemplate model checking as a preli…
▽ More
Hierarchical models are increasingly used in many applications. Along with this increased use comes a desire to investigate whether the model is compatible with the observed data. Bayesian methods are well suited to eliminate the many (nuisance) parameters in these complicated models; in this paper we investigate Bayesian methods for model checking. Since we contemplate model checking as a preliminary, exploratory analysis, we concentrate on objective Bayesian methods in which careful specification of an informative prior distribution is avoided. Numerous examples are given and different proposals are investigated and critically compared.
△ Less
Submitted 6 February, 2008;
originally announced February 2008.
-
Generalization of Jeffreys' divergence based priors for Bayesian hypothesis testing
Authors:
M. J. Bayarri,
G. García-Donato
Abstract:
In this paper we introduce objective proper prior distributions for hypothesis testing and model selection based on measures of divergence between the competing models; we call them divergence based (DB) priors. DB priors have simple forms and desirable properties, like information (finite sample) consistency; often, they are similar to other existing proposals like the intrinsic priors; moreove…
▽ More
In this paper we introduce objective proper prior distributions for hypothesis testing and model selection based on measures of divergence between the competing models; we call them divergence based (DB) priors. DB priors have simple forms and desirable properties, like information (finite sample) consistency; often, they are similar to other existing proposals like the intrinsic priors; moreover, in normal linear models scenarios, they exactly reproduce Jeffreys-Zellner-Siow priors. Most importantly, in challenging scenarios such as irregular models and mixture models, the DB priors are well defined and very reasonable, while alternative proposals are not. We derive approximations to the DB priors as well as MCMC and asymptotic expressions for the associated Bayes factors.
△ Less
Submitted 28 January, 2008;
originally announced January 2008.
-
Computer model validation with functional output
Authors:
M. J. Bayarri,
J. O. Berger,
J. Cafeo,
G. Garcia-Donato,
F. Liu,
J. Palomo,
R. J. Parthasarathy,
R. Paulo,
J. Sacks,
D. Walsh
Abstract:
A key question in evaluation of computer models is Does the computer model adequately represent reality? A six-step process for computer model validation is set out in Bayarri et al. [Technometrics 49 (2007) 138--154] (and briefly summarized below), based on comparison of computer model runs with field data of the process being modeled. The methodology is particularly suited to treating the majo…
▽ More
A key question in evaluation of computer models is Does the computer model adequately represent reality? A six-step process for computer model validation is set out in Bayarri et al. [Technometrics 49 (2007) 138--154] (and briefly summarized below), based on comparison of computer model runs with field data of the process being modeled. The methodology is particularly suited to treating the major issues associated with the validation process: quantifying multiple sources of error and uncertainty in computer models; combining multiple sources of information; and being able to adapt to different, but related scenarios. Two complications that frequently arise in practice are the need to deal with highly irregular functional data and the need to acknowledge and incorporate uncertainty in the inputs. We develop methodology to deal with both complications. A key part of the approach utilizes a wavelet representation of the functional data, applies a hierarchical version of the scalar validation methodology to the wavelet coefficients, and transforms back, to ultimately compare computer model output with field output. The generality of the methodology is only limited by the capability of a combination of computational tools and the appropriateness of decompositions of the sort (wavelets) employed here. The methods and analyses we present are illustrated with a test bed dynamic stress analysis for a particular engineering system.
△ Less
Submitted 21 November, 2007;
originally announced November 2007.
