-
How is model-related uncertainty quantified and reported in different disciplines?
Authors:
Emily G. Simmonds,
Kwaku Peprah Adjei,
Christoffer Wold Andersen,
Janne Cathrin Hetle Aspheim,
Claudia Battistin,
Nicola Bulso,
Hannah Christensen,
Benjamin Cretois,
Ryan Cubero,
Ivan A. Davidovich,
Lisa Dickel,
Benjamin Dunn,
Etienne Dunn-Sigouin,
Karin Dyrstad,
Sigurd Einum,
Donata Giglio,
Haakon Gjerlow,
Amelie Godefroidt,
Ricardo Gonzalez-Gil,
Soledad Gonzalo Cogno,
Fabian Grosse,
Paul Halloran,
Mari F. Jensen,
John James Kennedy,
Peter Egge Langsaether
, et al. (18 additional authors not shown)
Abstract:
How do we know how much we know? Quantifying uncertainty associated with our modelling work is the only way we can answer how much we know about any phenomenon. With quantitative science now highly influential in the public sphere and the results from models translating into action, we must support our conclusions with sufficient rigour to produce useful, reproducible results. Incomplete considera…
▽ More
How do we know how much we know? Quantifying uncertainty associated with our modelling work is the only way we can answer how much we know about any phenomenon. With quantitative science now highly influential in the public sphere and the results from models translating into action, we must support our conclusions with sufficient rigour to produce useful, reproducible results. Incomplete consideration of model-based uncertainties can lead to false conclusions with real world impacts. Despite these potentially damaging consequences, uncertainty consideration is incomplete both within and across scientific fields. We take a unique interdisciplinary approach and conduct a systematic audit of model-related uncertainty quantification from seven scientific fields, spanning the biological, physical, and social sciences. Our results show no single field is achieving complete consideration of model uncertainties, but together we can fill the gaps. We propose opportunities to improve the quantification of uncertainty through use of a source framework for uncertainty consideration, model type specific guidelines, improved presentation, and shared best practice. We also identify shared outstanding challenges (uncertainty in input data, balancing trade-offs, error propagation, and defining how much uncertainty is required). Finally, we make nine concrete recommendations for current practice (following good practice guidelines and an uncertainty checklist, presenting uncertainty numerically, and propagating model-related uncertainty into conclusions), future research priorities (uncertainty in input data, quantifying uncertainty in complex models, and the importance of missing uncertainty in different contexts), and general research standards across the sciences (transparency about study limitations and dedicated uncertainty sections of manuscripts).
△ Less
Submitted 1 July, 2022; v1 submitted 24 June, 2022;
originally announced June 2022.
-
Bayesian interpolation for power laws in neural data analysis
Authors:
Iván A. Davidovich,
Yasser Roudi
Abstract:
Power laws arise in a variety of phenomena ranging from matter undergoing phase transition to the distribution of word frequencies in the English language. Usually, their presence is only apparent when data is abundant, and accurately determining their exponents often requires even larger amounts of data. As the scale of recordings in neuroscience becomes larger, an increasing number of studies at…
▽ More
Power laws arise in a variety of phenomena ranging from matter undergoing phase transition to the distribution of word frequencies in the English language. Usually, their presence is only apparent when data is abundant, and accurately determining their exponents often requires even larger amounts of data. As the scale of recordings in neuroscience becomes larger, an increasing number of studies attempt to characterise potential power-law relationships in neural data. In this paper, we aim to discuss the potential pitfalls that one faces in such efforts and to promote a Bayesian interpolation framework for this purpose. We apply this framework to synthetic data and to data from a recent study of large-scale recordings in mouse primary visual cortex (V1), where the exponent of a power-law scaling in the data played an important role: its value was argued to determine whether the population's stimulus-response relationship is smooth, and experimental data was provided to confirm that this is indeed so. Our analysis shows that with such data types and sizes as we consider here, the best-fit values found for the parameters of the power law and the uncertainty for these estimates are heavily dependent on the noise model assumed for the estimation, the range of the data chosen, and (with all other things being equal) the particular recordings. It is thus challenging to offer a reliable statement about the exponents of the power law. Our analysis, however, shows that this does not affect the conclusions regarding the smoothness of the population response to low-dimensional stimuli but casts doubt on those to natural images. We discuss the implications of this result for the neural code in the V1 and offer the approach discussed here as a framework that future studies, perhaps exploring larger ranges of data, can employ as their starting point to examine power-law scalings in neural data.
△ Less
Submitted 18 April, 2022;
originally announced April 2022.
-
A symmetry for $ε_K$
Authors:
Leandro Da Rold,
Iván A. Davidovich
Abstract:
We show a symmetry that, in the context of a composite Higgs with anarchic flavor, can suppress the dominant CP violating contributions to $K-\bar K$ mixing. Based on previous extensions of SU(3)$_c$, we consider the case in which the composite sector has a global SU(6) symmetry, spontaneously broken to a subgroup containing SU(3)$\times$SU(3). We show that the interactions with the Standard Model…
▽ More
We show a symmetry that, in the context of a composite Higgs with anarchic flavor, can suppress the dominant CP violating contributions to $K-\bar K$ mixing. Based on previous extensions of SU(3)$_c$, we consider the case in which the composite sector has a global SU(6) symmetry, spontaneously broken to a subgroup containing SU(3)$\times$SU(3). We show that the interactions with the Standard Model can spontaneously break the remaining symmetry to the diagonal subgroup, identified with the group of color interactions, and naturally suppress $ε_K$. We consider this scenario in the context of the Minimal Composite Higgs Model based on SO(5)/SO(4) for the electroweak sector. By working in the framework of 2-site models, we compute the scalar potential, determine the conditions for a successful breaking of the symmetries and calculate the spectrum of lightest states. We find that $ε_K$ can be suppressed and the top mass reproduced for a large region of the parameter space where the symmetries are dynamically broken. Besides other new resonances, the model predicts the presence of a new singlet scalar state, generally lighter than the Higgs, that could have evaded detection at colliders.
△ Less
Submitted 12 May, 2017; v1 submitted 27 April, 2017;
originally announced April 2017.
-
Beautiful mirrors for a pNGB Higgs
Authors:
Eduardo C. Andrés,
Leandro Da Rold,
Iván A. Davidovich
Abstract:
We consider one of the most significant deviations from the Standard Model: the forward-backward asymmetry of the b-quark measured at leptonic colliders. We investigate the possibility to solve this discrepancy by introducing new physics at the TeV scale. We focus on models where the Higgs is a pseudo Nambu-Goldstone boson of a new strongly coupled sector with a global SO(5) symmetry broken sponta…
▽ More
We consider one of the most significant deviations from the Standard Model: the forward-backward asymmetry of the b-quark measured at leptonic colliders. We investigate the possibility to solve this discrepancy by introducing new physics at the TeV scale. We focus on models where the Higgs is a pseudo Nambu-Goldstone boson of a new strongly coupled sector with a global SO(5) symmetry broken spontaneously to SO(4). Besides the usual top partners, we introduce bottom partners in the representations 16 and 4 of SO(5) and show that they can improve significantly the fit by correcting the Zbb couplings. We also estimate the corrections to the couplings at one-loop and obtain that the tree-level ones dominate and can give a reliable estimation. We find that the large shift required for Zb_Rb_R leads to light custodians associated to the b-quark, similar to the top partners, as well as a rich phenomenology involving neutral interactions in the bottom-sector.
△ Less
Submitted 15 September, 2015;
originally announced September 2015.
