-
Automated Learning of Interpretable Models with Quantified Uncertainty
Authors:
G. F. Bomarito,
P. E. Leser,
N. C. M Strauss,
K. M. Garbrecht,
J. D. Hochhalter
Abstract:
Interpretability and uncertainty quantification in machine learning can provide justification for decisions, promote scientific discovery and lead to a better understanding of model behavior. Symbolic regression provides inherently interpretable machine learning, but relatively little work has focused on the use of symbolic regression on noisy data and the accompanying necessity to quantify uncert…
▽ More
Interpretability and uncertainty quantification in machine learning can provide justification for decisions, promote scientific discovery and lead to a better understanding of model behavior. Symbolic regression provides inherently interpretable machine learning, but relatively little work has focused on the use of symbolic regression on noisy data and the accompanying necessity to quantify uncertainty. A new Bayesian framework for genetic-programming-based symbolic regression (GPSR) is introduced that uses model evidence (i.e., marginal likelihood) to formulate replacement probability during the selection phase of evolution. Model parameter uncertainty is automatically quantified, enabling probabilistic predictions with each equation produced by the GPSR algorithm. Model evidence is also quantified in this process, and its use is shown to increase interpretability, improve robustness to noise, and reduce overfitting when compared to a conventional GPSR implementation on both numerical and physical experiments.
△ Less
Submitted 12 April, 2022;
originally announced May 2022.
-
Entropy-based adaptive design for contour finding and estimating reliability
Authors:
D. Austin Cole,
Robert B. Gramacy,
James E. Warner,
Geoffrey F. Bomarito,
Patrick E. Leser,
William P. Leser
Abstract:
In reliability analysis, methods used to estimate failure probability are often limited by the costs associated with model evaluations. Many of these methods, such as multifidelity importance sampling (MFIS), rely upon a computationally efficient, surrogate model like a Gaussian process (GP) to quickly generate predictions. The quality of the GP fit, particularly in the vicinity of the failure reg…
▽ More
In reliability analysis, methods used to estimate failure probability are often limited by the costs associated with model evaluations. Many of these methods, such as multifidelity importance sampling (MFIS), rely upon a computationally efficient, surrogate model like a Gaussian process (GP) to quickly generate predictions. The quality of the GP fit, particularly in the vicinity of the failure region(s), is instrumental in supplying accurately predicted failures for such strategies. We introduce an entropy-based GP adaptive design that, when paired with MFIS, provides more accurate failure probability estimates and with higher confidence. We show that our greedy data acquisition strategy better identifies multiple failure regions compared to existing contour-finding schemes. We then extend the method to batch selection, without sacrificing accuracy. Illustrative examples are provided on benchmark data as well as an application to an impact damage simulator for National Aeronautics and Space Administration (NASA) spacesuits.
△ Less
Submitted 24 October, 2021; v1 submitted 24 May, 2021;
originally announced May 2021.
-
On the Optimization of Approximate Control Variates with Parametrically Defined Estimators
Authors:
Geoffrey F. Bomarito,
Patrick E. Leser,
James E. Warner,
William P. Leser
Abstract:
Multi-model Monte Carlo methods, such as multi-level Monte Carlo (MLMC) and multifidelity Monte Carlo (MFMC), allow for efficient estimation of the expectation of a quantity of interest given a set of models of varying fidelities. Recently, it was shown that the MLMC and MFMC estimators are both instances of the approximate control variates (ACV) framework [Gorodetsky et al. 2020]. In that same wo…
▽ More
Multi-model Monte Carlo methods, such as multi-level Monte Carlo (MLMC) and multifidelity Monte Carlo (MFMC), allow for efficient estimation of the expectation of a quantity of interest given a set of models of varying fidelities. Recently, it was shown that the MLMC and MFMC estimators are both instances of the approximate control variates (ACV) framework [Gorodetsky et al. 2020]. In that same work, it was also shown that hand-tailored ACV estimators could outperform MLMC and MFMC for a variety of model scenarios. Because there is no reason to believe that these hand-tailored estimators are the best among a myriad of possible ACV estimators, a more general approach to estimator construction is pursued in this work. First, a general form of the ACV estimator variance is formulated. Then, the formulation is utilized to generate parametrically-defined estimators. These parametrically-defined estimators allow for an optimization to be pursued over a larger domain of possible ACV estimators. The parametrically-defined estimators are tested on a large set of model scenarios, and it is found that the broader search domain enabled by parametrically-defined estimators leads to greater variance reduction.
△ Less
Submitted 4 December, 2020;
originally announced December 2020.
-
Inverse Estimation of Elastic Modulus Using Physics-Informed Generative Adversarial Networks
Authors:
James E. Warner,
Julian Cuevas,
Geoffrey F. Bomarito,
Patrick E. Leser,
William P. Leser
Abstract:
While standard generative adversarial networks (GANs) rely solely on training data to learn unknown probability distributions, physics-informed GANs (PI-GANs) encode physical laws in the form of stochastic partial differential equations (PDEs) using auto differentiation. By relating observed data to unobserved quantities of interest through PDEs, PI-GANs allow for the estimation of underlying prob…
▽ More
While standard generative adversarial networks (GANs) rely solely on training data to learn unknown probability distributions, physics-informed GANs (PI-GANs) encode physical laws in the form of stochastic partial differential equations (PDEs) using auto differentiation. By relating observed data to unobserved quantities of interest through PDEs, PI-GANs allow for the estimation of underlying probability distributions without their direct measurement (i.e. inverse problems). The scalable nature of GANs allows high-dimensional, spatially-dependent probability distributions (i.e., random fields) to be inferred, while incorporating prior information through PDEs allows the training datasets to be relatively small.
In this work, PI-GANs are demonstrated for the application of elastic modulus estimation in mechanical testing. Given measured deformation data, the underlying probability distribution of spatially-varying elastic modulus (stiffness) is learned. Two feed-forward deep neural network generators are used to model the deformation and material stiffness across a two dimensional domain. Wasserstein GANs with gradient penalty are employed for enhanced stability. In the absence of explicit training data, it is demonstrated that the PI-GAN learns to generate realistic, physically-admissible realizations of material stiffness by incorporating the PDE that relates it to the measured deformation. It is shown that the statistics (mean, standard deviation, point-wise distributions, correlation length) of these generated stiffness samples have good agreement with the true distribution.
△ Less
Submitted 20 May, 2020;
originally announced June 2020.
-
Proceedings of the 2nd Workshop on Flavor Symmetries and Consequences in Accelerators and Cosmology (FLASY12)
Authors:
I. de Medeiros Varzielas,
C. Hambrock,
G. Hiller,
M. Jung,
P. Leser,
H. Päs,
S. Schacht,
M. Aoki,
J. Barry,
G. Bhattacharyya,
G. Blankenburg,
A. J. Buras,
L. Calibbi,
L. Covi,
D. Das,
F. F. Deppisch,
S. Descotes-Genon,
G. -J. Ding,
M. Duerr,
T. Feldmann,
M. Freytsis,
J. Girrbach,
F. González Canales,
F. Hartmann,
J. Heeck
, et al. (44 additional authors not shown)
Abstract:
These are the proceedings of the 2nd Workshop on Flavor Symmetries and Consequences in Accelerators and Cosmology, held 30 June 2012 - 4 July 2012, Dortmund, Germany.
These are the proceedings of the 2nd Workshop on Flavor Symmetries and Consequences in Accelerators and Cosmology, held 30 June 2012 - 4 July 2012, Dortmund, Germany.
△ Less
Submitted 25 October, 2012; v1 submitted 23 October, 2012;
originally announced October 2012.
-
A common origin of fermion mixing and geometrical CP violation, and its test through Higgs physics at the LHC
Authors:
Gautam Bhattacharyya,
Ivo de Medeiros Varzielas,
Philipp Leser
Abstract:
We construct for the first time a flavor model, based on the smallest discrete symmetry Delta(27) that implements spontaneous CP violation with a complex phase of geometric origin, which can actually reproduce all quark masses and mixing data. We show that its scalar sector has exotic properties that can be tested at the LHC.
We construct for the first time a flavor model, based on the smallest discrete symmetry Delta(27) that implements spontaneous CP violation with a complex phase of geometric origin, which can actually reproduce all quark masses and mixing data. We show that its scalar sector has exotic properties that can be tested at the LHC.
△ Less
Submitted 4 December, 2012; v1 submitted 1 October, 2012;
originally announced October 2012.
-
Novel signatures of the Higgs sector from S3 flavor symmetry
Authors:
Gautam Bhattacharyya,
Philipp Leser,
Heinrich Päs
Abstract:
In an earlier work we analyzed the CP-even scalar sector of an S3 flavor model, where we identified some novel decay signatures of an exotic scalar. In this work we extend our analysis by including the complete set of scalars/pseudoscalars, revisiting the potential minimization conditions in a more general setup, setting the spectrum in conformity with the current LHC limits on the scalar mass, an…
▽ More
In an earlier work we analyzed the CP-even scalar sector of an S3 flavor model, where we identified some novel decay signatures of an exotic scalar. In this work we extend our analysis by including the complete set of scalars/pseudoscalars, revisiting the potential minimization conditions in a more general setup, setting the spectrum in conformity with the current LHC limits on the scalar mass, and identifying yet another spectacularly novel decay channel which might be revealed from an intense study of rare top decays at the LHC into modes containing multileptons of different flavors.
△ Less
Submitted 27 August, 2012; v1 submitted 19 June, 2012;
originally announced June 2012.
-
Geometrical CP violation from non-renormalisable scalar potentials
Authors:
Ivo de Medeiros Varzielas,
David Emmanuel-Costa,
Philipp Leser
Abstract:
We consider in detail the non-renormalisable scalar potential of three Higgs doublets transforming as an irreducible triplet of Delta(27) or Delta(54). We start from a renormalisable potential that spontaneously leads to a vacuum with CP-violating phases independent of arbitrary parameters - geometrical CP violation. Then we analyse to arbitrarily high order non-renormalisable terms that are consi…
▽ More
We consider in detail the non-renormalisable scalar potential of three Higgs doublets transforming as an irreducible triplet of Delta(27) or Delta(54). We start from a renormalisable potential that spontaneously leads to a vacuum with CP-violating phases independent of arbitrary parameters - geometrical CP violation. Then we analyse to arbitrarily high order non-renormalisable terms that are consistent with the symmetry and we demonstrate that inclusion of non-renormalisable terms in the potential can preserve the geometrical CP-violating vacuum.
△ Less
Submitted 8 August, 2012; v1 submitted 16 April, 2012;
originally announced April 2012.
-
Proceedings of the first workshop on Flavor Symmetries and consequences in Accelerators and Cosmology (FLASY2011)
Authors:
M. Hirsch,
D. Meloni,
S. Morisi,
S. Pastor,
E. Peinado,
J. W. F. Valle,
Adisorn Adulpravitchai,
D. Aristizabal Sierra,
F. Bazzocchi,
Gautam Bhattacharyya,
G. Blankenburg,
M. S. Boucenna,
I. de Medeiros Varzielas,
Marco Aurelio Diaz,
Gui-Jun Ding,
J. N. Esteves,
Yasaman Farzan,
Sebastian Garcia Saenz,
W. Grimus,
Claudia Hagedorn,
J. Jones-Perez,
Anjan S. Joshipura,
Avihay Kadosh,
Kenji Kadota,
Sin Kyu Kang
, et al. (21 additional authors not shown)
Abstract:
The main goals of the first "Workshop on FLAvor SYmmetries and consequences in accelerators and cosmology" (FLASY) was to summarize the theoretical status of flavor symmetries, bringing together young researchers in the field to stimulate discussions and new collaborations, with the aim of investigating possible new physics scenarios to be tested at the LHC, as well as in future neutrino, cosmolog…
▽ More
The main goals of the first "Workshop on FLAvor SYmmetries and consequences in accelerators and cosmology" (FLASY) was to summarize the theoretical status of flavor symmetries, bringing together young researchers in the field to stimulate discussions and new collaborations, with the aim of investigating possible new physics scenarios to be tested at the LHC, as well as in future neutrino, cosmology experiments and dark matter searches.
△ Less
Submitted 26 January, 2012;
originally announced January 2012.
-
Knotted strings and leptonic flavor structure
Authors:
Thomas W. Kephart,
Philipp Leser,
Heinrich Päs
Abstract:
We propose a third idea for the explanation of the leptonic flavor structure in addition to the prominent approaches based on flavor symmetry and anarchy. Typical flavor patterns can be modeled by using mass spectra obtained from the discrete lengths spectrum of tight knots and links. We assume that a string theory model exists in which this idea can be incorporated via the Majorana mass structure…
▽ More
We propose a third idea for the explanation of the leptonic flavor structure in addition to the prominent approaches based on flavor symmetry and anarchy. Typical flavor patterns can be modeled by using mass spectra obtained from the discrete lengths spectrum of tight knots and links. We assume that a string theory model exists in which this idea can be incorporated via the Majorana mass structure of a type I seesaw model. It is shown by a scan over the parameter space that such a model is able to provide an excellent fit to current neutrino data and that it predicts a normal neutrino mass hierarchy as well as a small mixing angle θ_{13}. Startlingly, such scenarios could be related to the dimensionality of space time via an anthropic argument.
△ Less
Submitted 29 November, 2012; v1 submitted 30 June, 2011;
originally announced June 2011.
-
Neutrino mass hierarchy and the origin of leptonic flavor mixing from the right-handed sector
Authors:
Philipp Leser,
Heinrich Päs
Abstract:
We consider a neutrino mass model where all leptonic mixing is induced by a heavy Majorana sector through the seesaw type I mechanism, while the Dirac mass matrices are diagonal. Such a pattern occurs naturally in grand unified theories. Constraints on the parameters of the models are considered and it is shown that a normal neutrino mass hierarchy is preferred. The lightest neutrino mass is typic…
▽ More
We consider a neutrino mass model where all leptonic mixing is induced by a heavy Majorana sector through the seesaw type I mechanism, while the Dirac mass matrices are diagonal. Such a pattern occurs naturally in grand unified theories. Constraints on the parameters of the models are considered and it is shown that a normal neutrino mass hierarchy is preferred. The lightest neutrino mass is typically small, leading to nonobservable rates for neutrinoless double beta decay in the normal hierarchy case.
△ Less
Submitted 28 July, 2011; v1 submitted 13 April, 2011;
originally announced April 2011.
-
Exotic Higgs boson decay modes as a harbinger of $S_3$ flavor symmetry
Authors:
Gautam Bhattacharyya,
Philipp Leser,
Heinrich Päs
Abstract:
Discrete symmetries employed to explain flavor mixing and mass hierarchies can be associated with an enlarged scalar sector which might lead to exotic Higgs decay modes. In this paper, we explore such a possibility in a scenario with $S_3$ flavor symmetry which requires three scalar SU(2) doublets. The spectrum is fixed by minimizing the scalar potential, and we observe that the symmetry of the mo…
▽ More
Discrete symmetries employed to explain flavor mixing and mass hierarchies can be associated with an enlarged scalar sector which might lead to exotic Higgs decay modes. In this paper, we explore such a possibility in a scenario with $S_3$ flavor symmetry which requires three scalar SU(2) doublets. The spectrum is fixed by minimizing the scalar potential, and we observe that the symmetry of the model leads to tantalizing Higgs decay modes potentially observable at the CERN Large Hadron Collider (LHC).
△ Less
Submitted 3 January, 2011; v1 submitted 29 June, 2010;
originally announced June 2010.
