-
Learning thermodynamically constrained equations of state with uncertainty
Authors:
Himanshu Sharma,
Jim A. Gaffney,
Dimitrios Tsapetis,
Michael D. Shields
Abstract:
Numerical simulations of high energy-density experiments require equation of state (EOS) models that relate a material's thermodynamic state variables -- specifically pressure, volume/density, energy, and temperature. EOS models are typically constructed using a semi-empirical parametric methodology, which assumes a physics-informed functional form with many tunable parameters calibrated using exp…
▽ More
Numerical simulations of high energy-density experiments require equation of state (EOS) models that relate a material's thermodynamic state variables -- specifically pressure, volume/density, energy, and temperature. EOS models are typically constructed using a semi-empirical parametric methodology, which assumes a physics-informed functional form with many tunable parameters calibrated using experimental/simulation data. Since there are inherent uncertainties in the calibration data (parametric uncertainty) and the assumed functional EOS form (model uncertainty), it is essential to perform uncertainty quantification (UQ) to improve confidence in the EOS predictions. Model uncertainty is challenging for UQ studies since it requires exploring the space of all possible physically consistent functional forms. Thus, it is often neglected in favor of parametric uncertainty, which is easier to quantify without violating thermodynamic laws. This work presents a data-driven machine learning approach to constructing EOS models that naturally captures model uncertainty while satisfying the necessary thermodynamic consistency and stability constraints. We propose a novel framework based on physics-informed Gaussian process regression (GPR) that automatically captures total uncertainty in the EOS and can be jointly trained on both simulation and experimental data sources. A GPR model for the shock Hugoniot is derived and its uncertainties are quantified using the proposed framework. We apply the proposed model to learn the EOS for the diamond solid state of carbon, using both density functional theory data and experimental shock Hugoniot data to train the model and show that the prediction uncertainty reduces by considering the thermodynamic constraints.
△ Less
Submitted 23 February, 2024; v1 submitted 29 June, 2023;
originally announced June 2023.
-
Constraining Model Uncertainty in Plasma Equation-of-State Models with a Physics-Constrained Gaussian Process
Authors:
Jim A Gaffney,
Lin Yang,
Suzanne Ali
Abstract:
Equation-of-state (EOS) models underpin numerical simulations at the core of research in high energy density physics, inertial confinement fusion, laboratory astrophysics, and elsewhere. In these applications EOS models are needed that span ranges of thermodynamic variables that far exceed the ranges where data are available, making uncertainty quantification (UQ) of EOS models a significant conce…
▽ More
Equation-of-state (EOS) models underpin numerical simulations at the core of research in high energy density physics, inertial confinement fusion, laboratory astrophysics, and elsewhere. In these applications EOS models are needed that span ranges of thermodynamic variables that far exceed the ranges where data are available, making uncertainty quantification (UQ) of EOS models a significant concern. Model uncertainty, arising from the choice of functional form assumed for the EOS, is a major challenge to UQ studies for EOS that is usually neglected in favor of parameteric and data uncertainties which are easier to capture without violating the physical constraints on EOSs. In this work we introduce a new statistical EOS construction that naturally captures model uncertainty while automatically obeying the thermodynamic consistency constraint. We apply the model to existing data for $B_4C$\ to place an upper bound on the uncertainty in the EOS and Hugoniot, and show that the neglect of thermodynamic constraints overestimates the uncertainty by factors of several when data are available and underestimates when extrapolating to regions where they are not. We discuss extensions to this approach, and the role of GP-based models in accelerating simulation and experimental studies, defining portable uncertainty-aware EOS tables, and enabling uncertainty-aware downstream tasks.
△ Less
Submitted 26 October, 2022; v1 submitted 1 July, 2022;
originally announced July 2022.
-
Meaningful uncertainties from deep neural network surrogates of large-scale numerical simulations
Authors:
Gemma J. Anderson,
Jim A. Gaffney,
Brian K. Spears,
Peer-Timo Bremer,
Rushil Anirudh,
Jayaraman J. Thiagarajan
Abstract:
Large-scale numerical simulations are used across many scientific disciplines to facilitate experimental development and provide insights into underlying physical processes, but they come with a significant computational cost. Deep neural networks (DNNs) can serve as highly-accurate surrogate models, with the capacity to handle diverse datatypes, offering tremendous speed-ups for prediction and ma…
▽ More
Large-scale numerical simulations are used across many scientific disciplines to facilitate experimental development and provide insights into underlying physical processes, but they come with a significant computational cost. Deep neural networks (DNNs) can serve as highly-accurate surrogate models, with the capacity to handle diverse datatypes, offering tremendous speed-ups for prediction and many other downstream tasks. An important use-case for these surrogates is the comparison between simulations and experiments; prediction uncertainty estimates are crucial for making such comparisons meaningful, yet standard DNNs do not provide them. In this work we define the fundamental requirements for a DNN to be useful for scientific applications, and demonstrate a general variational inference approach to equip predictions of scalar and image data from a DNN surrogate model trained on inertial confinement fusion simulations with calibrated Bayesian uncertainties. Critically, these uncertainties are interpretable, meaningful and preserve physics-correlations in the predicted quantities.
△ Less
Submitted 26 October, 2020;
originally announced October 2020.
-
Designing Accurate Emulators for Scientific Processes using Calibration-Driven Deep Models
Authors:
Jayaraman J. Thiagarajan,
Bindya Venkatesh,
Rushil Anirudh,
Peer-Timo Bremer,
Jim Gaffney,
Gemma Anderson,
Brian Spears
Abstract:
Predictive models that accurately emulate complex scientific processes can achieve exponential speed-ups over numerical simulators or experiments, and at the same time provide surrogates for improving the subsequent analysis. Consequently, there is a recent surge in utilizing modern machine learning (ML) methods, such as deep neural networks, to build data-driven emulators. While the majority of e…
▽ More
Predictive models that accurately emulate complex scientific processes can achieve exponential speed-ups over numerical simulators or experiments, and at the same time provide surrogates for improving the subsequent analysis. Consequently, there is a recent surge in utilizing modern machine learning (ML) methods, such as deep neural networks, to build data-driven emulators. While the majority of existing efforts has focused on tailoring off-the-shelf ML solutions to better suit the scientific problem at hand, we study an often overlooked, yet important, problem of choosing loss functions to measure the discrepancy between observed data and the predictions from a model. Due to lack of better priors on the expected residual structure, in practice, simple choices such as the mean squared error and the mean absolute error are made. However, the inherent symmetric noise assumption made by these loss functions makes them inappropriate in cases where the data is heterogeneous or when the noise distribution is asymmetric. We propose Learn-by-Calibrating (LbC), a novel deep learning approach based on interval calibration for designing emulators in scientific applications, that are effective even with heterogeneous data and are robust to outliers. Using a large suite of use-cases, we show that LbC provides significant improvements in generalization error over widely-adopted loss function choices, achieves high-quality emulators even in small data regimes and more importantly, recovers the inherent noise structure without any explicit priors.
△ Less
Submitted 5 May, 2020;
originally announced May 2020.
-
Scalable Topological Data Analysis and Visualization for Evaluating Data-Driven Models in Scientific Applications
Authors:
Shusen Liu,
Di Wang,
Dan Maljovec,
Rushil Anirudh,
Jayaraman J. Thiagarajan,
Sam Ade Jacobs,
Brian C. Van Essen,
David Hysom,
Jae-Seung Yeom,
Jim Gaffney,
Luc Peterson,
Peter B. Robinson,
Harsh Bhatia,
Valerio Pascucci,
Brian K. Spears,
Peer-Timo Bremer
Abstract:
With the rapid adoption of machine learning techniques for large-scale applications in science and engineering comes the convergence of two grand challenges in visualization. First, the utilization of black box models (e.g., deep neural networks) calls for advanced techniques in exploring and interpreting model behaviors. Second, the rapid growth in computing has produced enormous datasets that re…
▽ More
With the rapid adoption of machine learning techniques for large-scale applications in science and engineering comes the convergence of two grand challenges in visualization. First, the utilization of black box models (e.g., deep neural networks) calls for advanced techniques in exploring and interpreting model behaviors. Second, the rapid growth in computing has produced enormous datasets that require techniques that can handle millions or more samples. Although some solutions to these interpretability challenges have been proposed, they typically do not scale beyond thousands of samples, nor do they provide the high-level intuition scientists are looking for. Here, we present the first scalable solution to explore and analyze high-dimensional functions often encountered in the scientific data analysis pipeline. By combining a new streaming neighborhood graph construction, the corresponding topology computation, and a novel data aggregation scheme, namely topology aware datacubes, we enable interactive exploration of both the topological and the geometric aspect of high-dimensional data. Following two use cases from high-energy-density (HED) physics and computational biology, we demonstrate how these capabilities have led to crucial new insights in both applications.
△ Less
Submitted 18 July, 2019;
originally announced July 2019.
-
Development of a Bayesian method for the analysis of inertial confinement fusion experiments on the NIF
Authors:
Jim A Gaffney,
Dan Clark,
Vijay Sonnad,
Stephen B Libby
Abstract:
The complex nature of inertial confinement fusion (ICF) experiments results in a very large number of experimental parameters that are only known with limited reliability. These parameters, combined with the myriad physical models that govern target evolution, make the reliable extraction of physics from experimental campaigns very difficult. We develop an inference method that allows all importan…
▽ More
The complex nature of inertial confinement fusion (ICF) experiments results in a very large number of experimental parameters that are only known with limited reliability. These parameters, combined with the myriad physical models that govern target evolution, make the reliable extraction of physics from experimental campaigns very difficult. We develop an inference method that allows all important experimental parameters, and previous knowledge, to be taken into account when investigating underlying microphysics models. The result is framed as a modified $χ^{2}$ analysis which is easy to implement in existing analyses, and quite portable. We present a first application to a recent convergent ablator experiment performed at the NIF, and investigate the effect of variations in all physical dimensions of the target (very difficult to do using other methods). We show that for well characterised targets in which dimensions vary at the 0.5% level there is little effect, but 3% variations change the results of inferences dramatically. Our Bayesian method allows particular inference results to be associated with prior errors in microphysics models; in our example, tuning the carbon opacity to match experimental data (i.e., ignoring prior knowledge) is equivalent to an assumed prior error of 400% in the tabop opacity tables. This large error is unreasonable, underlining the importance of including prior knowledge in the analysis of these experiments.
△ Less
Submitted 22 February, 2013;
originally announced February 2013.
-
Bayesian inference of inaccuracies in radiation transport physics from inertial confinement fusion experiments
Authors:
Jim A Gaffney,
Dan Clark,
Vijay Sonnad,
Stephen B Libby
Abstract:
First principles microphysics models are essential to the design and analysis of high energy density physics experiments. Using experimental data to investigate the underlying physics is also essential, particularly when simulations and experiments are not consistent with each other. This is a difficult task, due to the large number of physical models that play a role, and due to the complex (and…
▽ More
First principles microphysics models are essential to the design and analysis of high energy density physics experiments. Using experimental data to investigate the underlying physics is also essential, particularly when simulations and experiments are not consistent with each other. This is a difficult task, due to the large number of physical models that play a role, and due to the complex (and as a result, noisy) nature of the experiments. This results in a large number of parameters that make any inference a daunting task; it is also very important to consistently treat both experimental and prior understanding of the problem. In this paper we present a Bayesian method that includes both these effects, and allows the inference of a set of modifiers which have been constructed to give information about microphysics models from experimental data. We pay particular attention to radiation transport models. The inference takes into account a large set of experimental parameters and an estimate of the prior knowledge through a modified $χ^{2}$ function, which is minimised using an efficient genetic algorithm. Both factors play an essential role in our analysis. We find that although there is evidence of inaccuracies in off-line calculations of X ray drive intensity and Ge $L$ shell absorption, modifications to radiation transport are unable to reconcile differences between 1D HYDRA simulations and the experiment.
△ Less
Submitted 22 February, 2013;
originally announced February 2013.
-
Bayesian Analysis of Inertial Confinement Fusion Experiments at the National Ignition Facility
Authors:
J. A. Gaffney,
D. Clark,
V. Sonnad,
S. B. Libby
Abstract:
We develop a Bayesian inference method that allows the efficient determination of several interesting parameters from complicated high-energy-density experiments performed on the National Ignition Facility (NIF). The model is based on an exploration of phase space using the hydrodynamic code HYDRA. A linear model is used to describe the effect of nuisance parameters on the analysis, allowing an an…
▽ More
We develop a Bayesian inference method that allows the efficient determination of several interesting parameters from complicated high-energy-density experiments performed on the National Ignition Facility (NIF). The model is based on an exploration of phase space using the hydrodynamic code HYDRA. A linear model is used to describe the effect of nuisance parameters on the analysis, allowing an analytic likelihood to be derived that can be determined from a small number of HYDRA runs and then used in existing advanced statistical analysis methods. This approach is applied to a recent experiment in order to determine the carbon opacity and X-ray drive; it is found that the inclusion of prior expert knowledge and fluctuations in capsule dimensions and chemical composition significantly improve the agreement between experiment and theoretical opacity calculations. A parameterisation of HYDRA results is used to test the application of both Markov chain Monte Carlo (MCMC) and genetic algorithm (GA) techniques to explore the posterior. These approaches have distinct advantages and we show that both can allow the efficient analysis of high energy density experiments.
△ Less
Submitted 2 July, 2012;
originally announced July 2012.
