-
Representing Model Discrepancy in Bound-to-Bound Data Collaboration
Authors:
Wenyu Li,
Arun Hegde,
James Oreluk,
Andrew Packard,
Michael Frenklach
Abstract:
We extended the existing methodology in Bound-to-Bound Data Collaboration (B2BDC), an optimization-based deterministic uncertainty quantification (UQ) framework, to explicitly take into account model discrepancy. The discrepancy was represented as a linear combination of finite basis functions and the feasible set was constructed according to a collection of modified model-data constraints. Formul…
▽ More
We extended the existing methodology in Bound-to-Bound Data Collaboration (B2BDC), an optimization-based deterministic uncertainty quantification (UQ) framework, to explicitly take into account model discrepancy. The discrepancy was represented as a linear combination of finite basis functions and the feasible set was constructed according to a collection of modified model-data constraints. Formulas for making predictions were also modified to include the model discrepancy function. Prior information about the model discrepancy can be added to the framework as additional constraints. Dataset consistency, a central feature of B2BDC, was generalized based on the extended framework.
△ Less
Submitted 4 February, 2020; v1 submitted 1 July, 2019;
originally announced July 2019.
-
Diagnostics of Data-Driven Models: Uncertainty Quantification of PM7 Semi-Empirical Quantum Chemical Method
Authors:
James Oreluk,
Zhenyuan Liu,
Arun Hegde,
Wenyu Li,
Andrew Packard,
Michael Frenklach,
Dmitry Zubarev
Abstract:
We report an evaluation of a semi-empirical quantum chemical method PM7 from the perspective of uncertainty quantification. Specifically, we apply Bound-to-Bound Data Collaboration, an uncertainty quantification framework, to characterize a) variability of PM7 model parameter values consistent with the uncertainty in the training data, and b) uncertainty propagation from the training data to the m…
▽ More
We report an evaluation of a semi-empirical quantum chemical method PM7 from the perspective of uncertainty quantification. Specifically, we apply Bound-to-Bound Data Collaboration, an uncertainty quantification framework, to characterize a) variability of PM7 model parameter values consistent with the uncertainty in the training data, and b) uncertainty propagation from the training data to the model predictions. Experimental heats of formation of a homologous series of linear alkanes are used as the property of interest. The training data are chemically accurate, i.e., they have very low uncertainty by the standards of computational chemistry. The analysis does not find evidence of PM7 consistency with the entire data set considered as no single set of parameter values is found that captures the experimental uncertainties of all training data. Nevertheless, PM7 is found to be consistent for subsets of the training data. In such cases, uncertainty propagation from the chemically accurate training data to the predicted values preserves error within bounds of chemical accuracy if predictions are made for the molecules of comparable size. Otherwise, the error grows linearly with the relative size of the molecules.
△ Less
Submitted 16 June, 2018; v1 submitted 12 June, 2018;
originally announced June 2018.
-
Dynamic Chemical Model for H2/O2 Combustion Developed Through a Community Workflow
Authors:
James Oreluk,
Craig D. Needham,
Sathya Baskaran,
S. Mani Sarathy,
Michael P. Burke,
Richard H. West,
Michael Frenklach,
Phillip R. Westmoreland
Abstract:
Elementary-reaction models for H2/O2 combustion were evaluated and optimized through a collaborative workflow, establishing accuracy and characterizing uncertainties. Quantitative findings were the optimized model, the importance of $\text{H}_2 + \text{O}_2(1Δ) = \text{H} + \text{HO}_2$ in high-pressure flames, and the inconsistency of certain low-temperature shock-tube data. The workflow describe…
▽ More
Elementary-reaction models for H2/O2 combustion were evaluated and optimized through a collaborative workflow, establishing accuracy and characterizing uncertainties. Quantitative findings were the optimized model, the importance of $\text{H}_2 + \text{O}_2(1Δ) = \text{H} + \text{HO}_2$ in high-pressure flames, and the inconsistency of certain low-temperature shock-tube data. The workflow described here is proposed to be even more important because the approach and publicly available cyberinfrastructure allows future community development of evolving improvements. The workflow steps applied here were to develop an initial reaction set using Burke et al. [2012], Burke et al. [2013], Sellevag et al. [2009], and Konnov [2015]; test it for thermodynamic and kinetics consistency and plausibility against other sets in the literature; assign estimated uncertainties where not stated in the sources; select key data targets ("Quantities of Interest" or QOIs) from shock-tube and flame experimental data; perform conventional sensitivity analyses of QOIs with respect to Arrhenius pre-exponential factors; develop surrogate models for the model-predicted QOI values; evaluate model-vs.-data consistency using Bound-to-Bound Data Collaboration; and optimize model parameters within their estimated uncertainty bounds (feasible set). Necessary data and software for such analyses were developed and are publicly available through the PrIMe cyberinfrastructure. This community workflow proved to be a means to reveal inconsistencies, improvements, and uncertainty bounds. Even more significantly, it is a means of revealing which parameters and experimental findings are inconsistent with the larger body of work from the community and, thus, of designing new experiments and parameter calculations.
△ Less
Submitted 3 February, 2018; v1 submitted 30 January, 2018;
originally announced January 2018.
-
Consistency Analysis for Massively Inconsistent Datasets in Bound-to-Bound Data Collaboration
Authors:
Arun Hegde,
Wenyu Li,
James Oreluk,
Andrew Packard,
Michael Frenklach
Abstract:
Bound-to-Bound Data Collaboration (B2BDC) provides a natural framework for addressing both forward and inverse uncertainty quantification problems. In this approach, QOI (quantity of interest) models are constrained by related experimental observations with interval uncertainty. A collection of such models and observations is termed a dataset and carves out a feasible region in the parameter space…
▽ More
Bound-to-Bound Data Collaboration (B2BDC) provides a natural framework for addressing both forward and inverse uncertainty quantification problems. In this approach, QOI (quantity of interest) models are constrained by related experimental observations with interval uncertainty. A collection of such models and observations is termed a dataset and carves out a feasible region in the parameter space. If a dataset has a nonempty feasible set, it is said to be consistent. In real-world applications, it is often the case that collections of experiments and observations are inconsistent. Revealing the source of this inconsistency, i.e., identifying which models and/or observations are problematic, is essential before a dataset can be used for prediction. To address this issue, we introduce a constraint relaxation-based approach, entitled the vector consistency measure, for investigating datasets with numerous sources of inconsistency. The benefits of this vector consistency measure over a previous method of consistency analysis are demonstrated in two realistic gas combustion examples.
△ Less
Submitted 1 April, 2019; v1 submitted 13 January, 2017;
originally announced January 2017.
-
Scale-Bridging Model Development for Coal Particle Devolatilization
Authors:
Benjamin B Schroeder,
Sean T Smith,
Philip J Smith,
Thomas H Fletcher,
Andrew Packard,
Michael Frenklach,
Arun Hegde,
Wenyu Li,
James Oreluk
Abstract:
When performing large-scale, high-performance computations of multi-physics applications, it is common to limit the complexity of physics sub-models comprising the simulation. For a hierarchical system of coal boiler simulations a scale-bridging model is constructed to capture characteristics appropriate for the application-scale from a detailed coal devolatilization model. Such scale-bridging all…
▽ More
When performing large-scale, high-performance computations of multi-physics applications, it is common to limit the complexity of physics sub-models comprising the simulation. For a hierarchical system of coal boiler simulations a scale-bridging model is constructed to capture characteristics appropriate for the application-scale from a detailed coal devolatilization model. Such scale-bridging allows full descriptions of scale-applicable physics, while functioning at reasonable computational costs. This study presents a variation on multi-fidelity modeling with a detailed physics model, the chemical percolation devolatilization model, being used to calibrate a scale-briding model for the application of interest. The application space provides essential context for designing the scale-bridging model by defining scales, determining requirements and weighting desired characteristics. A single kinetic reaction equation with functional yield model and distributed activation energy is implemented to act as the scale-bridging model-form. Consistency constraints are used to locate regions of the scale-bridging model's parameter-space that are consistent with the uncertainty identified within the detailed model. Ultimately, the performance of the scale-bridging model with consistent parameter-sets was assessed against desired characteristics of the detailed model and found to perform satisfactorily in capturing thermodynamic trends and kinetic timescales for the desired application-scale. Framing the process of model-form selection within the context of calibration and uncertainty quantification allows the credibility of the model to be established.
△ Less
Submitted 3 September, 2016;
originally announced September 2016.
