Design of experiments for the calibration of history-dependent models via deep reinforcement learning and an enhanced Kalman filter
Authors:
Ruben Villarreal,
Nikolaos N. Vlassis,
Nhon N. Phan,
Tommie A. Catanach,
Reese E. Jones,
Nathaniel A. Trask,
Sharlotte L. B. Kramer,
WaiChing Sun
Abstract:
Experimental data is costly to obtain, which makes it difficult to calibrate complex models. For many models an experimental design that produces the best calibration given a limited experimental budget is not obvious. This paper introduces a deep reinforcement learning (RL) algorithm for design of experiments that maximizes the information gain measured by Kullback-Leibler (KL) divergence obtaine…
▽ More
Experimental data is costly to obtain, which makes it difficult to calibrate complex models. For many models an experimental design that produces the best calibration given a limited experimental budget is not obvious. This paper introduces a deep reinforcement learning (RL) algorithm for design of experiments that maximizes the information gain measured by Kullback-Leibler (KL) divergence obtained via the Kalman filter (KF). This combination enables experimental design for rapid online experiments where traditional methods are too costly. We formulate possible configurations of experiments as a decision tree and a Markov decision process (MDP), where a finite choice of actions is available at each incremental step. Once an action is taken, a variety of measurements are used to update the state of the experiment. This new data leads to a Bayesian update of the parameters by the KF, which is used to enhance the state representation. In contrast to the Nash-Sutcliffe efficiency (NSE) index, which requires additional sampling to test hypotheses for forward predictions, the KF can lower the cost of experiments by directly estimating the values of new data acquired through additional actions. In this work our applications focus on mechanical testing of materials. Numerical experiments with complex, history-dependent models are used to verify the implementation and benchmark the performance of the RL-designed experiments.
△ Less
Submitted 26 September, 2022;
originally announced September 2022.
Perturbing the ground state of Dirac stars
Authors:
Emanuel Daka,
Nhon N. Phan,
Ben Kain
Abstract:
Dirac stars are self-gravitating configurations of spin-1/2 fermions in which the fermions are described by the Dirac equation. After a detailed review of the derivation of the equations and their static solutions, we present an in-depth dynamical stability analysis of the ground state similar to previous studies for boson stars. We confirm that there exist both stable and unstable branches of sta…
▽ More
Dirac stars are self-gravitating configurations of spin-1/2 fermions in which the fermions are described by the Dirac equation. After a detailed review of the derivation of the equations and their static solutions, we present an in-depth dynamical stability analysis of the ground state similar to previous studies for boson stars. We confirm that there exist both stable and unstable branches of static solutions and show that weakly perturbed Dirac stars from the unstable branch migrate to the stable branch. We also show that strongly perturbed Dirac stars from the stable branch migrate to the stable branch if their mass is below a critical value. If their mass is above the critical value they can migrate to the stable branch or collapse and form a black hole. For strongly perturbed Dirac stars from the unstable branch we show that the addition of even a small amount of mass leads to collapse, while if we decrease their mass they migrate to the stable branch.
△ Less
Submitted 21 October, 2019;
originally announced October 2019.
