Showing 1–32 of 32 results for author: Tartakovsky, A M

Randomized Physics-Informed Machine Learning for Uncertainty Quantification in High-Dimensional Inverse Problems

Authors: Yifei Zong, David Barajas-Solano, Alexandre M. Tartakovsky

Abstract: We propose a physics-informed machine learning method for uncertainty quantification in high-dimensional inverse problems. In this method, the states and parameters of partial differential equations (PDEs) are approximated with truncated conditional Karhunen-Loève expansions (CKLEs), which, by construction, match the measurements of the respective variables. The maximum a posteriori (MAP) solution… ▽ More We propose a physics-informed machine learning method for uncertainty quantification in high-dimensional inverse problems. In this method, the states and parameters of partial differential equations (PDEs) are approximated with truncated conditional Karhunen-Loève expansions (CKLEs), which, by construction, match the measurements of the respective variables. The maximum a posteriori (MAP) solution of the inverse problem is formulated as a minimization problem over CKLE coefficients where the loss function is the sum of the norm of PDE residuals and the $\ell_2$ regularization term. This MAP formulation is known as the physics-informed CKLE (PICKLE) method. Uncertainty in the inverse solution is quantified in terms of the posterior distribution of CKLE coefficients, and we sample the posterior by solving a randomized PICKLE minimization problem, formulated by adding zero-mean Gaussian perturbations in the PICKLE loss function. We call the proposed approach the randomized PICKLE (rPICKLE) method. For linear and low-dimensional nonlinear problems (15 CKLE parameters), we show analytically and through comparison with Hamiltonian Monte Carlo (HMC) that the rPICKLE posterior converges to the true posterior given by the Bayes rule. For high-dimensional non-linear problems with 2000 CKLE parameters, we numerically demonstrate that rPICKLE posteriors are highly informative--they provide mean estimates with an accuracy comparable to the estimates given by the MAP solution and the confidence interval that mostly covers the reference solution. We are not able to obtain the HMC posterior to validate rPICKLE's convergence to the true posterior due to the HMC's prohibitive computational cost for the considered high-dimensional problems. Our results demonstrate the advantages of rPICKLE over HMC for approximately sampling high-dimensional posterior distributions subject to physics constraints. △ Less

Submitted 23 December, 2023; v1 submitted 11 December, 2023; originally announced December 2023.

MSC Class: 60H15; 68T07; 60J10

Conditional Korhunen-Loéve regression model with Basis Adaptation for high-dimensional problems: uncertainty quantification and inverse modeling

Authors: Yu-Hong Yeung, Ramakrishna Tipireddy, David A. Barajas-Solano, Alexandre M. Tartakovsky

Abstract: We propose a methodology for improving the accuracy of surrogate models of the observable response of physical systems as a function of the systems' spatially heterogeneous parameter fields with applications to uncertainty quantification and parameter estimation in high-dimensional problems. Practitioners often formulate finite-dimensional representations of spatially heterogeneous parameter field… ▽ More We propose a methodology for improving the accuracy of surrogate models of the observable response of physical systems as a function of the systems' spatially heterogeneous parameter fields with applications to uncertainty quantification and parameter estimation in high-dimensional problems. Practitioners often formulate finite-dimensional representations of spatially heterogeneous parameter fields using truncated unconditional Karhunen-Loéve expansions (KLEs) for a certain choice of unconditional covariance kernel and construct surrogate models of the observable response with respect to the random variables in the KLE. When direct measurements of the parameter fields are available, we propose improving the accuracy of these surrogate models by representing the parameter fields via conditional Karhunen-Loéve expansions (CKLEs). CKLEs are constructed by conditioning the covariance kernel of the unconditional expansion on the direct measurements via Gaussian process regression and then truncating the corresponding KLE. We apply the proposed methodology to constructing surrogate models via the Basis Adaptation (BA) method of the stationary hydraulic head response, measured at spatially discrete observation locations, of a groundwater flow model of the Hanford Site, as a function of the 1,000-dimensional representation of the model's log-transmissivity field. We find that BA surrogate models of the hydraulic head based on CKLEs are more accurate than BA surrogate models based on unconditional expansions for forward uncertainty quantification tasks. Furthermore, we find that inverse estimates of the hydraulic transmissivity field computed using CKLE-based BA surrogate models are more accurate than those computed using unconditional BA surrogate models. △ Less

Submitted 5 July, 2023; originally announced July 2023.

Comments: 29 pages, 4 figures, 5 tables

Gaussian process regression and conditional Karhunen-Loéve models for data assimilation in inverse problems

Authors: Yu-Hong Yeung, David A. Barajas-Solano, Alexandre M. Tartakovsky

Abstract: We present a model inversion algorithm, CKLEMAP, for data assimilation and parameter estimation in partial differential equation models of physical systems with spatially heterogeneous parameter fields. These fields are approximated using low-dimensional conditional Karhunen-Loéve expansions, which are constructed using Gaussian process regression models of these fields trained on the parameters'… ▽ More We present a model inversion algorithm, CKLEMAP, for data assimilation and parameter estimation in partial differential equation models of physical systems with spatially heterogeneous parameter fields. These fields are approximated using low-dimensional conditional Karhunen-Loéve expansions, which are constructed using Gaussian process regression models of these fields trained on the parameters' measurements. We then assimilate measurements of the state of the system and compute the maximum a posteriori estimate of the CKLE coefficients by solving a nonlinear least-squares problem. When solving this optimization problem, we efficiently compute the Jacobian of the vector objective by exploiting the sparsity structure of the linear system of equations associated with the forward solution of the physics problem. The CKLEMAP method provides better scalability compared to the standard MAP method. In the MAP method, the number of unknowns to be estimated is equal to the number of elements in the numerical forward model. On the other hand, in CKLEMAP, the number of unknowns (CKLE coefficients) is controlled by the smoothness of the parameter field and the number of measurements, and is in general much smaller than the number of discretization nodes, which leads to a significant reduction of computational cost with respect to the standard MAP method. To show its advantage in scalability, we apply CKLEMAP to estimate the transmissivity field in a two-dimensional steady-state subsurface flow model of the Hanford Site by assimilating synthetic measurements of transmissivity and hydraulic head. We find that the execution time of CKLEMAP scales nearly linearly as $N^{1.33}$, where $N$ is the number of discretization nodes, while the execution time of standard MAP scales as $N^{2.91}$. The CKLEMAP method improved execution time without sacrificing accuracy when compared to the standard MAP. △ Less

Submitted 26 January, 2023; originally announced January 2023.

Comments: 27 pages, 7 figures

Physics-Informed Neural Network Method for Parabolic Differential Equations with Sharply Perturbed Initial Conditions

Authors: Yifei Zong, QiZhi He, Alexandre M. Tartakovsky

Abstract: In this paper, we develop a physics-informed neural network (PINN) model for parabolic problems with a sharply perturbed initial condition. As an example of a parabolic problem, we consider the advection-dispersion equation (ADE) with a point (Gaussian) source initial condition. In the $d$-dimensional ADE, perturbations in the initial condition decay with time $t$ as $t^{-d/2}$, which can cause a… ▽ More In this paper, we develop a physics-informed neural network (PINN) model for parabolic problems with a sharply perturbed initial condition. As an example of a parabolic problem, we consider the advection-dispersion equation (ADE) with a point (Gaussian) source initial condition. In the $d$-dimensional ADE, perturbations in the initial condition decay with time $t$ as $t^{-d/2}$, which can cause a large approximation error in the PINN solution. Localized large gradients in the ADE solution make the (common in PINN) Latin hypercube sampling of the equation's residual highly inefficient. Finally, the PINN solution of parabolic equations is sensitive to the choice of weights in the loss function. We propose a normalized form of ADE where the initial perturbation of the solution does not decrease in amplitude and demonstrate that this normalization significantly reduces the PINN approximation error. We propose criteria for weights in the loss function that produce a more accurate PINN solution than those obtained with the weights selected via other methods. Finally, we proposed an adaptive sampling scheme that significantly reduces the PINN solution error for the same number of the sampling (residual) points. We demonstrate the accuracy of the proposed PINN model for forward, inverse, and backward ADEs. △ Less

Submitted 18 August, 2022; originally announced August 2022.

MSC Class: 35K99

Physics-Informed Machine Learning Method for Large-Scale Data Assimilation Problems

Authors: Yu-Hong Yeung, David A. Barajas-Solano, Alexandre M. Tartakovsky

Abstract: We develop a physics-informed machine learning approach for large-scale data assimilation and parameter estimation and apply it for estimating transmissivity and hydraulic head in the two-dimensional steady-state subsurface flow model of the Hanford Site given synthetic measurements of said variables. In our approach, we extend the physics-informed conditional Karhunen-Loéve expansion (PICKLE) met… ▽ More We develop a physics-informed machine learning approach for large-scale data assimilation and parameter estimation and apply it for estimating transmissivity and hydraulic head in the two-dimensional steady-state subsurface flow model of the Hanford Site given synthetic measurements of said variables. In our approach, we extend the physics-informed conditional Karhunen-Loéve expansion (PICKLE) method for modeling subsurface flow with unknown flux (Neumann) and varying head (Dirichlet) boundary conditions. We demonstrate that the PICKLE method is comparable in accuracy with the standard maximum a posteriori (MAP) method, but is significantly faster than MAP for large-scale problems. Both methods use a mesh to discretize the computational domain. In MAP, the parameters and states are discretized on the mesh; therefore, the size of the MAP parameter estimation problem directly depends on the mesh size. In PICKLE, the mesh is used to evaluate the residuals of the governing equation, while the parameters and states are approximated by the truncated conditional Karhunen-Loéve expansions with the number of parameters controlled by the smoothness of the parameter and state fields, and not by the mesh size. For a considered example, we demonstrate that the computational cost of PICKLE increases near linearly (as $N_{FV}^{1.15}$) with the number of grid points $N_{FV}$, while that of MAP increases much faster as $N_{FV}^{3.28}$. We demonstrated that once trained for one set of Dirichlet boundary conditions (i.e., one river stage), the PICKLE method provides accurate estimates of the hydraulic head for any value of the Dirichlet boundary conditions (i.e., for any river stage). △ Less

Submitted 30 July, 2021; originally announced August 2021.

Comments: 28 pages, 9 figures submitted to Water Resources Research

Physics-informed CoKriging model of a redox flow battery

Authors: Amanda A. Howard, Alexandre M. Tartakovsky

Abstract: Redox flow batteries (RFBs) offer the capability to store large amounts of energy cheaply and efficiently, however, there is a need for fast and accurate models of the charge-discharge curve of a RFB to potentially improve the battery capacity and performance. We develop a multifidelity model for predicting the charge-discharge curve of a RFB. In the multifidelity model, we use the Physics-informe… ▽ More Redox flow batteries (RFBs) offer the capability to store large amounts of energy cheaply and efficiently, however, there is a need for fast and accurate models of the charge-discharge curve of a RFB to potentially improve the battery capacity and performance. We develop a multifidelity model for predicting the charge-discharge curve of a RFB. In the multifidelity model, we use the Physics-informed CoKriging (CoPhIK) machine learning method that is trained on experimental data and constrained by the so-called "zero-dimensional" physics-based model. Here we demonstrate that the model shows good agreement with experimental results and significant improvements over existing zero-dimensional models. We show that the proposed model is robust as it is not sensitive to the input parameters in the zero-dimensional model. We also show that only a small amount of high-fidelity experimental datasets are needed for accurate predictions for the range of considered input parameters, which include current density, flow rate, and initial concentrations. △ Less

Submitted 16 June, 2021; originally announced June 2021.

Time-dependent stochastic basis adaptation for uncertainty quantification

Authors: Ramakrishna Tipireddy, Panos Stinis, Alexandre M. Tartakovsky

Abstract: We extend stochastic basis adaptation and spatial domain decomposition methods to solve time varying stochastic partial differential equations (SPDEs) with a large number of input random parameters. Stochastic basis adaptation allows the determination of a low dimensional stochastic basis representation of a quantity of interest (QoI). Extending basis adaptation to time-dependent problems is chall… ▽ More We extend stochastic basis adaptation and spatial domain decomposition methods to solve time varying stochastic partial differential equations (SPDEs) with a large number of input random parameters. Stochastic basis adaptation allows the determination of a low dimensional stochastic basis representation of a quantity of interest (QoI). Extending basis adaptation to time-dependent problems is challenging because small errors introduced in the previous time steps of the low dimensional approximate solution accumulate over time and cause divergence from the true solution. To address this issue we have introduced an approach where the basis adaptation varies at every time step so that the low dimensional basis is adapted to the QoI at that time step. We have coupled the time-dependent basis adaptation with domain decomposition to further increase the accuracy in the representation of the QoI. To illustrate the construction, we present numerical results for one-dimensional time varying linear and nonlinear diffusion equations with random space-dependent diffusion coefficients. Stochastic dimension reduction techniques proposed in the literature have mainly focused on quantifying the uncertainty in time independent and scalar QoI. To the best of our knowledge, this is the first attempt to extend dimensional reduction techniques to time varying and spatially dependent quantities such as the solution of SPDEs. △ Less

Submitted 4 March, 2021; originally announced March 2021.

Physics-Informed Neural Network Method for Forward and Backward Advection-Dispersion Equations

Authors: QiZhi He, Alexandre M. Tartakovsky

Abstract: We propose a discretization-free approach based on the physics-informed neural network (PINN) method for solving coupled advection-dispersion and Darcy flow equations with space-dependent hydraulic conductivity. In this approach, the hydraulic conductivity, hydraulic head, and concentration fields are approximated with deep neural networks (DNNs). We assume that the conductivity field is given by… ▽ More We propose a discretization-free approach based on the physics-informed neural network (PINN) method for solving coupled advection-dispersion and Darcy flow equations with space-dependent hydraulic conductivity. In this approach, the hydraulic conductivity, hydraulic head, and concentration fields are approximated with deep neural networks (DNNs). We assume that the conductivity field is given by its values on a grid, and we use these values to train the conductivity DNN. The head and concentration DNNs are trained by minimizing the residuals of the flow equation and ADE and using the initial and boundary conditions as additional constraints. The PINN method is applied to one- and two-dimensional forward advection-dispersion equations (ADEs), where its performance for various Péclet numbers ($Pe$) is compared with the analytical and numerical solutions. We find that the PINN method is accurate with errors of less than 1% and outperforms some conventional discretization-based methods for $Pe$ larger than 100. Next, we demonstrate that the PINN method remains accurate for the backward ADEs, with the relative errors in most cases staying under 5% compared to the reference concentration field. Finally, we show that when available, the concentration measurements can be easily incorporated in the PINN method and significantly improve (by more than 50% in the considered cases) the accuracy of the PINN solution of the backward ADE. △ Less

Submitted 21 December, 2020; originally announced December 2020.

Comments: 31 pages, 15 figures

Physics-Informed Gaussian Process Regression for Probabilistic States Estimation and Forecasting in Power Grids

Authors: Tong Ma, David Alonso Barajas-Solano, Ramakrishna Tipireddy, Alexandre M. Tartakovsky

Abstract: Real-time state estimation and forecasting is critical for efficient operation of power grids. In this paper, a physics-informed Gaussian process regression (PhI-GPR) method is presented and used for probabilistic forecasting and estimating the phase angle, angular speed, and wind mechanical power of a three-generator power grid system using sparse measurements. In standard data-driven Gaussian pr… ▽ More Real-time state estimation and forecasting is critical for efficient operation of power grids. In this paper, a physics-informed Gaussian process regression (PhI-GPR) method is presented and used for probabilistic forecasting and estimating the phase angle, angular speed, and wind mechanical power of a three-generator power grid system using sparse measurements. In standard data-driven Gaussian process regression (GPR), parameterized models for the prior statistics are fit by maximizing the marginal likelihood of observed data, whereas in PhI-GPR, we compute the prior statistics by solving stochastic equations governing power grid dynamics. The short-term forecast of a power grid system dominated by wind generation is complicated by the stochastic nature of the wind and the resulting uncertain mechanical wind power. Here, we assume that the power-grid dynamic is governed by the swing equations, and we treat the unknown terms in the swing equations (specifically, the mechanical wind power) as random processes, which turns these equations into stochastic differential equations. We solve these equations for the mean and variance of the power grid system using the Monte Carlo simulations method. We demonstrate that the proposed PhI-GPR method can accurately forecast and estimate both observed and unobserved states, including the mean behavior and associated uncertainty. For observed states, we show that PhI-GPR provides a forecast comparable to the standard data-driven GPR, with both forecasts being significantly more accurate than the autoregressive integrated moving average (ARIMA) forecast. We also show that the ARIMA forecast is much more sensitive to observation frequency and measurement errors than the PhI-GPR forecast. △ Less

Submitted 9 October, 2020; originally announced October 2020.

MSC Class: 62G99

Stochastically forced ensemble dynamic mode decomposition for forecasting and analysis of near-periodic systems

Authors: Daniel Dylewsky, David Barajas-Solano, Tong Ma, Alexandre M. Tartakovsky, J. Nathan Kutz

Abstract: Time series forecasting remains a central challenge problem in almost all scientific disciplines. We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system using Dynamic Mode Decomposition (DMD) in time delay coordinates. Central to this approach is the insight that grid load, like many observables on complex real-world systems, has an "almost-pe… ▽ More Time series forecasting remains a central challenge problem in almost all scientific disciplines. We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system using Dynamic Mode Decomposition (DMD) in time delay coordinates. Central to this approach is the insight that grid load, like many observables on complex real-world systems, has an "almost-periodic" character, i.e., a continuous Fourier spectrum punctuated by dominant peaks, which capture regular (e.g., daily or weekly) recurrences in the dynamics. The forecasting method presented takes advantage of this property by (i) regressing to a deterministic linear model whose eigenspectrum maps onto those peaks, and (ii) simultaneously learning a stochastic Gaussian process regression (GPR) process to actuate this system. Our forecasting algorithm is compared against state-of-the-art forecasting techniques not using additional explanatory variables and is shown to produce superior performance. Moreover, its use of linear intrinsic dynamics offers a number of desirable properties in terms of interpretability and parsimony. Results are presented for a test case using load data from an electrical grid. Load forecasting is an essential challenge in power systems engineering, with major implications for real-time control, pricing, maintenance, and security decisions. △ Less

Submitted 9 July, 2021; v1 submitted 8 October, 2020; originally announced October 2020.

Learning Unknown Physics of non-Newtonian Fluids

Authors: Brandon Reyes, Amanda A. Howard, Paris Perdikaris, Alexandre M. Tartakovsky

Abstract: We extend the physics-informed neural network (PINN) method to learn viscosity models of two non-Newtonian systems (polymer melts and suspensions of particles) using only velocity measurements. The PINN-inferred viscosity models agree with the empirical models for shear rates with large absolute values but deviate for shear rates near zero where the analytical models have an unphysical singularity… ▽ More We extend the physics-informed neural network (PINN) method to learn viscosity models of two non-Newtonian systems (polymer melts and suspensions of particles) using only velocity measurements. The PINN-inferred viscosity models agree with the empirical models for shear rates with large absolute values but deviate for shear rates near zero where the analytical models have an unphysical singularity. Once a viscosity model is learned, we use the PINN method to solve the momentum conservation equation for non-Newtonian fluid flow using only the boundary conditions. △ Less

Submitted 26 August, 2020; originally announced September 2020.

Journal ref: Phys. Rev. Fluids 6, 073301 (2021)

Inverse Modeling of Viscoelasticity Materials using Physics Constrained Learning

Authors: Kailai Xu, Alexandre M. Tartakovsky, Jeff Burghardt, Eric Darve

Abstract: We propose a novel approach to model viscoelasticity materials using neural networks, which capture rate-dependent and nonlinear constitutive relations. However, inputs and outputs of the neural networks are not directly observable, and therefore common training techniques with input-output pairs for the neural networks are inapplicable. To that end, we develop a novel computational approach to bo… ▽ More We propose a novel approach to model viscoelasticity materials using neural networks, which capture rate-dependent and nonlinear constitutive relations. However, inputs and outputs of the neural networks are not directly observable, and therefore common training techniques with input-output pairs for the neural networks are inapplicable. To that end, we develop a novel computational approach to both calibrate parametric and learn neural-network-based constitutive relations of viscoelasticity materials from indirect displacement data in the context of multi-physics interactions. We show that limited displacement data hold sufficient information to quantify the viscoelasticity behavior. We formulate the inverse computation---modeling viscoelasticity properties from observed displacement data---as a PDE-constrained optimization problem and minimize the error functional using a gradient-based optimization method. The gradients are computed by a combination of automatic differentiation and physics constrained learning. The effectiveness of our method is demonstrated through numerous benchmark problems in geomechanics and porous media transport. △ Less

Submitted 9 May, 2020; originally announced May 2020.

Comments: 28 pages, 22 figures

Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transport

Authors: QiZhi He, David Brajas-Solano, Guzel Tartakovsky, Alexandre M. Tartakovsky

Abstract: Data assimilation for parameter and state estimation in subsurface transport problems remains a significant challenge due to the sparsity of measurements, the heterogeneity of porous media, and the high computational cost of forward numerical models. We present a physics-informed deep neural networks (DNNs) machine learning method for estimating space-dependent hydraulic conductivity, hydraulic he… ▽ More Data assimilation for parameter and state estimation in subsurface transport problems remains a significant challenge due to the sparsity of measurements, the heterogeneity of porous media, and the high computational cost of forward numerical models. We present a physics-informed deep neural networks (DNNs) machine learning method for estimating space-dependent hydraulic conductivity, hydraulic head, and concentration fields from sparse measurements. In this approach, we employ individual DNNs to approximate the unknown parameters (e.g., hydraulic conductivity) and states (e.g., hydraulic head and concentration) of a physical system, and jointly train these DNNs by minimizing the loss function that consists of the governing equations residuals in addition to the error with respect to measurement data. We apply this approach to assimilate conductivity, hydraulic head, and concentration measurements for joint inversion of the conductivity, hydraulic head, and concentration fields in a steady-state advection--dispersion problem. We study the accuracy of the physics-informed DNN approach with respect to data size, number of variables (conductivity and head versus conductivity, head, and concentration), DNNs size, and DNN initialization during training. We demonstrate that the physics-informed DNNs are significantly more accurate than standard data-driven DNNs when the training set consists of sparse data. We also show that the accuracy of parameter estimation increases as additional variables are inverted jointly. △ Less

Submitted 5 December, 2019; originally announced December 2019.

Physics-Informed Machine Learning with Conditional Karhunen-Loève Expansions

Authors: Alexandre M. Tartakovsky, David A. Barajas-Solano, Qizhi He

Abstract: We present a new physics-informed machine learning approach for the inversion of PDE models with heterogeneous parameters. In our approach, the space-dependent partially-observed parameters and states are approximated via Karhunen-Loève expansions (KLEs). Each of these KLEs is then conditioned on their corresponding measurements, resulting in low-dimensional models of the parameters and states tha… ▽ More We present a new physics-informed machine learning approach for the inversion of PDE models with heterogeneous parameters. In our approach, the space-dependent partially-observed parameters and states are approximated via Karhunen-Loève expansions (KLEs). Each of these KLEs is then conditioned on their corresponding measurements, resulting in low-dimensional models of the parameters and states that resolve observed data. Finally, the coefficients of the KLEs are estimated by minimizing the norm of the residual of the PDE model evaluated at a finite set of points in the computational domain, ensuring that the reconstructed parameters and states are consistent with both the observations and the PDE model to an arbitrary level of accuracy. In our approach, KLEs are constructed using the eigendecomposition of covariance models of spatial variability. For the model parameters, we employ a parameterized covariance model calibrated on parameter observations; for the model states, the covariance is estimated from a number of forward simulations of the PDE model corresponding to realizations of the parameters drawn from their KLE. We apply the proposed approach to identifying heterogeneous log-diffusion coefficients in diffusion equations from spatially sparse measurements of the log-diffusion coefficient and the solution of the diffusion equation. We find that the proposed approach compares favorably against state-of-the-art point estimates such as maximum a posteriori estimation and physics-informed neural networks. △ Less

Submitted 4 December, 2019; originally announced December 2019.

Electric Load and Power Forecasting Using Ensemble Gaussian Process Regression

Authors: Tong Ma, Renke Huang, David Barajas-Solano, Ramakrishna Tipireddy, Alexandre M. Tartakovsky

Abstract: We propose a new forecasting method for predicting load demand and generation scheduling. Accurate week-long forecasting of load demand and optimal power generation is critical for efficient operation of power grid systems. In this work, we use a synthetic data set describing a power grid with 700 buses and 134 generators over a 365-days period with data synthetically generated at an hourly rate.… ▽ More We propose a new forecasting method for predicting load demand and generation scheduling. Accurate week-long forecasting of load demand and optimal power generation is critical for efficient operation of power grid systems. In this work, we use a synthetic data set describing a power grid with 700 buses and 134 generators over a 365-days period with data synthetically generated at an hourly rate. The proposed approach for week-long forecasting is based on the Gaussian process regression (GPR) method, with prior covariance matrices of the quantities of interest (QoI) computed from ensembles formed by up to twenty preceding weeks of QoI observations. Then, we use these covariances within the GPR framework to forecast the QoIs for the following week. We demonstrate that the the proposed ensemble GPR (EGPR) method is capable of accurately forecasting weekly total load demand and power generation profiles. The EGPR method is shown to outperform traditional forecasting methods including the standard GPR and autoregressive integrated moving average (ARIMA) methods. △ Less

Submitted 9 October, 2019; originally announced October 2019.

MSC Class: 68T05; 65L05; 37M10; 62M45; 68Q32

Gaussian Process Regression and Conditional Polynomial Chaos for Parameter Estimation

Authors: **g Li, Alexandre M Tartakovsky

Abstract: We present a new approach for constructing a data-driven surrogate model and using it for Bayesian parameter estimation in partial differential equation (PDE) models. We first use parameter observations and Gaussian Process regression to condition the Karhunen-Loéve (KL) expansion of the unknown space-dependent parameters and then build the conditional generalized Polynomial Chaos (gPC) surrogate… ▽ More We present a new approach for constructing a data-driven surrogate model and using it for Bayesian parameter estimation in partial differential equation (PDE) models. We first use parameter observations and Gaussian Process regression to condition the Karhunen-Loéve (KL) expansion of the unknown space-dependent parameters and then build the conditional generalized Polynomial Chaos (gPC) surrogate model of the PDE states. Next, we estimate the unknown parameters by computing coefficients in the KL expansion minimizing the square difference between the gPC predictions and measurements of the states using the Markov Chain Monte Carlo method. Our approach addresses two major challenges in the Bayesian parameter estimation. First, it reduces dimensionality of the parameter space and replaces expensive direct solutions of PDEs with the conditional gPC surrogates. Second, the estimated parameter field exactly matches the parameter measurements. In addition, we show that the conditional gPC surrogate can be used to estimate the states variance, which, in turn, can be used to guide data acquisition. We demonstrate that our approach improves its accuracy with application to one- and two-dimensional Darcy equation with (unknown) space-dependent hydraulic conductivity. We also discuss the effect of hydraulic conductivity and head locations on the accuracy of the hydraulic conductivity estimations. △ Less

Submitted 31 July, 2019; originally announced August 2019.

Report number: PNNL-SA-143585

A New Approach For Learning Coarse-Grained Potentials with Application to Immiscible Fluids

Authors: Peiyuan Gao, Xiu Yang, Alexandre M. Tartakovsky

Abstract: Even though atomistic and coarse-grained (CG) models have been used to simulate liquid nanodroplets in vapor, very few rigorous studies of the liquid-liquid interface structure are available, and most of them are limited to planar interfaces. In this work, we evaluate several existing force fields (FF)s, including two atomistic and three CG FFs, with respect to modeling the interface structure and… ▽ More Even though atomistic and coarse-grained (CG) models have been used to simulate liquid nanodroplets in vapor, very few rigorous studies of the liquid-liquid interface structure are available, and most of them are limited to planar interfaces. In this work, we evaluate several existing force fields (FF)s, including two atomistic and three CG FFs, with respect to modeling the interface structure and thermodynamic properties of the water-hexane interface. Both atomistic FFs are able to quantitatively reproduce the interfacial tension and the coexisting densities of the experimentally-observed planar interface. We use the atomistic FFs to model water droplets in hexane and use these simulations to test the CG FFs. We find that the tested CG FFs cannot reproduce the interfacial tensions of planar and/or curved interfaces. Finally, we propose a new approach for learning CG potentials within the CG SDK (Shinoda-DeVane-Klein) FF framework from atomistic simulation data. We demonstrate that the new potential significantly improves the prediction of both the interfacial tension and structure of water-hexane planar and curved interfaces. △ Less

Submitted 13 July, 2019; originally announced July 2019.

Non-local model for surface tension in fluid-fluid simulations

Authors: Amanda A. Howard, Alexandre M. Tartakovsky

Abstract: We propose a non-local model for surface tension obtained in the form of an integral of a molecular-force-like function with support $3.5\varepsilon$ added to the Navier-Stokes momentum conservation equation. We demonstrate analytically and numerically that with the non-local model interfaces with a radius of curvature larger than the support length behave macroscopically and microscopically, othe… ▽ More We propose a non-local model for surface tension obtained in the form of an integral of a molecular-force-like function with support $3.5\varepsilon$ added to the Navier-Stokes momentum conservation equation. We demonstrate analytically and numerically that with the non-local model interfaces with a radius of curvature larger than the support length behave macroscopically and microscopically, otherwise. For static droplets, the pressure difference $P_{\varepsilon, in} - P_{\varepsilon, out}$ satisfies the Young-Laplace law for droplet radius greater than $3.5\varepsilon$ and otherwise deviates from the Young-Laplace law. The latter indicates that the surface tension in the proposed model decreases with decreasing radius of curvature, which agrees with molecular dynamics and experimental studies of nanodroplets. Using the non-local model we perform numerical simulations of droplets under dynamic conditions, including a rising droplet, a droplet in shear flow, and two colliding droplets in shear flow, and compare results with a standard Navier-Stokes model subject to the Young-Laplace boundary condition at the fluid-fluid interface implemented via the Conservative Level Set (CLS) method. We find good agreement with existing numerical methods and analytical results for a rising macroscopic droplet and a droplet in a shear flow. For colliding droplets in shear flow, the non-local model converges (with respect to the grid size) to the correct behavior, including sliding, coalescence, and merging and breaking of two droplets depending on the capillary number. In contrast, we find that the results of the CLS model are highly grid-size dependent. △ Less

Submitted 30 June, 2020; v1 submitted 24 June, 2019; originally announced June 2019.

Analytical steady-state solutions for pressure with a multiscale non-local model for two-fluid systems

Authors: Amanda A. Howard, Yongcheng Zhou, Alexandre M. Tartakovsky

Abstract: We consider the nonlocal multiscale model for surface tension \citep{Tartakovsky2018} as an alternative to the (macroscale) Young-Laplace law. The nonlocal model is obtained in the form of an integral of a molecular-force-like function with support $\varepsilon$ added to the Navier-Stokes momentum conservation equation. Using this model, we calculate analytical forms for the steady-state equilibri… ▽ More We consider the nonlocal multiscale model for surface tension \citep{Tartakovsky2018} as an alternative to the (macroscale) Young-Laplace law. The nonlocal model is obtained in the form of an integral of a molecular-force-like function with support $\varepsilon$ added to the Navier-Stokes momentum conservation equation. Using this model, we calculate analytical forms for the steady-state equilibrium pressure gradient and pressure profile for circular and spherical bubbles and flat interfaces in two and three dimensions. According to the analytical solutions, the pressure changes continuously across the interface in a way that is quantitatively similar to what is observed in MD simulations. Furthermore, the pressure difference $P_{\varepsilon, in} - P_{\varepsilon, out}$ satisfies the Young-Laplace law for the radius of curvature greater than $3\varepsilon$ and deviates from the Young-Laplace law otherwise (i.e., $P_{\varepsilon, in} - P_{\varepsilon, out}$ goes to zero as the radius of the curvature goes to zero, where $P_{\varepsilon, out}$ is the pressure outside of the bubble at the distance greater than $3\varepsilon$ from the interface and $P_{\varepsilon, in}$ is the pressure at the center of the bubble). The latter indicates that the surface tension in the proposed model decreases with the decreasing radius of curvature, which agrees with molecular dynamics simulations and laboratory experiments with nanobubbles. Therefore, our results demonstrate that the nonlocal model behaves microscopically at scales smaller than $\varepsilon$ and macroscopically, otherwise. △ Less

Submitted 21 May, 2019; v1 submitted 16 May, 2019; originally announced May 2019.

Conditional Karhunen-Loève expansion for uncertainty quantification and active learning in partial differential equation models

Authors: Ramakrishna Tipireddy, David A Barajas-Solano, Alexandre M. Tartakovsky

Abstract: We use a conditional Karhunen-Loève (KL) model to quantify and reduce uncertainty in a stochastic partial differential equation (SPDE) problem with partially-known space-dependent coefficient, $Y(x)$. We assume that a small number of $Y(x)$ measurements are available and model $Y(x)$ with a KL expansion. We achieve reduction in uncertainty by conditioning the KL expansion coefficients on measu… ▽ More We use a conditional Karhunen-Loève (KL) model to quantify and reduce uncertainty in a stochastic partial differential equation (SPDE) problem with partially-known space-dependent coefficient, $Y(x)$. We assume that a small number of $Y(x)$ measurements are available and model $Y(x)$ with a KL expansion. We achieve reduction in uncertainty by conditioning the KL expansion coefficients on measurements. We consider two approaches for conditioning the KL expansion: In Approach 1, we condition the KL model first and then truncate it. In Approach 2, we first truncate the KL expansion and then condition it. We employ the conditional KL expansion together with Monte Carlo and sparse grid collocation methods to compute the moments of the solution of the SPDE problem. Uncertainty of the problem is further reduced by adaptively selecting additional observation locations using two active learning methods. Method 1 minimizes the variance of the PDE coefficient, while Method 2 minimizes the variance of the solution of the PDE. We demonstrate that conditioning leads to dimension reduction of the KL representation of $Y(x)$. For a linear diffusion SPDE with uncertain log-normal coefficient, we show that Approach 1 provides a more accurate approximation of the conditional log-normal coefficient and solution of the SPDE than Approach 2 for the same number of random dimensions in a conditional KL expansion. Furthermore, Approach 2 provides a good estimate for the number of terms of the truncated KL expansion of the conditional field of Approach 1. Finally, we demonstrate that active learning based on Method 2 is more efficient for uncertainty reduction in the SPDE's states (i.e., it leads to a larger reduction of the variance) than active learning using Method 2. △ Less

Submitted 16 April, 2019; originally announced April 2019.

Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients

Authors: David A. Barajas-Solano, Alexandre M. Tartakovsky

Abstract: We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and cost-effective alternatives to Markov Chain Monte Carlo simulation. We assume a parameterized Gaussian prior on the unknown functions, and approximate the posterior de… ▽ More We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and cost-effective alternatives to Markov Chain Monte Carlo simulation. We assume a parameterized Gaussian prior on the unknown functions, and approximate the posterior density by a parameterized multivariate Gaussian density. The parameters of the prior and posterior are estimated from sparse observations of the PDE model's states and the unknown functions themselves by maximizing the evidence lower bound (ELBO), a lower bound on the log marginal likelihood of the observations. The first method, Laplace-EM, employs the expectation maximization algorithm to maximize the ELBO, with a Laplace approximation of the posterior on the E-step, and minimization of a Kullback-Leibler divergence on the M-step. The second method, DSVI-EB, employs the doubly stochastic variational inference (DSVI) algorithm, in which the ELBO is maximized via gradient-based stochastic optimization, with nosiy gradients computed via simple Monte Carlo sampling and Gaussian backpropagation. We apply these methods to identifying diffusion coefficients in linear and nonlinear diffusion equations, and we find that both methods provide accurate estimates of posterior densities and the hyperparameters of Gaussian priors. While the Laplace-EM method is more accurate, it requires computing Hessians of the physics model. The DSVI-EB method is found to be less accurate but only requires gradients of the physics model. △ Less

Submitted 18 February, 2019; originally announced February 2019.

Learning Parameters and Constitutive Relationships with Physics Informed Deep Neural Networks

Authors: Alexandre M. Tartakovsky, Carlos Ortiz Marrero, Paris Perdikaris, Guzel D. Tartakovsky, David Barajas-Solano

Abstract: We present a physics informed deep neural network (DNN) method for estimating parameters and unknown physics (constitutive relationships) in partial differential equation (PDE) models. We use PDEs in addition to measurements to train DNNs to approximate unknown parameters and constitutive relationships as well as states. The proposed approach increases the accuracy of DNN approximations of partial… ▽ More We present a physics informed deep neural network (DNN) method for estimating parameters and unknown physics (constitutive relationships) in partial differential equation (PDE) models. We use PDEs in addition to measurements to train DNNs to approximate unknown parameters and constitutive relationships as well as states. The proposed approach increases the accuracy of DNN approximations of partially known functions when a limited number of measurements is available and allows for training DNNs when no direct measurements of the functions of interest are available. We employ physics informed DNNs to estimate the unknown space-dependent diffusion coefficient in a linear diffusion equation and an unknown constitutive relationship in a non-linear diffusion equation. For the parameter estimation problem, we assume that partial measurements of the coefficient and states are available and demonstrate that under these conditions, the proposed method is more accurate than state-of-the-art methods. For the non-linear diffusion PDE model with a fully unknown constitutive relationship (i.e., no measurements of constitutive relationship are available), the physics informed DNN method can accurately estimate the non-linear constitutive relationship based on state measurements only. Finally, we demonstrate that the proposed method remains accurate in the presence of measurement noise. △ Less

Submitted 17 August, 2018; v1 submitted 9 August, 2018; originally announced August 2018.

Discrete-element model for the interaction between ocean waves and sea ice

Authors: Zhijie Xu, Alexandre M. Tartakovsky, Wenxiao Pan

Abstract: We present a discrete element method (DEM) model to simulate the mechanical behavior of sea ice in response to ocean waves. The interaction of ocean waves and sea ice can potentially lead to the fracture and fragmentation of sea ice depending on the wave amplitude and period. The fracture behavior of sea ice is explicitly modeled by a DEM method, where sea ice is modeled by densely packed spherica… ▽ More We present a discrete element method (DEM) model to simulate the mechanical behavior of sea ice in response to ocean waves. The interaction of ocean waves and sea ice can potentially lead to the fracture and fragmentation of sea ice depending on the wave amplitude and period. The fracture behavior of sea ice is explicitly modeled by a DEM method, where sea ice is modeled by densely packed spherical particles with finite size. These particles are bonded together at their contact points through mechanical bonds that can sustain both tensile and compressive forces and moments. Fracturing can be naturally represented by the sequential breaking of mechanical bonds. For a given amplitude and period of incident ocean wave, the model provides information for the spatial distribution and time evolution of stress and micro-fractures and the fragment size distribution. We demonstrate that the fraction of broken bonds, , increases with increasing wave amplitude. In contrast, the ice fragment size l decreases with increasing amplitude. This information is important for the understanding of breakup of individual ice floes and floe fragment size. △ Less

Submitted 2 August, 2018; originally announced August 2018.

Journal ref: Phys. Rev. E 85, 016703, 2012

Method of model reduction and multifidelity models for solute transport in random layered porous media

Authors: Zhijie Xu, Alexandre M. Tartakovsky

Abstract: This work presents a hierarchical model for solute transport in bounded layered porous media with random permeability. The model generalizes the Taylor-Aris dispersion theory to stochastic transport in random layered porous media with a known velocity covariance function. In the hierarchical model, we represent (random) concentration in terms of its cross-sectional average and a variation function… ▽ More This work presents a hierarchical model for solute transport in bounded layered porous media with random permeability. The model generalizes the Taylor-Aris dispersion theory to stochastic transport in random layered porous media with a known velocity covariance function. In the hierarchical model, we represent (random) concentration in terms of its cross-sectional average and a variation function. We derive a one-dimensional stochastic advection-dispersion-type equation for the average concentration and a stochastic Poisson equation for the variation function, as well as expressions for the effective velocity and dispersion coefficient. We observe that velocity fluctuations enhance dispersion in a non-monotonic fashion: the dispersion initially increases with correlation length λ, reaches a maximum, and decreases to zero at infinity. Maximum enhancement can be obtained at the correlation length about 0.25 the size of the porous media perpendicular to flow. △ Less

Submitted 25 June, 2018; originally announced June 2018.

Journal ref: Physical Review E, 2017, Vol 96, 033314

Continuum Model for Nanoscale Multiphase Flows

Authors: Alexandre M. Tartakovsky

Abstract: We propose a nonlocal model for surface tension. This model, in combination with the Landau-Lifshitz-Navier-Stokes equations, describes mesoscale features of the multiphase flow, including the static (pressure) tensor and curvature dependence of surface tension. The nonlocal model is obtained in the form of an integral of a molecular-force-like function added into the momentum conservation equatio… ▽ More We propose a nonlocal model for surface tension. This model, in combination with the Landau-Lifshitz-Navier-Stokes equations, describes mesoscale features of the multiphase flow, including the static (pressure) tensor and curvature dependence of surface tension. The nonlocal model is obtained in the form of an integral of a molecular-force-like function added into the momentum conservation equation. We present an analytical steady-state solution for fluid pressure at the fluid-fluid interface and numerical Smoothed Particle Hydrodynamics solutions that reveal the mesoscopic features of the proposed model. △ Less

Submitted 21 May, 2018; originally announced May 2018.

Multivariate Gaussian Process Regression for Multiscale Data Assimilation and Uncertainty Reduction

Authors: David A. Barajas-Solano, Alexandre M. Tartakovsky

Abstract: We present a multivariate Gaussian process regression approach for parameter field reconstruction based on the field's measurements collected at two different scales, the coarse and fine scales. The proposed approach treats the parameter field defined at fine and coarse scales as a bivariate Gaussian process with a parameterized multiscale covariance model. We employ a full bivariate Matérn kernel… ▽ More We present a multivariate Gaussian process regression approach for parameter field reconstruction based on the field's measurements collected at two different scales, the coarse and fine scales. The proposed approach treats the parameter field defined at fine and coarse scales as a bivariate Gaussian process with a parameterized multiscale covariance model. We employ a full bivariate Matérn kernel as multiscale covariance model, with shape and smoothness hyperparameters that account for the coarsening relation between fine and coarse fields. In contrast to similar multiscale kriging approaches that assume a known coarsening relation between scales, the hyperparameters of the multiscale covariance model are estimated directly from data via pseudo-likelihood maximization. We illustrate the proposed approach with a predictive simulation application for saturated flow in porous media. Multiscale Gaussian process regression is employed to estimate two-dimensional log-saturated hydraulic conductivity distributions from synthetic multiscale measurements. The resulting stochastic model for coarse saturated conductivity is employed to quantify and reduce uncertainty in pressure predictions. △ Less

Submitted 17 April, 2018; originally announced April 2018.

Enforcing constraints for interpolation and extrapolation in Generative Adversarial Networks

Authors: Panos Stinis, Tobias Hagge, Alexandre M. Tartakovsky, Enoch Yeung

Abstract: We suggest ways to enforce given constraints in the output of a Generative Adversarial Network (GAN) generator both for interpolation and extrapolation (prediction). For the case of dynamical systems, given a time series, we wish to train GAN generators that can be used to predict trajectories starting from a given initial condition. In this setting, the constraints can be in algebraic and/or diff… ▽ More We suggest ways to enforce given constraints in the output of a Generative Adversarial Network (GAN) generator both for interpolation and extrapolation (prediction). For the case of dynamical systems, given a time series, we wish to train GAN generators that can be used to predict trajectories starting from a given initial condition. In this setting, the constraints can be in algebraic and/or differential form. Even though we are predominantly interested in the case of extrapolation, we will see that the tasks of interpolation and extrapolation are related. However, they need to be treated differently. For the case of interpolation, the incorporation of constraints is built into the training of the GAN. The incorporation of the constraints respects the primary game-theoretic setup of a GAN so it can be combined with existing algorithms. However, it can exacerbate the problem of instability during training that is well-known for GANs. We suggest adding small noise to the constraints as a simple remedy that has performed well in our numerical experiments. The case of extrapolation (prediction) is more involved. During training, the GAN generator learns to interpolate a noisy version of the data and we enforce the constraints. This approach has connections with model reduction that we can utilize to improve the efficiency and accuracy of the training. Depending on the form of the constraints, we may enforce them also during prediction through a projection step. We provide examples of linear and nonlinear systems of differential equations to illustrate the various constructions. △ Less

Submitted 19 June, 2019; v1 submitted 21 March, 2018; originally announced March 2018.

Comments: 29 pages; v2 has major text revision/restructuring, includes results for the Lorenz system and has several more references

Report number: PNNL-SA-133233 MSC Class: 68T05; 65L05; 37M10; 62M45; 68Q32

Persistent incomplete mixing in reactive flows

Authors: Alexandre M. Tartakovsky, David Barajas-Solano

Abstract: We present an effective stochastic advection-diffusion-reaction (SADR) model that explains incomplete mixing typically observed in transport with bimolecular reactions. Unlike traditional advection-dispersion-reaction models, the SADR model describes mechanical and diffusive mixing as two separate processes. In the SADR model, mechanical mixing is driven by random advective velocity with the varia… ▽ More We present an effective stochastic advection-diffusion-reaction (SADR) model that explains incomplete mixing typically observed in transport with bimolecular reactions. Unlike traditional advection-dispersion-reaction models, the SADR model describes mechanical and diffusive mixing as two separate processes. In the SADR model, mechanical mixing is driven by random advective velocity with the variance given by the coefficient of mechanical dispersion. The diffusive mixing is modeled as a Fickian diffusion with the effective diffusion coefficient. We demonstrate that the sum of the two coefficients is equal to the dispersion coefficients, but only the effective diffusion coefficient contributes to the mixing-controlled reactions, indicating that such systems do not get fully mixed at the Representative Elementary Volume scale where the deterministic equations and dispersion coefficient are defined. We use the experimental results of Gramling et al. \cite{Gramling} to show that for transport and bimolecular reactions in porous media, the SADR model is significantly more accurate than the traditional dispersion model, which overestimates the concentration of the reaction product by as much as 60\%. △ Less

Submitted 18 March, 2018; originally announced March 2018.

Solving differential equations with unknown constitutive relations as recurrent neural networks

Authors: Tobias Hagge, Panos Stinis, Enoch Yeung, Alexandre M. Tartakovsky

Abstract: We solve a system of ordinary differential equations with an unknown functional form of a sink (reaction rate) term. We assume that the measurements (time series) of state variables are partially available, and we use recurrent neural network to "learn" the reaction rate from this data. This is achieved by including a discretized ordinary differential equations as part of a recurrent neural networ… ▽ More We solve a system of ordinary differential equations with an unknown functional form of a sink (reaction rate) term. We assume that the measurements (time series) of state variables are partially available, and we use recurrent neural network to "learn" the reaction rate from this data. This is achieved by including a discretized ordinary differential equations as part of a recurrent neural network training problem. We extend TensorFlow's recurrent neural network architecture to create a simple but scalable and effective solver for the unknown functions, and apply it to a fedbatch bioreactor simulation problem. Use of techniques from recent deep learning literature enables training of functions with behavior manifesting over thousands of time steps. Our networks are structurally similar to recurrent neural networks, but differences in design and function require modifications to the conventional wisdom about training such networks. △ Less

Submitted 5 October, 2017; originally announced October 2017.

Comments: 19 pages, 8 figures

PDF estimation for power grid systems via sparse regression

Authors: Xiu Yang, David A. Barajas-Solano, W. Steven Rosenthal, Alexandre M. Tartakovsky

Abstract: We present a numerical approach for estimating the probability density function (PDF) of quantities of interest (QoIs) of power grid systems subject to uncertain power generation and load fluctuations. In our approach, generation and load fluctuations are modeled by means of autocorrelated-in-time random processes, which are approximated in terms of a finite set of random parameters by means of Ka… ▽ More We present a numerical approach for estimating the probability density function (PDF) of quantities of interest (QoIs) of power grid systems subject to uncertain power generation and load fluctuations. In our approach, generation and load fluctuations are modeled by means of autocorrelated-in-time random processes, which are approximated in terms of a finite set of random parameters by means of Karhunen-Loève approximations. The map from random parameters to QoIs is approximated by means of Hermite polynomial expansions. We propose a new approach based on compressive sensing to estimate the coefficients in the Hermite expansions from a small number of realizations (sampling points). Linear transforms identified by iterative rotations are introduced to improve the sparsity of the Hermite representations, exploiting the intrinsic low-dimensional structure of the map. As such, the proposed approach significantly reduces the required number of sampling points to achieve a given accuracy compared to the standard least squares method. The proposed approach is employed to estimate the PDF of relative angular velocities and bus voltages of systems of classical machines driven by autocorrelated random generation. More accurate PDF estimates, as measured by the Kullback-Leibler divergence, are achieved using fewer realizations than required by basic Monte Carlo sampling. △ Less

Submitted 21 August, 2017; originally announced August 2017.

Smoothed Dissipative Particle Dynamics model for mesoscopic multiphase flows in the presence of thermal fluctuations

Authors: Huan Lei, Nathan A. Baker, Lei Wu, Gregory K. Schenter, Christopher J. Mundy, Alexandre M. Tartakovsky

Abstract: Thermal fluctuations cause perturbations of fluid-fluid interfaces and highly nonlinear hydrodynamics in multiphase flows. In this work, we develop a novel multiphase smoothed dissipative particle dynamics model. This model accounts for both bulk hydrodynamics and interfacial fluctuations. Interfacial surface tension is modeled by imposing a pairwise force between SDPD particles. We show that the… ▽ More Thermal fluctuations cause perturbations of fluid-fluid interfaces and highly nonlinear hydrodynamics in multiphase flows. In this work, we develop a novel multiphase smoothed dissipative particle dynamics model. This model accounts for both bulk hydrodynamics and interfacial fluctuations. Interfacial surface tension is modeled by imposing a pairwise force between SDPD particles. We show that the relationship between the model parameters and surface tension, previously derived under the assumption of zero thermal fluctuation, is accurate for fluid systems at low temperature but overestimates the surface tension for intermediate and large thermal fluctuations. To analyze the effect of thermal fluctuations on surface tension, we construct a coarse-grained Euler lattice model based on the mean field theory and derive a semi-analytical formula to directly relate the surface tension to model parameters for a wide range of temperatures and model resolutions. We demonstrate that the present method correctly models the dynamic processes, such as bubble coalescence and capillary spectra across the interface. △ Less

Submitted 30 November, 2015; originally announced December 2015.

Journal ref: Phys. Rev. E 94, 023304 (2016)

The Effect of Nonlinearity in Hybrid KMC-Continuum models

Authors: Ariel Balter, Guang Lin, Alexandre M. Tartakovsky

Abstract: Recently there has been interest in develo** efficient ways to model heterogeneous surface reactions with hybrid computational models that couple a KMC model for a surface to a finite difference model for bulk diffusion in a continuous domain. We consider two representative problems that validate a hybrid method and also show that this method captures the combined effects of nonlinearity and sto… ▽ More Recently there has been interest in develo** efficient ways to model heterogeneous surface reactions with hybrid computational models that couple a KMC model for a surface to a finite difference model for bulk diffusion in a continuous domain. We consider two representative problems that validate a hybrid method and also show that this method captures the combined effects of nonlinearity and stochasticity. We first validate a simple deposition/dissolution model with a linear rate showing that the KMC-continuum hybrid agrees with both a fully deterministic model and its analytical solution. We then study a deposition/dissolution model including competitive adsorption, which leads to a nonlinear rate, and show that, in this case, the KMC-continuum hybrid and fully deterministic simulations do not agree. However, we are able to identify the difference as a natural result of the stochasticity coming from the KMC surface process. Because KMC captures inherent fluctuations, we consider it to be more realistic than a purely deterministic model. Therefore, we consider the KMC-continuum hybrid to be more representative of a real system. △ Less

Submitted 26 August, 2011; originally announced August 2011.