Showing 1–16 of 16 results for author: Schneier, M

Latent Neural PDE Solver: a reduced-order modelling framework for partial differential equations

Authors: Zijie Li, Saurabh Patil, Francis Ogoke, Dule Shu, Wilson Zhen, Michael Schneier, John R. Buchanan, Jr., Amir Barati Farimani

Abstract: Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional discretized fields, we propose to learn the dynamics of the system in the latent space with much coarser discretizations. In our proposed framework - Latent Neural P… ▽ More Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional discretized fields, we propose to learn the dynamics of the system in the latent space with much coarser discretizations. In our proposed framework - Latent Neural PDE Solver (LNS), a non-linear autoencoder is first trained to project the full-order representation of the system onto the mesh-reduced space, then a temporal model is trained to predict the future state in this mesh-reduced space. This reduction process simplifies the training of the temporal model by greatly reducing the computational cost accompanying a fine discretization. We study the capability of the proposed framework and several other popular neural PDE solvers on various types of systems including single-phase and multi-phase flows along with varying system parameters. We showcase that it has competitive accuracy and efficiency compared to the neural PDE solver that operates on full-order space. △ Less

Submitted 27 February, 2024; originally announced February 2024.

The Scott-Vogelius Method for Stokes Problem on Anisotropic Meshes

Authors: Kiera Kean, Michael Neilan, Michael Schneier

Abstract: This paper analyzes the Scott-Vogelius divergence-free element pair on anisotropic meshes. Weexplore the behavior of the inf-sup stability constant with respect to the aspect ratio on meshes generated with astandard barycenter mesh refinement strategy, as well as a newly introduced incenter refinement strategy. Numericalexperiments are presented which support the theoretical results This paper analyzes the Scott-Vogelius divergence-free element pair on anisotropic meshes. Weexplore the behavior of the inf-sup stability constant with respect to the aspect ratio on meshes generated with astandard barycenter mesh refinement strategy, as well as a newly introduced incenter refinement strategy. Numericalexperiments are presented which support the theoretical results △ Less

Submitted 29 September, 2021; originally announced September 2021.

Clip** over dissipation in turbulence models

Authors: Kiera Kean, William Layton, Michael Schneier

Abstract: Clip** refers to adding 1 line of code A=min{A,B} to force the variable A to stay below a present bound B. Phenomenological clip** also occurs in turbulence models to correct for over dissipation caused by the action of eddy viscosity terms in regions of small scales. Herein we analyze eddy viscosity model energy dissipation rates with 2 phenomenological clip** strategies. Since the true Rey… ▽ More Clip** refers to adding 1 line of code A=min{A,B} to force the variable A to stay below a present bound B. Phenomenological clip** also occurs in turbulence models to correct for over dissipation caused by the action of eddy viscosity terms in regions of small scales. Herein we analyze eddy viscosity model energy dissipation rates with 2 phenomenological clip** strategies. Since the true Reynolds stresses are O(d^2) (d= wall normal distance) in the near wall region, the first is to force this near wall behavior in the eddy viscosity by clip** the turbulent viscosity. The second is Escudier's early proposal to clip the turbulence length scale, reducing too large values in the interior of the flow. Analyzing respectively shear flow turbulence and turbulence in a box (i.e., periodic boundary conditions), we show that both clip** strategies do prevent aggregate over dissipation of model solutions. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Comments: 18 pages

MSC Class: primary 76F02; secondary 76F10

On the Prandtl-Kolmogorov 1-equation model of turbulence

Authors: Kiera Kean, William Layton, Michael Schneier

Abstract: We prove an estimate of total (viscous plus modelled turbulent) energy dissipation in general eddy viscosity models for shear flows. For general eddy viscosity models, we show that the ratio of the near wall average viscosity to the effective global viscosity is the key parameter. This result is then applied to the 1-equation, URANS model of turbulence for which this ratio depends on the specifica… ▽ More We prove an estimate of total (viscous plus modelled turbulent) energy dissipation in general eddy viscosity models for shear flows. For general eddy viscosity models, we show that the ratio of the near wall average viscosity to the effective global viscosity is the key parameter. This result is then applied to the 1-equation, URANS model of turbulence for which this ratio depends on the specification of the turbulence length scale. The model, which was derived by Prandtl in 1945, is a component of a 2-equation model derived by Kolmogorov in 1942 and is the core of many unsteady, Reynolds averaged models for prediction of turbulent flows. Away from walls, interpreting an early suggestion of Prandtl, we set \begin{equation*} l=\sqrt{2}k^{+1/2}τ, \hspace{50mm} \end{equation*} where $τ=$ selected time scale. In the near wall region analysis suggests replacing the traditional $l=0.41d$ ($d=$ wall normal distance) with $l=0.41d\sqrt{d/L}$ giving, e.g., \begin{equation*} l=\min \left\{ \sqrt{2}k{}^{+1/2}τ,\text{ }0.41d\sqrt{\frac{d}{L}} \right\} . \hspace{50mm} \end{equation*} This $l(\cdot )$ results in a simpler model with correct near wall asymptotics. Its energy dissipation rate scales no larger than the physically correct $O(U^{3}/L)$, balancing energy input with energy dissipation. △ Less

Submitted 21 June, 2021; v1 submitted 17 June, 2021; originally announced June 2021.

On Optimal Pointwise in Time Error Bounds and Difference Quotients for the Proper Orthogonal Decomposition

Authors: Birgul Koc, Samuele Rubino, Michael Schneier, John R. Singler, Traian Iliescu

Abstract: In this paper, we resolve several long standing issues dealing with optimal pointwise in time error bounds for proper orthogonal decomposition (POD) reduced order modeling of the heat equation. In particular, we study the role played by difference quotients (DQs) in obtaining reduced order model (ROM) error bounds that are optimal with respect to both the time discretization error and the ROM disc… ▽ More In this paper, we resolve several long standing issues dealing with optimal pointwise in time error bounds for proper orthogonal decomposition (POD) reduced order modeling of the heat equation. In particular, we study the role played by difference quotients (DQs) in obtaining reduced order model (ROM) error bounds that are optimal with respect to both the time discretization error and the ROM discretization error. When the DQs are not used, we prove that both the ROM projection error and the ROM error are suboptimal. When the DQs are used, we prove that both the ROM projection error and the ROM error are optimal. The numerical results for the heat equation support the theoretical results. △ Less

Submitted 7 October, 2020; originally announced October 2020.

An embedded variable step IMEX scheme for the incompressible Navier-Stokes equations

Authors: Victor DeCaria, Michael Schneier

Abstract: This report presents a series of implicit-explicit (IMEX) variable timestep algorithms for the incompressible Navier-Stokes equations (NSE). With the advent of new computer architectures there has been growing demand for low memory solvers of this type. The addition of time adaptivity improves the accuracy and greatly enhances the efficiency of the algorithm. We prove energy stability of an embedd… ▽ More This report presents a series of implicit-explicit (IMEX) variable timestep algorithms for the incompressible Navier-Stokes equations (NSE). With the advent of new computer architectures there has been growing demand for low memory solvers of this type. The addition of time adaptivity improves the accuracy and greatly enhances the efficiency of the algorithm. We prove energy stability of an embedded first-second order IMEX pair. For the first order member of the pair, we prove stability for variable stepsizes, and analyze convergence. We believe this to be the first proof of this type for a variable step IMEX scheme for the incompressible NSE. We then define and test a variable stepsize, variable order IMEX scheme using these methods. Our work contributes several firsts for IMEX NSE schemes, including an energy argument and error analysis of a two-step, variable stepsize method, and embedded error estimation for an IMEX multi-step method. △ Less

Submitted 31 January, 2020; originally announced February 2020.

Comments: 25 pages, 8 figures

Diagnostics for Eddy Viscosity Models of Turbulence Including Data-Driven/Neural Network Based Parameterizations

Authors: William Layon, Michael Schneier

Abstract: Classical eddy viscosity models add a viscosity term with turbulent viscosity coefficient whose specification varies from model to model. Turbulent viscosity coefficient approximations of unknown accuracy are typically constructed by solving associated systems of nonlinear evolution equations or by data driven approaches such as deep neural networks. Often eddy viscosity models over-diffuse, so ad… ▽ More Classical eddy viscosity models add a viscosity term with turbulent viscosity coefficient whose specification varies from model to model. Turbulent viscosity coefficient approximations of unknown accuracy are typically constructed by solving associated systems of nonlinear evolution equations or by data driven approaches such as deep neural networks. Often eddy viscosity models over-diffuse, so additional fixes are added. This process increases model complexity and decreases model comprehensibility, leading to the following two questions: Is an eddy viscosity model needed? Does the eddy viscosity model fail? This report derives a posteriori computable conditions that answer these two questions. △ Less

Submitted 6 November, 2019; originally announced November 2019.

Error Analysis of Supremizer Pressure Recovery for POD based Reduced Order Models of the time-dependent Navier-Stokes Equations

Authors: Kiera Kean, Michael Schneier

Abstract: For incompressible flow models, the pressure term serves as a Lagrange multiplier to ensure that the incompressibility constraint is satisfied. In engineering applications, the pressure term is necessary for calculating important quantities based on stresses like the lift and drag. For reduced order models generated via a Proper orthogonal decomposition, it is common for the pressure to drop out o… ▽ More For incompressible flow models, the pressure term serves as a Lagrange multiplier to ensure that the incompressibility constraint is satisfied. In engineering applications, the pressure term is necessary for calculating important quantities based on stresses like the lift and drag. For reduced order models generated via a Proper orthogonal decomposition, it is common for the pressure to drop out of the equations and produce a velocity-only reduced order model. To recover the pressure, many techniques have been numerically studied in the literature; however, these techniques have undergone little rigorous analysis. In this work, we examine two of the most popular approaches: pressure recovery through the Pressure Poisson equation and recovery via the momentum equation through the use of a supremizer stabilized velocity basis. We examine the challenges that each approach faces and prove stability and convergence results for the supremizer stabilized approach. We also investigate numerically the stability and convergence of the supremizer based approach, in addition to its performance against the Pressure Poisson method. △ Less

Submitted 12 September, 2019; originally announced September 2019.

Continuous Data Assimilation Reduced Order Models of Fluid Flow

Authors: Camille Zerfas, Leo G. Rebholz, Michael Schneier, Traian Iliescu

Abstract: We propose, analyze, and test a novel continuous data assimilation reduced order model (DA-ROM) for simulating incompressible flows. While ROMs have a long history of success on certain problems with recurring dominant structures, they tend to lose accuracy on more complicated problems and over longer time intervals. Meanwhile, continuous data assimilation (DA) has recently been used to improve ac… ▽ More We propose, analyze, and test a novel continuous data assimilation reduced order model (DA-ROM) for simulating incompressible flows. While ROMs have a long history of success on certain problems with recurring dominant structures, they tend to lose accuracy on more complicated problems and over longer time intervals. Meanwhile, continuous data assimilation (DA) has recently been used to improve accuracy and, in particular, long time accuracy in fluid simulations by incorporating measurement data into the simulation. This paper synthesizes these two ideas, in an attempt to address inaccuracies in ROM by applying DA, especially over long time intervals and when only inaccurate snapshots are available. We prove that with a properly chosen nudging parameter, the proposed DA-ROM algorithm converges exponentially fast in time to the true solution, up to discretization and ROM truncation errors. Finally, we propose a strategy for nudging adaptively in time, by adjusting dissipation arising from the nudging term to better match true solution energy. Numerical tests confirm all results, and show that the DA-ROM strategy with adaptive nudging can be highly effective at providing long time accuracy in ROMs. △ Less

Submitted 10 March, 2019; originally announced March 2019.

An Artificial Compression Reduced Order Model

Authors: Victor DeCaria, Traian Iliescu, William Layton, Michael McLaughlin, Michael Schneier

Abstract: We propose a novel artificial compression, reduced order model (AC-ROM) for the numerical simulation of viscous incompressible fluid flows. The new AC-ROM provides approximations not only for velocity, but also for pressure, which is needed to calculate forces on bodies in the flow and to connect the simulation parameters with pressure data. The new AC-ROM does not require that the velocity-pressu… ▽ More We propose a novel artificial compression, reduced order model (AC-ROM) for the numerical simulation of viscous incompressible fluid flows. The new AC-ROM provides approximations not only for velocity, but also for pressure, which is needed to calculate forces on bodies in the flow and to connect the simulation parameters with pressure data. The new AC-ROM does not require that the velocity-pressure ROM spaces satisfy the inf-sup (Ladyzhenskaya-Babuska-Brezzi) condition and its basis functions are constructed from data that are not required to be weakly-divergence free. We prove error estimates for the reduced basis discretization of the AC-ROM. We also investigate numerically the new AC-ROM in the simulation of a two-dimensional flow between offset cylinders. △ Less

Submitted 24 February, 2019; originally announced February 2019.

Nonintrusive Stabilization of Reduced Order Models for Uncertainty Quantification of Time-Dependent Convection-Dominated Flows

Authors: M. Gunzburger, T. Iliescu, M. Mohebujjaman, M. Schneier

Abstract: In this paper, we propose a nonintrusive filter-based stabilization of reduced order models (ROMs) for uncertainty quantification (UQ) of the time-dependent Navier-Stokes equations in convection-dominated regimes. We propose a novel high-order ROM differential filter and use it in conjunction with an evolve-filter-relax algorithm to attenuate the numerical oscillations of standard ROMs. We also ex… ▽ More In this paper, we propose a nonintrusive filter-based stabilization of reduced order models (ROMs) for uncertainty quantification (UQ) of the time-dependent Navier-Stokes equations in convection-dominated regimes. We propose a novel high-order ROM differential filter and use it in conjunction with an evolve-filter-relax algorithm to attenuate the numerical oscillations of standard ROMs. We also examine how stochastic collocation methods (SCMs) can be combined with the evolve-filter-relax algorithm for efficient UQ of fluid flows. We emphasize that the new stabilized SCM-ROM framework is nonintrusive and can be easily used in conjunction with legacy flow solvers. We test the new framework in the numerical simulation of a two-dimensional flow past a circular cylinder with a random viscosity that yields a random Reynolds number with mean $Re=100$. △ Less

Submitted 19 October, 2018; originally announced October 2018.

Comments: 22

MSC Class: 65M15; 65M60

A Leray regularized ensemble-proper orthogonal decomposition method for parameterized convection-dominated flows

Authors: Max Gunzburger, Traian Iliescu, Michael Schneier

Abstract: Partial differential equations (PDEs) are often dependent on input quantities which are inherently uncertain. To quantify this uncertainty, these PDEs must be solved over a large ensemble of parameters. Even for a single realization this can a computationally intensive process. In the case of flows governed by the Navier-Stokes equations, an efficient method has been devised for computing an ensem… ▽ More Partial differential equations (PDEs) are often dependent on input quantities which are inherently uncertain. To quantify this uncertainty, these PDEs must be solved over a large ensemble of parameters. Even for a single realization this can a computationally intensive process. In the case of flows governed by the Navier-Stokes equations, an efficient method has been devised for computing an ensemble of solutions. To further reduce the computational cost of this method, an ensemble proper orthogonal decomposition (POD) method was recently proposed. The main contribution of this work is the introduction of POD spatial filtering for ensemble-POD methods. The POD spatial filter makes possible the construction of the Leray ensemble-POD model, which is a regularized reduced order model for the numerical simulation of convection-dominated flows. The Leray ensemble-POD model employs the POD spatial filter to smooth (regularize) the convection term in the Navier-Stokes equations and greatly diminishes the numerical inaccuracies produced by the ensemble-POD method in the numerical simulation of convection-dominated flows. Specifically, for the numerical simulation of a convection-dominated two-dimensional flow between two offset cylinders, we show that the Leray ensemble-POD method yields accurate results, whereas the ensemble-POD is highly inaccurate. The second contribution of this work is a new numerical discretization of the variable viscosity ensemble algorithm in which the average viscosity is replaced with the maximum viscosity. It is shown that this new numerical discretization is significantly more stable than those in current use. Furthermore, error estimates for the novel Leray ensemble-POD algorithm with this new numerical discretization are also proven. △ Less

Submitted 23 October, 2017; v1 submitted 16 October, 2017; originally announced October 2017.

Comments: arXiv admin note: text overlap with arXiv:1709.06422

An improved discrete least-squares/reduced-basis method for parameterized elliptic PDEs

Authors: Max Gunzburger, Michael Schneier, Clayton Webster, Guannan Zhang

Abstract: It is shown that the computational efficiency of the discrete least-squares (DLS) approximation of solutions of stochastic elliptic PDEs is improved by incorporating a reduced-basis method into the DLS framework. The goal is to recover the entire solution map from the parameter space to the finite element space. To this end, first, a reduced-basis solution using a weak greedy algorithm is construc… ▽ More It is shown that the computational efficiency of the discrete least-squares (DLS) approximation of solutions of stochastic elliptic PDEs is improved by incorporating a reduced-basis method into the DLS framework. The goal is to recover the entire solution map from the parameter space to the finite element space. To this end, first, a reduced-basis solution using a weak greedy algorithm is constructed, then a DLS approximation is determined by evaluating the reduced-basis approximation instead of the full finite element approximation. The main advantage of the new approach is that one only need apply the DLS operator to the coefficients of the reduced-basis expansion, resulting in huge savings in both the storage of the DLS coefficients and the online cost of evaluating the DLS approximation. In addition, the recently developed quasi-optimal polynomial space is also adopted in the new approach, resulting in superior convergence rates for a wider class of problems than previous analyzed. Numerical experiments are provided that illustrate the theoretical results. △ Less

Submitted 8 November, 2017; v1 submitted 3 October, 2017; originally announced October 2017.

A higher-order ensemble/proper orthogonal decomposition method for the nonstationary Navier-Stokes equations

Authors: Max Gunzburger, Nan Jiang, Michael Schneier

Abstract: Partial differential equations (PDE) often involve parameters, such as viscosity or density. An analysis of the PDE may involve considering a large range of parameter values, as occurs in uncertainty quantification, control and optimization, inference, and several statistical techniques. The solution for even a single case may be quite expensive; whereas parallel computing may be applied, this red… ▽ More Partial differential equations (PDE) often involve parameters, such as viscosity or density. An analysis of the PDE may involve considering a large range of parameter values, as occurs in uncertainty quantification, control and optimization, inference, and several statistical techniques. The solution for even a single case may be quite expensive; whereas parallel computing may be applied, this reduces the total elapsed time but not the total computational effort. In the case of flows governed by the Navier-Stokes equations, a method has been devised for computing an ensemble of solutions. Recently, a reduced-order model derived from a proper orthogonal decomposition (POD) approach was incorporated into a first-order accurate in time version of the ensemble algorithm. In this work, we expand on that work by incorporating the POD reduced order model into a second-order accurate ensemble algorithm. Stability and convergence results for this method are updated to account for the POD/ROM approach. Numerical experiments illustrate the accuracy and efficiency of the new approach. △ Less

Submitted 27 September, 2017; v1 submitted 15 September, 2017; originally announced September 2017.

Comments: arXiv admin note: text overlap with arXiv:1603.04777

An efficient, partitioned ensemble algorithm for simulating ensembles of evolutionary MHD flows at low magnetic Reynolds number

Authors: Nan Jiang, Michael Schneier

Abstract: Studying the propagation of uncertainties in a nonlinear dynamical system usually involves generating a set of samples in the stochastic parameter space and then repeated simulations with different sampled parameters. The main difficulty faced in the process is the excessive computational cost. In this paper, we present an efficient, partitioned ensemble algorithm to determine multiple realization… ▽ More Studying the propagation of uncertainties in a nonlinear dynamical system usually involves generating a set of samples in the stochastic parameter space and then repeated simulations with different sampled parameters. The main difficulty faced in the process is the excessive computational cost. In this paper, we present an efficient, partitioned ensemble algorithm to determine multiple realizations of a reduced Magnetohydrodynamics (MHD) system, which models MHD flows at low magnetic Reynolds number. The algorithm decouples the fully coupled problem into two smaller sub-physics problems, which reduces the size of the linear systems that to be solved and allows the use of optimized codes for each sub-physics problem. Moreover, the resulting coefficient matrices are the same for all realizations at each time step, which allows faster computation of all realizations and significant savings in computational cost. We prove this algorithm is first order accurate and long time stable under a time step condition. Numerical examples are provided to verify the theoretical results and demonstrate the efficiency of the algorithm. △ Less

Submitted 15 September, 2017; originally announced September 2017.

An Ensemble-Proper Orthogonal Decomposition Method for the Nonstationary Navier-Stokes Equations

Authors: Max Gunzburger, Nan Jiang, Michael Schneier

Abstract: The definition of partial differential equation (PDE) models usually involves a set of parameters whose values may vary over a wide range. The solution of even a single set of parameter values may be quite expensive. In many cases, e.g., optimization, control, uncertainty quantification, and other settings, solutions are needed for many sets of parameter values. We consider the case of the time-de… ▽ More The definition of partial differential equation (PDE) models usually involves a set of parameters whose values may vary over a wide range. The solution of even a single set of parameter values may be quite expensive. In many cases, e.g., optimization, control, uncertainty quantification, and other settings, solutions are needed for many sets of parameter values. We consider the case of the time-dependent Navier-Stokes equations for which a recently developed ensemble-based method allows for the efficient determination of the multiple solutions corresponding to many parameter sets. The method uses the average of the multiple solutions at any time step to define a linear set of equations that determines the solutions at the next time step. To significantly further reduce the costs of determining multiple solutions of the Navier-Stokes equations, we incorporate a proper orthogonal decomposition (POD) reduced-order model into the ensemble-based method. The stability and convergence results for the ensemble-based method are extended to the ensemble-POD approach. Numerical experiments are provided that illustrate the accuracy and efficiency of computations determined using the new approach. △ Less

Submitted 15 November, 2016; v1 submitted 15 March, 2016; originally announced March 2016.