Showing 1–50 of 51 results for author: Gunzburger, M

Optimal control of stochastic cylinder flow using data-driven compressive sensing method

Authors: Liuhong Chen, Ju Ming, Max D. Gunzburger

Abstract: A stochastic optimal control problem for incompressible Newtonian channel flow past a circular cylinder is used as a prototype optimal control problem for the stochastic Navier-Stokes equations. The inlet flow and the rotation speed of the cylinder are allowed to have stochastic perturbations. The control acts on the cylinder via adjustment of the rotation speed. Possible objectives of the control… ▽ More A stochastic optimal control problem for incompressible Newtonian channel flow past a circular cylinder is used as a prototype optimal control problem for the stochastic Navier-Stokes equations. The inlet flow and the rotation speed of the cylinder are allowed to have stochastic perturbations. The control acts on the cylinder via adjustment of the rotation speed. Possible objectives of the control include, among others, tracking a desired (given) velocity field or minimizing the kinetic energy, enstrophy, or the drag of the flow over a given body. Owing to the high computational requirements, the direct application of the classical Monte Carlo methods for our problem is limited. To overcome the difficulty, we use a multi-fidelity data-driven compressive sensing based polynomial chaos expansions (MDCS-PCE). An effective gradient-based optimization for the discrete optimality systems resulted from the MDCS-PCE discretization is developed. The strategy can be applied broadly to many stochastic flow control problems. Numerical tests are performed to validate our methodology. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Multifidelity Methods for Uncertainty Quantification of a Nonlocal Model for Phase Changes in Materials

Authors: Parisa Khodabakhshi, Olena Burkovska, Karen Willcox, Max Gunzburger

Abstract: This study is devoted to the construction of a multifidelity Monte Carlo (MFMC) method for the uncertainty quantification of a nonlocal, non-mass-conserving Cahn-Hilliard model for phase transitions with an obstacle potential. We are interested in the estimation of the expected value of an output of interest (OoI) that depends on the solution of the nonlocal Cahn-Hilliard model. As opposed to its… ▽ More This study is devoted to the construction of a multifidelity Monte Carlo (MFMC) method for the uncertainty quantification of a nonlocal, non-mass-conserving Cahn-Hilliard model for phase transitions with an obstacle potential. We are interested in the estimation of the expected value of an output of interest (OoI) that depends on the solution of the nonlocal Cahn-Hilliard model. As opposed to its local counterpart, the nonlocal model captures sharp interfaces without the need for significant mesh refinement. However, the computational cost of the nonlocal Cahn-Hilliard model is higher than that of its local counterpart with similar mesh refinement, inhibiting its use for outer-loop applications such as uncertainty quantification. The MFMC method augments the desired high-fidelity, high-cost OoI with a set of lower-fidelity, lower-cost OoIs to alleviate the computational burden associated with nonlocality. Most of the computational budget is allocated to sampling the cheap surrogate models to achieve speedup, whereas the high-fidelity model is sparsely sampled to maintain accuracy. For the non-mass-conserving nonlocal Cahn-Hilliard model, the use of the MFMC method results in, for a given computational budget, about one-order-of-magnitude reduction in the mean-squared error of the expected value of the OoI relative to that of the Monte Carlo method. △ Less

Submitted 16 October, 2023; originally announced October 2023.

A scalable domain decomposition method for FEM discretizations of nonlocal equations of integrable and fractional type

Authors: Manuel Klar, Giacomo Capodaglio, Marta D'Elia, Christian Glusa, Max Gunzburger, Christian Vollmann

Abstract: Nonlocal models allow for the description of phenomena which cannot be captured by classical partial differential equations. The availability of efficient solvers is one of the main concerns for the use of nonlocal models in real world engineering applications. We present a domain decomposition solver that is inspired by substructuring methods for classical local equations. In numerical experiment… ▽ More Nonlocal models allow for the description of phenomena which cannot be captured by classical partial differential equations. The availability of efficient solvers is one of the main concerns for the use of nonlocal models in real world engineering applications. We present a domain decomposition solver that is inspired by substructuring methods for classical local equations. In numerical experiments involving finite element discretizations of scalar and vectorial nonlocal equations of integrable and fractional type, we observe improvements in solution time of up to 14.6x compared to commonly used solver strategies. △ Less

Submitted 31 May, 2023; originally announced June 2023.

MSC Class: 34B10; 65M60; 45P05; 45A99; 65R99

A Multifidelity Monte Carlo Method for Realistic Computational Budgets

Authors: Anthony Gruber, Max Gunzburger, Lili Ju, Zhu Wang

Abstract: A method for the multifidelity Monte Carlo (MFMC) estimation of statistical quantities is proposed which is applicable to computational budgets of any size. Based on a sequence of optimization problems each with a globally minimizing closed-form solution, this method extends the usability of a well known MFMC algorithm, recovering it when the computational budget is large enough. Theoretical resul… ▽ More A method for the multifidelity Monte Carlo (MFMC) estimation of statistical quantities is proposed which is applicable to computational budgets of any size. Based on a sequence of optimization problems each with a globally minimizing closed-form solution, this method extends the usability of a well known MFMC algorithm, recovering it when the computational budget is large enough. Theoretical results verify that the proposed approach is at least as optimal as its namesake and retains the benefits of multifidelity estimation with minimal assumptions on the budget or amount of available data, providing a notable reduction in variance over simple Monte Carlo estimation. △ Less

Submitted 12 November, 2022; v1 submitted 15 June, 2022; originally announced June 2022.

MSC Class: 62K05; 49M20

Energetically Consistent Model Reduction for Metriplectic Systems

Authors: Anthony Gruber, Max Gunzburger, Lili Ju, Zhu Wang

Abstract: The metriplectic formalism is useful for describing complete dynamical systems which conserve energy and produce entropy. This creates challenges for model reduction, as the elimination of high-frequency information will generally not preserve the metriplectic structure which governs long-term stability of the system. Based on proper orthogonal decomposition, a provably convergent metriplectic red… ▽ More The metriplectic formalism is useful for describing complete dynamical systems which conserve energy and produce entropy. This creates challenges for model reduction, as the elimination of high-frequency information will generally not preserve the metriplectic structure which governs long-term stability of the system. Based on proper orthogonal decomposition, a provably convergent metriplectic reduced-order model is formulated which is guaranteed to maintain the algebraic structure necessary for energy conservation and entropy formation. Numerical results on benchmark problems show that the proposed method is remarkably stable, leading to improved accuracy over long time scales at a moderate increase in cost over naive methods. △ Less

Submitted 12 November, 2022; v1 submitted 17 April, 2022; originally announced April 2022.

An asymptotically compatible coupling formulation for nonlocal interface problems with jumps

Authors: Christian Glusa, Marta D'Elia, Giacomo Capodaglio, Max Gunzburger, Pavel B. Bochev

Abstract: We introduce a mathematically rigorous formulation for a nonlocal interface problem with jumps and propose an asymptotically compatible finite element discretization for the weak form of the interface problem. After proving the well-posedness of the weak form, we demonstrate that solutions to the nonlocal interface problem converge to the corresponding local counterpart when the nonlocal data are… ▽ More We introduce a mathematically rigorous formulation for a nonlocal interface problem with jumps and propose an asymptotically compatible finite element discretization for the weak form of the interface problem. After proving the well-posedness of the weak form, we demonstrate that solutions to the nonlocal interface problem converge to the corresponding local counterpart when the nonlocal data are appropriately prescribed. Several numerical tests in one and two dimensions show the applicability of our technique, its numerical convergence to exact nonlocal solutions, its convergence to the local limit when the horizons vanish, and its robustness with respect to the patch test. △ Less

Submitted 14 March, 2022; originally announced March 2022.

Report number: SAND2022-2944 O

A Comparison of Neural Network Architectures for Data-Driven Reduced-Order Modeling

Authors: Anthony Gruber, Max Gunzburger, Lili Ju, Zhu Wang

Abstract: The popularity of deep convolutional autoencoders (CAEs) has engendered new and effective reduced-order models (ROMs) for the simulation of large-scale dynamical systems. Despite this, it is still unknown whether deep CAEs provide superior performance over established linear techniques or other network-based methods in all modeling scenarios. To elucidate this, the effect of autoencoder architectu… ▽ More The popularity of deep convolutional autoencoders (CAEs) has engendered new and effective reduced-order models (ROMs) for the simulation of large-scale dynamical systems. Despite this, it is still unknown whether deep CAEs provide superior performance over established linear techniques or other network-based methods in all modeling scenarios. To elucidate this, the effect of autoencoder architecture on its associated ROM is studied through the comparison of deep CAEs against two alternatives: a simple fully connected autoencoder, and a novel graph convolutional autoencoder. Through benchmark experiments, it is shown that the superior autoencoder architecture for a given ROM application is highly dependent on the size of the latent space and the structure of the snapshot data, with the proposed architecture demonstrating benefits on data with irregular connectivity when the latent space is sufficiently large. △ Less

Submitted 8 February, 2022; v1 submitted 5 October, 2021; originally announced October 2021.

MSC Class: 65M22; 65M60

Parallel Exponential Time Differencing Methods for Geophysical Flow Simulations

Authors: Rihui Lan, Wei Leng, Zhu Wang, Lili Ju, Max Gunzburger

Abstract: Two ocean models are considered for geophysical flow simulations: the multi-layer shallow water equations and the multi-layer primitive equations. For the former, we investigate the parallel performance of exponential time differencing (ETD) methods, including exponential Rosenbrock-Euler, ETD2wave, and B-ETD2wave. For the latter, we take advantage of the splitting of barotropic and baroclinic mod… ▽ More Two ocean models are considered for geophysical flow simulations: the multi-layer shallow water equations and the multi-layer primitive equations. For the former, we investigate the parallel performance of exponential time differencing (ETD) methods, including exponential Rosenbrock-Euler, ETD2wave, and B-ETD2wave. For the latter, we take advantage of the splitting of barotropic and baroclinic modes and propose a new two-level method in which an ETD method is applied to solve the fast barotropic mode. These methods could improve the computational efficiency of numerical simulations because ETD methods allow for much larger time step sizes than traditional explicit time-step** techniques that are commonly used in existing computational ocean models. Several standard benchmark tests for ocean modeling are performed and comparison of the numerical results demonstrate a great potential of applying the parallel ETD methods for simulating real-world geophysical flows. △ Less

Submitted 27 May, 2021; originally announced June 2021.

High-Order Multirate Explicit Time-Step** Schemes for the Baroclinic-Barotropic Split Dynamics in Primitive Equations

Authors: Rihui Lan, Lili Ju, Zhu Wang, Max Gunzburger, Philip Jones

Abstract: In order to treat the multiple time scales of ocean dynamics in an efficient manner, the baroclinic-barotropic splitting technique has been widely used for solving the primitive equations for ocean modeling. Based on the framework of strong stability-preserving Runge-Kutta approach, we propose two high-order multirate explicit time-step** schemes (SSPRK2-SE and SSPRK3-SE) for the resulting split… ▽ More In order to treat the multiple time scales of ocean dynamics in an efficient manner, the baroclinic-barotropic splitting technique has been widely used for solving the primitive equations for ocean modeling. Based on the framework of strong stability-preserving Runge-Kutta approach, we propose two high-order multirate explicit time-step** schemes (SSPRK2-SE and SSPRK3-SE) for the resulting split system in this paper. The proposed schemes allow for a large time step to be used for the three-dimensional baroclinic (slow) mode and a small time step for the two-dimensional barotropic (fast) mode, in which each of the two mode solves just need to satisfy their respective CFL conditions for numerical stability. Specifically, at each time step, the baroclinic velocity is first computed by advancing the baroclinic mode and fluid thickness of the system with the large time-step \textcolor{black}{and the assistance of some intermediate approximations of the baroctropic mode obtained by substep** with the small-time step}; then the barotropic velocity is corrected by using the small time step to re-advance the barotropic mode under an improved barotropic forcing produced by interpolation of the forcing terms from the preceding baroclinic mode solves; lastly, the fluid thickness is updated by coupling the baroclinic and barotropic velocities. Additionally, numerical inconsistencies on the discretized sea surface height caused by the mode splitting are relieved via a reconciliation process with carefully calculated flux deficits. Two benchmark tests from the "MPAS-Ocean" platform are carried out to numerically demonstrate the performance and parallel scalability of the proposed SSPRK-SE schemes. △ Less

Submitted 30 December, 2021; v1 submitted 27 May, 2021; originally announced May 2021.

Nonlinear Level Set Learning for Function Approximation on Sparse Data with Applications to Parametric Differential Equations

Authors: Anthony Gruber, Max Gunzburger, Lili Ju, Yuankai Teng, Zhu Wang

Abstract: A dimension reduction method based on the "Nonlinear Level set Learning" (NLL) approach is presented for the pointwise prediction of functions which have been sparsely sampled. Leveraging geometric information provided by the Implicit Function Theorem, the proposed algorithm effectively reduces the input dimension to the theoretical lower bound with minor accuracy loss, providing a one-dimensional… ▽ More A dimension reduction method based on the "Nonlinear Level set Learning" (NLL) approach is presented for the pointwise prediction of functions which have been sparsely sampled. Leveraging geometric information provided by the Implicit Function Theorem, the proposed algorithm effectively reduces the input dimension to the theoretical lower bound with minor accuracy loss, providing a one-dimensional representation of the function which can be used for regression and sensitivity analysis. Experiments and applications are presented which compare this modified NLL with the original NLL and the Active Subspaces (AS) method. While accommodating sparse input data, the proposed algorithm is shown to train quickly and provide a much more accurate and informative reduction than either AS or the original NLL on two example functions with high-dimensional domains, as well as two state-dependent quantities depending on the solutions to parametric differential equations. △ Less

Submitted 7 August, 2021; v1 submitted 28 April, 2021; originally announced April 2021.

MSC Class: 65D15; 65D40

A general framework for substructuring-based domain decomposition methods for models having nonlocal interactions

Authors: Giacomo Capodaglio, Marta D'Elia, Max Gunzburger, Pavel Bochev, Manuel Klar, Christian Vollmann

Abstract: A rigorous mathematical framework is provided for a substructuring-based domain-decomposition approach for nonlocal problems that feature interactions between points separated by a finite distance. Here, by substructuring it is meant that a traditional geometric configuration for local partial differential equation problems is used in which a computational domain is subdivided into non-overlap**… ▽ More A rigorous mathematical framework is provided for a substructuring-based domain-decomposition approach for nonlocal problems that feature interactions between points separated by a finite distance. Here, by substructuring it is meant that a traditional geometric configuration for local partial differential equation problems is used in which a computational domain is subdivided into non-overlap** subdomains. In the nonlocal setting, this approach is substructuring-based in the sense that those subdomains interact with neighboring domains over interface regions having finite volume, in contrast to the local PDE setting in which interfaces are lower dimensional manifolds separating abutting subdomains. Key results include the equivalence between the global, single-domain nonlocal problem and its multi-domain reformulation, both at the continuous and discrete levels. These results provide the rigorous foundation necessary for the development of efficient solution strategies for nonlocal domain-decomposition methods. △ Less

Submitted 26 August, 2020; originally announced August 2020.

Comments: 27 pages, 3 figures

Report number: Sandia National Laboratories SAND2020-8735 MSC Class: 34B10; 65M60; 45P05; 45A99; 65R99

A cookbook for finite element methods for nonlocal problems, including quadrature rules and approximate Euclidean balls

Authors: Marta D'Elia, Max Gunzburger, Christian Vollmann

Abstract: The implementation of finite element methods (FEMs) for nonlocal models with a finite range of interaction poses challenges not faced in the partial differential equations (PDEs) setting. For example, one has to deal with weak forms involving double integrals which lead to discrete systems having higher assembly and solving costs due to possibly much lower sparsity compared to that of FEMs for PDE… ▽ More The implementation of finite element methods (FEMs) for nonlocal models with a finite range of interaction poses challenges not faced in the partial differential equations (PDEs) setting. For example, one has to deal with weak forms involving double integrals which lead to discrete systems having higher assembly and solving costs due to possibly much lower sparsity compared to that of FEMs for PDEs. In addition, one may encounter non-smooth integrands. In many nonlocal models, nonlocal interactions are limited to bounded neighborhoods that are ubiquitously chosen to be Euclidean balls, resulting in the challenge of dealing with intersections of such balls with the finite elements. We focus on develo** recipes for the efficient assembly of FEM stiffness matrices and on the choice of quadrature rules for the double integrals that contribute to the assembly efficiency and also posses sufficient accuracy. A major feature of our recipes is the use of approximate balls, e.g., several polygonal approximations of Euclidean balls, that, among other advantages, mitigate the challenge of dealing with ball-element intersections. We provide numerical illustrations of the relative accuracy and efficiency of the several approaches we develop. △ Less

Submitted 21 May, 2020; originally announced May 2020.

Comments: 61 pages, 4 tables, 17 figures

Report number: Sandia National Laboratories, SAND2020-4407 MSC Class: 34B10; 65M60; 45P05; 45A99; 65R99; 65D30; 65M15

On a nonlocal Cahn-Hilliard model permitting sharp interfaces

Authors: Olena Burkovska, Max Gunzburger

Abstract: A nonlocal Cahn-Hilliard model with a nonsmooth potential of double-well obstacle type that promotes sharp interfaces in the solution is presented. To capture long-range interactions between particles, a nonlocal Ginzburg-Landau energy functional is defined which recovers the classical (local) model for vanishing nonlocal interactions. In contrast to the local Cahn-Hilliard problem that always lea… ▽ More A nonlocal Cahn-Hilliard model with a nonsmooth potential of double-well obstacle type that promotes sharp interfaces in the solution is presented. To capture long-range interactions between particles, a nonlocal Ginzburg-Landau energy functional is defined which recovers the classical (local) model for vanishing nonlocal interactions. In contrast to the local Cahn-Hilliard problem that always leads to diffuse interfaces, the proposed nonlocal model can lead to a strict separation into pure phases of the substance. Here, the lack of smoothness of the potential is essential to guarantee the aforementioned sharp-interface property. Mathematically, this introduces additional inequality constraints that, in a weak form, lead to a coupled system of variational inequalities which at each time instance can be restated as a constrained optimization problem. We prove the well-posedness and regularity of the semi-discrete and continuous in time weak solutions, and derive the conditions under which pure phases are admitted. Moreover, we develop discretizations of the problem based on finite elements and implicit-explicit time step** methods that can be realized efficiently. Finally, we illustrate our theoretical findings through several numerical experiments in one and two spatial dimensions that highlight the differences in features of local and nonlocal solutions and also the sharp interface properties of the nonlocal model. △ Less

Submitted 9 September, 2021; v1 submitted 29 April, 2020; originally announced April 2020.

Numerical methods for nonlocal and fractional models

Authors: Marta D'Elia, Qiang Du, Christian Glusa, Max Gunzburger, Xiaochuan Tian, Zhi Zhou

Abstract: Partial differential equations (PDEs) are used, with huge success, to model phenomena arising across all scientific and engineering disciplines. However, across an equally wide swath, there exist situations in which PDE models fail to adequately model observed phenomena or are not the best available model for that purpose. On the other hand, in many situations, nonlocal models that account for int… ▽ More Partial differential equations (PDEs) are used, with huge success, to model phenomena arising across all scientific and engineering disciplines. However, across an equally wide swath, there exist situations in which PDE models fail to adequately model observed phenomena or are not the best available model for that purpose. On the other hand, in many situations, nonlocal models that account for interaction occurring at a distance have been shown to more faithfully and effectively model observed phenomena that involve possible singularities and other anomalies. In this article, we consider a generic nonlocal model, beginning with a short review of its definition, the properties of its solution, its mathematical analysis, and specific concrete examples. We then provide extensive discussions about numerical methods, including finite element, finite difference, and spectral methods, for determining approximate solutions of the nonlocal models considered. In that discussion, we pay particular attention to a special class of nonlocal models that are the most widely studied in the literature, namely those involving fractional derivatives. The article ends with brief considerations of several modeling and algorithmic extensions which serve to show the wide applicability of nonlocal modeling. △ Less

Submitted 20 May, 2020; v1 submitted 4 February, 2020; originally announced February 2020.

Comments: Revised/Improved version. 126 pages, 18 figures, review paper

Report number: Sandia National Laboratories, SAND2020-1442 R

An energy-based coupling approach to nonlocal interface problems

Authors: Giacomo Capodaglio, Marta D'Elia, Pavel Bochev, Max Gunzburger

Abstract: Nonlocal models provide accurate representations of physical phenomena ranging from fracture mechanics to complex subsurface flows, where traditional partial differential equations fail to capture effects caused by long-range forces at the microscale and mesoscale. However, the application of nonlocal models to problems involving interfaces such as multimaterial simulations and fluid-structure int… ▽ More Nonlocal models provide accurate representations of physical phenomena ranging from fracture mechanics to complex subsurface flows, where traditional partial differential equations fail to capture effects caused by long-range forces at the microscale and mesoscale. However, the application of nonlocal models to problems involving interfaces such as multimaterial simulations and fluid-structure interaction, is hampered by the lack of a rigorous nonlocal interface theory needed to support numerical developments. In this paper, we use an energy-based approach to develop a mathematically rigorous nonlocal interface theory which provides a physically consistent extension of the classical perfect interface PDE formulation. Numerical examples validate the proposed framework and demonstrate the scope of our theory. △ Less

Submitted 7 May, 2020; v1 submitted 10 January, 2020; originally announced January 2020.

Comments: 23 pages, 15 figures

Report number: SAND2020-027 MSC Class: 34b10; 45a05; 74a50; 35j50

Exponential Time Differencing for the Tracer Equations Appearing in Primitive Equation Ocean Models

Authors: Sara Calandrini, Konstantin Pieper, Max Gunzburger

Abstract: The tracer equations are part of the primitive equations used in ocean modeling and describe the transport of tracers, such as temperature, salinity or chemicals, in the ocean. Depending on the number of tracers considered, several equations may be added to and coupled to the dynamics system. In many relevant situations, the time-step requirements of explicit methods imposed by the transport and m… ▽ More The tracer equations are part of the primitive equations used in ocean modeling and describe the transport of tracers, such as temperature, salinity or chemicals, in the ocean. Depending on the number of tracers considered, several equations may be added to and coupled to the dynamics system. In many relevant situations, the time-step requirements of explicit methods imposed by the transport and mixing in the vertical direction are more restrictive than those for the horizontal, and this may cause the need to use very small time steps if a fully explicit method is employed. To overcome this issue, we propose an exponential time differencing (ETD) solver where the vertical terms (transport and diffusion) are treated with a matrix exponential, whereas the horizontal terms are dealt with in an explicit way. We investigate numerically the computational speed-ups that can be obtained over other semi-implicit methods, and we analyze the advantages of the method in the case of multiple tracers. △ Less

Submitted 4 October, 2019; originally announced October 2019.

Piecewise polynomial approximation of probability density functions with application to uncertainty quantification for stochastic PDEs

Authors: Giacomo Capodaglio, Max Gunzburger

Abstract: The probability density function (PDF) associated with a given set of samples is approximated by a piecewise-linear polynomial constructed with respect to a binning of the sample space. The kernel functions are a compactly supported basis for the space of such polynomials, i.e. finite element hat functions, that are centered at the bin nodes rather than at the samples, as is the case for the stand… ▽ More The probability density function (PDF) associated with a given set of samples is approximated by a piecewise-linear polynomial constructed with respect to a binning of the sample space. The kernel functions are a compactly supported basis for the space of such polynomials, i.e. finite element hat functions, that are centered at the bin nodes rather than at the samples, as is the case for the standard kernel density estimation approach. This feature naturally provides an approximation that is scalable with respect to the sample size. On the other hand, unlike other strategies that use a finite element approach, the proposed approximation does not require the solution of a linear system. In addition, a simple rule that relates the bin size to the sample size eliminates the need for bandwidth selection procedures. The proposed density estimator has unitary integral, does not require a constraint to enforce positivity, and is consistent. The proposed approach is validated through numerical examples in which samples are drawn from known PDFs. The approach is also used to determine approximations of (unknown) PDFs associated with outputs of interest that depend on the solution of a stochastic partial differential equation. △ Less

Submitted 5 December, 2019; v1 submitted 26 June, 2019; originally announced June 2019.

Exponential time differencing for mimetic multilayer ocean models

Authors: Konstantin Pieper, K. Chad Sockwell, Max Gunzburger

Abstract: A framework for exponential time discretization of the multilayer rotating shallow water equations is developed in combination with a mimetic discretization in space. The method is based on a combination of existing exponential time differencing (ETD) methods and a careful choice of approximate Jacobians. The discrete Hamiltonian structure and conservation properties of the model are taken into ac… ▽ More A framework for exponential time discretization of the multilayer rotating shallow water equations is developed in combination with a mimetic discretization in space. The method is based on a combination of existing exponential time differencing (ETD) methods and a careful choice of approximate Jacobians. The discrete Hamiltonian structure and conservation properties of the model are taken into account, in order to ensure stability of the method for large time steps and simulation horizons. In the case of many layers, further efficiency can be gained by a layer reduction which is based on the vertical structure of fast and slow modes. Numerical experiments on the example of a mid-latitude regional ocean model confirm long term stability for time steps increased by an order of magnitude over the explicit CFL, while maintaining accuracy for key statistical quantities. △ Less

Submitted 23 August, 2019; v1 submitted 17 January, 2019; originally announced January 2019.

Affine approximation of parametrized kernels and model order reduction for nonlocal and fractional Laplace models

Authors: Olena Burkovska, Max Gunzburger

Abstract: We consider parametrized problems driven by spatially nonlocal integral operators with parameter-dependent kernels. In particular, kernels with varying nonlocal interaction radius $δ> 0$ and fractional Laplace kernels, parametrized by the fractional power $s\in(0,1)$, are studied. In order to provide an efficient and reliable approximation of the solution for different values of the parameters, we… ▽ More We consider parametrized problems driven by spatially nonlocal integral operators with parameter-dependent kernels. In particular, kernels with varying nonlocal interaction radius $δ> 0$ and fractional Laplace kernels, parametrized by the fractional power $s\in(0,1)$, are studied. In order to provide an efficient and reliable approximation of the solution for different values of the parameters, we develop the reduced basis method as a parametric model order reduction approach. Major difficulties arise since the kernels are not affine in the parameters, singular, and discontinuous. Moreover, the spatial regularity of the solutions depends on the varying fractional power $s$. To address this, we derive regularity and differentiability results with respect to $δ$ and $s$, which are of independent interest for other applications such as optimization and parameter identification. We then use these results to construct affine approximations of the kernels by local polynomials. Finally, we certify the method by providing reliable a posteriori error estimators, which account for all approximation errors, and support the theoretical findings by numerical experiments. △ Less

Submitted 30 September, 2019; v1 submitted 20 January, 2019; originally announced January 2019.

Nonintrusive Stabilization of Reduced Order Models for Uncertainty Quantification of Time-Dependent Convection-Dominated Flows

Authors: M. Gunzburger, T. Iliescu, M. Mohebujjaman, M. Schneier

Abstract: In this paper, we propose a nonintrusive filter-based stabilization of reduced order models (ROMs) for uncertainty quantification (UQ) of the time-dependent Navier-Stokes equations in convection-dominated regimes. We propose a novel high-order ROM differential filter and use it in conjunction with an evolve-filter-relax algorithm to attenuate the numerical oscillations of standard ROMs. We also ex… ▽ More In this paper, we propose a nonintrusive filter-based stabilization of reduced order models (ROMs) for uncertainty quantification (UQ) of the time-dependent Navier-Stokes equations in convection-dominated regimes. We propose a novel high-order ROM differential filter and use it in conjunction with an evolve-filter-relax algorithm to attenuate the numerical oscillations of standard ROMs. We also examine how stochastic collocation methods (SCMs) can be combined with the evolve-filter-relax algorithm for efficient UQ of fluid flows. We emphasize that the new stabilized SCM-ROM framework is nonintrusive and can be easily used in conjunction with legacy flow solvers. We test the new framework in the numerical simulation of a two-dimensional flow past a circular cylinder with a random viscosity that yields a random Reynolds number with mean $Re=100$. △ Less

Submitted 19 October, 2018; originally announced October 2018.

Comments: 22

MSC Class: 65M15; 65M60

Approximation of probability density functions for PDEs with random parameters using truncated series expansions

Authors: Giacomo Capodaglio, Max Gunzburger, Henry P. Wynn

Abstract: The probability density function (PDF) of a random variable associated with the solution of a partial differential equation (PDE) with random parameters is approximated using a truncated series expansion. The random PDE is solved using two stochastic finite element methods, Monte Carlo sampling and the stochastic Galerkin method with global polynomials. The random variable is a functional of the s… ▽ More The probability density function (PDF) of a random variable associated with the solution of a partial differential equation (PDE) with random parameters is approximated using a truncated series expansion. The random PDE is solved using two stochastic finite element methods, Monte Carlo sampling and the stochastic Galerkin method with global polynomials. The random variable is a functional of the solution of the random PDE, such as the average over the physical domain. The truncated series are obtained considering a finite number of terms in the Gram-Charlier or Edgeworth series expansions. These expansions approximate the PDF of a random variable in terms of another PDF, and involve coefficients that are functions of the known cumulants of the random variable. To the best of our knowledge, their use in the framework of PDEs with random parameters has not yet been explored. △ Less

Submitted 23 September, 2020; v1 submitted 1 October, 2018; originally announced October 2018.

A Localized Reduced-Order Modeling Approach for PDEs with Bifurcating Solutions

Authors: Martin Hess, Alessandro Alla, Annalisa Quaini, Gianluigi Rozza, Max Gunzburger

Abstract: Reduced-order modeling (ROM) commonly refers to the construction, based on a few solutions (referred to as snapshots) of an expensive discretized partial differential equation (PDE), and the subsequent application of low-dimensional discretizations of partial differential equations (PDEs) that can be used to more efficiently treat problems in control and optimization, uncertainty quantification, a… ▽ More Reduced-order modeling (ROM) commonly refers to the construction, based on a few solutions (referred to as snapshots) of an expensive discretized partial differential equation (PDE), and the subsequent application of low-dimensional discretizations of partial differential equations (PDEs) that can be used to more efficiently treat problems in control and optimization, uncertainty quantification, and other settings that require multiple approximate PDE solutions. In this work, a ROM is developed and tested for the treatment of nonlinear PDEs whose solutions bifurcate as input parameter values change. In such cases, the parameter domain can be subdivided into subregions, each of which corresponds to a different branch of solutions. Popular ROM approaches such as proper orthogonal decomposition (POD), results in a global low-dimensional basis that does no respect not take advantage of the often large differences in the PDE solutions corresponding to different subregions. Instead, in the new method, the k-means algorithm is used to cluster snapshots so that within cluster snapshots are similar to each other and are dissimilar to those in other clusters. This is followed by the construction of local POD bases, one for each cluster. The method also can detect which cluster a new parameter point belongs to, after which the local basis corresponding to that cluster is used to determine a ROM approximation. Numerical experiments show the effectiveness of the method both for problems for which bifurcation cause continuous and discontinuous changes in the solution of the PDE. △ Less

Submitted 23 July, 2018; originally announced July 2018.

Survey of multifidelity methods in uncertainty propagation, inference, and optimization

Authors: Benjamin Peherstorfer, Karen Willcox, Max Gunzburger

Abstract: In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a computationally expensive high-fidelity model describes the system with the accuracy required by the current application at hand, while lower-fidelity models are les… ▽ More In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a computationally expensive high-fidelity model describes the system with the accuracy required by the current application at hand, while lower-fidelity models are less accurate but computationally cheaper than the high-fidelity model. Outer-loop applications, such as optimization, inference, and uncertainty quantification, require multiple model evaluations at many different inputs, which often leads to computational demands that exceed available resources if only the high-fidelity model is used. This work surveys multifidelity methods that accelerate the solution of outer-loop applications by combining high-fidelity and low-fidelity model evaluations, where the low-fidelity evaluations arise from an explicit low-fidelity model (e.g., a simplified physics approximation, a reduced model, a data-fit surrogate, etc.) that approximates the same output quantity as the high-fidelity model. The overall premise of these multifidelity methods is that low-fidelity models are leveraged for speedup while the high-fidelity model is kept in the loop to establish accuracy and/or convergence guarantees. We categorize multifidelity methods according to three classes of strategies: adaptation, fusion, and filtering. The paper reviews multifidelity methods in the outer-loop contexts of uncertainty propagation, inference, and optimization. △ Less

Submitted 28 June, 2018; originally announced June 2018.

Comments: will appear in SIAM Review

MSC Class: 65-02; 62-02; 49-02

Regularity and approximation analyses of nonlocal variational equality and inequality problems

Authors: Olena Burkovska, Max Gunzburger

Abstract: We consider linear and obstacle problems driven by a nonlocal integral operator, for which nonlocal interactions are restricted to a ball of finite radius. These type of operators are used to model anomalous diffusion and, for a special choice of the integral kernels, reduce to the fractional Laplace operator on a bounded domain. By means of a nonlocal vector calculus we recast the problems in a w… ▽ More We consider linear and obstacle problems driven by a nonlocal integral operator, for which nonlocal interactions are restricted to a ball of finite radius. These type of operators are used to model anomalous diffusion and, for a special choice of the integral kernels, reduce to the fractional Laplace operator on a bounded domain. By means of a nonlocal vector calculus we recast the problems in a weak form, leading to corresponding nonlocal variational equality and inequality problems. We prove optimal regularity results for both problems, including a higher regularity of the solution and the Lagrange multiplier. Based on the regularity results, we analyze the convergence of finite element approximations for a linear problem and illustrate the theoretical findings by numerical results. △ Less

Submitted 26 April, 2018; originally announced April 2018.

Convergence of finite element solutions of stochastic partial integro-differential equations driven by white noise

Authors: Max Gunzburger, Buyang Li, Jilu Wang

Abstract: Numerical approximation of a stochastic partial integro-differential equation driven by a space- time white noise is studied by truncating a series representation of the noise, with finite element method for spatial discretization and convolution quadrature for time discretization. Sharp-order convergence of the numerical solutions is proved up to a logarithmic factor. Numerical examples are provi… ▽ More Numerical approximation of a stochastic partial integro-differential equation driven by a space- time white noise is studied by truncating a series representation of the noise, with finite element method for spatial discretization and convolution quadrature for time discretization. Sharp-order convergence of the numerical solutions is proved up to a logarithmic factor. Numerical examples are provided to support the theoretical analysis. △ Less

Submitted 6 November, 2017; originally announced November 2017.

A Leray regularized ensemble-proper orthogonal decomposition method for parameterized convection-dominated flows

Authors: Max Gunzburger, Traian Iliescu, Michael Schneier

Abstract: Partial differential equations (PDEs) are often dependent on input quantities which are inherently uncertain. To quantify this uncertainty, these PDEs must be solved over a large ensemble of parameters. Even for a single realization this can a computationally intensive process. In the case of flows governed by the Navier-Stokes equations, an efficient method has been devised for computing an ensem… ▽ More Partial differential equations (PDEs) are often dependent on input quantities which are inherently uncertain. To quantify this uncertainty, these PDEs must be solved over a large ensemble of parameters. Even for a single realization this can a computationally intensive process. In the case of flows governed by the Navier-Stokes equations, an efficient method has been devised for computing an ensemble of solutions. To further reduce the computational cost of this method, an ensemble proper orthogonal decomposition (POD) method was recently proposed. The main contribution of this work is the introduction of POD spatial filtering for ensemble-POD methods. The POD spatial filter makes possible the construction of the Leray ensemble-POD model, which is a regularized reduced order model for the numerical simulation of convection-dominated flows. The Leray ensemble-POD model employs the POD spatial filter to smooth (regularize) the convection term in the Navier-Stokes equations and greatly diminishes the numerical inaccuracies produced by the ensemble-POD method in the numerical simulation of convection-dominated flows. Specifically, for the numerical simulation of a convection-dominated two-dimensional flow between two offset cylinders, we show that the Leray ensemble-POD method yields accurate results, whereas the ensemble-POD is highly inaccurate. The second contribution of this work is a new numerical discretization of the variable viscosity ensemble algorithm in which the average viscosity is replaced with the maximum viscosity. It is shown that this new numerical discretization is significantly more stable than those in current use. Furthermore, error estimates for the novel Leray ensemble-POD algorithm with this new numerical discretization are also proven. △ Less

Submitted 23 October, 2017; v1 submitted 16 October, 2017; originally announced October 2017.

Comments: arXiv admin note: text overlap with arXiv:1709.06422

Optimally accurate higher-order finite element methods on polytopial approximations of domains with smooth boundaries

Authors: James Cheung, Mauro Perego, Pavel Bochev, Max Gunzburger

Abstract: Meshing of geometric domains having curved boundaries by affine simplices produces a polytopial approximation of those domains. The resulting error in the representation of the domain limits the accuracy of finite element methods based on such meshes. On the other hand, the simplicity of affine meshes makes them a desirable modeling tool in many applications. In this paper, we develop and analyze… ▽ More Meshing of geometric domains having curved boundaries by affine simplices produces a polytopial approximation of those domains. The resulting error in the representation of the domain limits the accuracy of finite element methods based on such meshes. On the other hand, the simplicity of affine meshes makes them a desirable modeling tool in many applications. In this paper, we develop and analyze higher-order accurate finite element methods that remain stable and optimally accurate on polytopial approximations of domains with smooth boundaries. This is achieved by constraining a judiciously chosen extension of the finite element solution on the polytopial domain to weakly match the prescribed boundary condition on the true geometric boundary. We provide numerical examples that highlight key properties of the new method and that illustrate the optimal $H^1$ and $L^2$-norm convergence rates. △ Less

Submitted 8 February, 2018; v1 submitted 16 October, 2017; originally announced October 2017.

Comments: Preprint submitted to Mathematics of Computation. 31 Pages

MSC Class: 65N30

A Coupling Approach for Linear Elasticity Problems with Spatially Noncoincident Interfaces

Authors: Pavel Bochev, James Cheung, Max Gunzburger, Mauro Perego

Abstract: We present a new formulation based on the classical Dirichlet-Neumann formulation for interface coupling problems in linearized elasticity. By using Taylor series expansions, we derive a new set of interface conditions that allow our formulation to pass the linear consistency test. In addition, we propose an iterative method to determine the solution of our formulation. We demonstrate in our numer… ▽ More We present a new formulation based on the classical Dirichlet-Neumann formulation for interface coupling problems in linearized elasticity. By using Taylor series expansions, we derive a new set of interface conditions that allow our formulation to pass the linear consistency test. In addition, we propose an iterative method to determine the solution of our formulation. We demonstrate in our numerical results that we may achieve the desired piecewise linear finite element error bounds for both nonoverlap** domain decomposition problems as well as for interface coupling problems where the Lamé parameters of the structures differ. △ Less

Submitted 5 October, 2017; originally announced October 2017.

An Optimally Convergent Coupling Approach for Interface Problems Approximated with Higher-Order Finite Elements

Authors: Pavel Bochev, James Cheung, Max Gunzburger, Mauro Perego

Abstract: In this paper, we present a new numerical method for determining the numerical solution of interface problems to optimal accuracy with respect to the polynomial order of the Lagrangian finite element space on polytopial meshes. We introduce the notion of a virtual interface, and on this virtual interface we enforce that "extended" interface conditions are satisfied in the sense of a Dirichlet--Neu… ▽ More In this paper, we present a new numerical method for determining the numerical solution of interface problems to optimal accuracy with respect to the polynomial order of the Lagrangian finite element space on polytopial meshes. We introduce the notion of a virtual interface, and on this virtual interface we enforce that "extended" interface conditions are satisfied in the sense of a Dirichlet--Neumann coupling. The virtual interface framework serves to bypass geometric variational crimes incurred by the classical finite element method. Further, this approach does not require that the geometric interfaces are spatially matching. Our analysis indicates that this approach is well--posed and optimally convergent in $H^1$. Numerical experiments indicate that optimal $H^1$ and $L^2$ convergence is achieved. △ Less

Submitted 12 March, 2018; v1 submitted 4 October, 2017; originally announced October 2017.

Comments: Third draft. Improved theoretical results

MSC Class: 65M60

An improved discrete least-squares/reduced-basis method for parameterized elliptic PDEs

Authors: Max Gunzburger, Michael Schneier, Clayton Webster, Guannan Zhang

Abstract: It is shown that the computational efficiency of the discrete least-squares (DLS) approximation of solutions of stochastic elliptic PDEs is improved by incorporating a reduced-basis method into the DLS framework. The goal is to recover the entire solution map from the parameter space to the finite element space. To this end, first, a reduced-basis solution using a weak greedy algorithm is construc… ▽ More It is shown that the computational efficiency of the discrete least-squares (DLS) approximation of solutions of stochastic elliptic PDEs is improved by incorporating a reduced-basis method into the DLS framework. The goal is to recover the entire solution map from the parameter space to the finite element space. To this end, first, a reduced-basis solution using a weak greedy algorithm is constructed, then a DLS approximation is determined by evaluating the reduced-basis approximation instead of the full finite element approximation. The main advantage of the new approach is that one only need apply the DLS operator to the coefficients of the reduced-basis expansion, resulting in huge savings in both the storage of the DLS coefficients and the online cost of evaluating the DLS approximation. In addition, the recently developed quasi-optimal polynomial space is also adopted in the new approach, resulting in superior convergence rates for a wider class of problems than previous analyzed. Numerical experiments are provided that illustrate the theoretical results. △ Less

Submitted 8 November, 2017; v1 submitted 3 October, 2017; originally announced October 2017.

Fast Spherical Centroidal Voronoi Mesh Generation: A Lloyd-preconditioned LBFGS Method in Parallel

Authors: Huanhuan Yang, Max Gunzburger, Lili Ju

Abstract: Centroidal Voronoi tessellation (CVT)-based mesh generation is a very effective technique for creating high-quality Voronoi meshes and their dual Delaunay triangulations that often play a crucial role in applications, including ocean and atmospheric simulations using finite volume schemes. In the next generation climate models, the spacing scales change dramatically across the whole sphere and req… ▽ More Centroidal Voronoi tessellation (CVT)-based mesh generation is a very effective technique for creating high-quality Voronoi meshes and their dual Delaunay triangulations that often play a crucial role in applications, including ocean and atmospheric simulations using finite volume schemes. In the next generation climate models, the spacing scales change dramatically across the whole sphere and require ultra-high resolution and smooth transitions from coarse to fine grid regions. Thus fast and robust spherical CVT (SCVT) meshing algorithms become highly desirable. In this paper, we first propose a Lloyd-preconditioned limited-memory BFGS method for constructing SCVTs that is also applicable to the construction of CVTs of general domains. This method is then parallelized based on overlap** domain decomposition, enabling excellent scalability on distributed systems. Results of several computational experiments show that the new method could incur computational time costs one order of magnitude smaller compared with some existing methods for generating large-scale highly variable-resolution meshes, while also providing significantly improvements in mesh quality. △ Less

Submitted 1 January, 2018; v1 submitted 20 September, 2017; originally announced September 2017.

A higher-order ensemble/proper orthogonal decomposition method for the nonstationary Navier-Stokes equations

Authors: Max Gunzburger, Nan Jiang, Michael Schneier

Abstract: Partial differential equations (PDE) often involve parameters, such as viscosity or density. An analysis of the PDE may involve considering a large range of parameter values, as occurs in uncertainty quantification, control and optimization, inference, and several statistical techniques. The solution for even a single case may be quite expensive; whereas parallel computing may be applied, this red… ▽ More Partial differential equations (PDE) often involve parameters, such as viscosity or density. An analysis of the PDE may involve considering a large range of parameter values, as occurs in uncertainty quantification, control and optimization, inference, and several statistical techniques. The solution for even a single case may be quite expensive; whereas parallel computing may be applied, this reduces the total elapsed time but not the total computational effort. In the case of flows governed by the Navier-Stokes equations, a method has been devised for computing an ensemble of solutions. Recently, a reduced-order model derived from a proper orthogonal decomposition (POD) approach was incorporated into a first-order accurate in time version of the ensemble algorithm. In this work, we expand on that work by incorporating the POD reduced order model into a second-order accurate ensemble algorithm. Stability and convergence results for this method are updated to account for the POD/ROM approach. Numerical experiments illustrate the accuracy and efficiency of the new approach. △ Less

Submitted 27 September, 2017; v1 submitted 15 September, 2017; originally announced September 2017.

Comments: arXiv admin note: text overlap with arXiv:1603.04777

A second-order time-step** scheme for simulating ensembles of parameterized flow problems

Authors: Max Gunzburger, Nan Jiang, Zhu Wang

Abstract: We consider settings for which one needs to perform multiple flow simulations based on the Navier-Stokes equations, each having different values for the physical parameters and/or different initial condition data, boundary conditions data, and/or forcing functions. For such settings, we propose a second-order time accurate ensemble-based method that to simulate the whole set of solutions, requires… ▽ More We consider settings for which one needs to perform multiple flow simulations based on the Navier-Stokes equations, each having different values for the physical parameters and/or different initial condition data, boundary conditions data, and/or forcing functions. For such settings, we propose a second-order time accurate ensemble-based method that to simulate the whole set of solutions, requires, at each time step, the solution of only a single linear system with multiple right-hand-side vectors. Rigorous analyses are given proving the conditional stability and error estimates for the proposed algorithm. Numerical experiments are provided that illustrate the analyses. △ Less

Submitted 9 June, 2017; originally announced June 2017.

Comments: arXiv admin note: text overlap with arXiv:1705.09350

An efficient algorithm for simulating ensembles of parameterized flow problems

Authors: Max Gunzburger, Nan Jiang, Zhu Wang

Abstract: Many applications of computational fluid dynamics require multiple simulations of a flow under different input conditions. In this paper, a numerical algorithm is developed to efficiently determine a set of such simulations in which the individually independent members of the set are subject to different viscosity coefficients, initial conditions, and/or body forces. The proposed scheme applied to… ▽ More Many applications of computational fluid dynamics require multiple simulations of a flow under different input conditions. In this paper, a numerical algorithm is developed to efficiently determine a set of such simulations in which the individually independent members of the set are subject to different viscosity coefficients, initial conditions, and/or body forces. The proposed scheme applied to the flow ensemble leads to need to solve a single linear system with multiple right-hand sides, and thus is computationally more efficient than solving for all the simulations separately. We show that the scheme is nonlinearly and long-term stable under certain conditions on the time-step size and a parameter deviation ratio. Rigorous numerical error estimate shows the scheme is of first-order accuracy in time and optimally accurate in space. Several numerical experiments are presented to illustrate the theoretical results. △ Less

Submitted 25 May, 2017; originally announced May 2017.

Comments: 20 pages, 3 figures

Sharp convergence rates of time discretization for stochastic time-fractional PDEs subject to additive space-time white noise

Authors: Max Gunzburger, Buyang Li, Jilu Wang

Abstract: The stochastic time-fractional equation $\partial_t ψ-Δ\partial_t^{1-α} ψ= f + \dot W$ with space-time white noise $\dot W$ is discretized in time by a backward-Euler convolution quadrature for which the sharp-order error estimate \[ {\mathbb E}\|ψ(\cdot,t_n)-ψ_n\|_{L^2(\mathcal{O})}^2=O(τ^{1-αd/2}) \] is established for $α\in(0,2/d)$, where $d$ denotes the spatial dimension, $ψ_n$ the approximate… ▽ More The stochastic time-fractional equation $\partial_t ψ-Δ\partial_t^{1-α} ψ= f + \dot W$ with space-time white noise $\dot W$ is discretized in time by a backward-Euler convolution quadrature for which the sharp-order error estimate \[ {\mathbb E}\|ψ(\cdot,t_n)-ψ_n\|_{L^2(\mathcal{O})}^2=O(τ^{1-αd/2}) \] is established for $α\in(0,2/d)$, where $d$ denotes the spatial dimension, $ψ_n$ the approximate solution at the $n^{\rm th}$ time step, and $\mathbb{E}$ the expectation operator. In particular, the result indicates optimal convergence rates of numerical solutions for both stochastic subdiffusion and diffusion-wave problems in one spatial dimension. Numerical examples are presented to illustrate the theoretical analysis. △ Less

Submitted 8 August, 2018; v1 submitted 10 April, 2017; originally announced April 2017.

Analysis and approximation of a fractional Laplacian-based closure model for turbulent flows and its connection to Richardson pair dispersion

Authors: Max Gunzburger, Nan Jiang, Feifei Xu

Abstract: We study a turbulence closure model in which the fractional Laplacian $(-Δ)^α$ of the velocity field represents the turbulence diffusivity. We investigate the energy spectrum of the model by applying Pao's energy transfer theory. For the case $α=1/3$, the corresponding power law of the energy spectrum in the inertial range has a correction exponent on the regular Kolmogorov -5/3 scaling exponent.… ▽ More We study a turbulence closure model in which the fractional Laplacian $(-Δ)^α$ of the velocity field represents the turbulence diffusivity. We investigate the energy spectrum of the model by applying Pao's energy transfer theory. For the case $α=1/3$, the corresponding power law of the energy spectrum in the inertial range has a correction exponent on the regular Kolmogorov -5/3 scaling exponent. For this case, this model represents Richardson's particle pair-distance superdiffusion of a fully developed homogeneous turbulent flow as well as Lévy jumps that lead to the superdiffusion. For other values of $α$, the power law of the energy spectrum is consistent with the regular Kolmogorov -5/3 scaling exponent. We also propose and study a modular time-step** algorithm in semi-discretized form. The algorithm is minimally intrusive to a given legacy code for solving Navier-Stokes equations by decoupling the local part and nonlocal part of the equations for the unknowns. We prove the algorithm is unconditionally stable and unconditionally, first-order convergent. We also derive error estimates for full discretizations of the model which, in addition to the time step** algorithm, involves a finite element spatial discretization and a domain truncation approximation to the range of the fractional Laplacian. △ Less

Submitted 15 November, 2016; originally announced November 2016.

Algorithms and analyses for stochastic optimization for turbofan noise reduction using parallel reduced-order modeling

Authors: Huanhuan Yang, Max Gunzburger

Abstract: Simulation-based optimization of acoustic liner design in a turbofan engine nacelle for noise reduction purposes can dramatically reduce the cost and time needed for experimental designs. Because uncertainties are inevitable in the design process, a stochastic optimization algorithm is posed based on the conditional value-at-risk measure so that an ideal acoustic liner impedance is determined that… ▽ More Simulation-based optimization of acoustic liner design in a turbofan engine nacelle for noise reduction purposes can dramatically reduce the cost and time needed for experimental designs. Because uncertainties are inevitable in the design process, a stochastic optimization algorithm is posed based on the conditional value-at-risk measure so that an ideal acoustic liner impedance is determined that is robust in the presence of uncertainties. A parallel reduced-order modeling framework is developed that dramatically improves the computational efficiency of the stochastic optimization solver for a realistic nacelle geometry. The reduced stochastic optimization solver takes less than 500 seconds to execute. In addition, well-posedness and finite element error analyses of the state system and optimization problem are provided. △ Less

Submitted 2 November, 2016; originally announced November 2016.

Research and Education in Computational Science and Engineering

Authors: Ulrich Rüde, Karen Willcox, Lois Curfman McInnes, Hans De Sterck, George Biros, Hans Bungartz, James Corones, Evin Cramer, James Crowley, Omar Ghattas, Max Gunzburger, Michael Hanke, Robert Harrison, Michael Heroux, Jan Hesthaven, Peter Jimack, Chris Johnson, Kirk E. Jordan, David E. Keyes, Rolf Krause, Vipin Kumar, Stefan Mayer, Juan Meza, Knut Martin Mørken, J. Tinsley Oden , et al. (8 additional authors not shown)

Abstract: Over the past two decades the field of computational science and engineering (CSE) has penetrated both basic and applied research in academia, industry, and laboratories to advance discovery, optimize systems, support decision-makers, and educate the scientific and engineering workforce. Informed by centuries of theory and experiment, CSE performs computational experiments to answer questions that… ▽ More Over the past two decades the field of computational science and engineering (CSE) has penetrated both basic and applied research in academia, industry, and laboratories to advance discovery, optimize systems, support decision-makers, and educate the scientific and engineering workforce. Informed by centuries of theory and experiment, CSE performs computational experiments to answer questions that neither theory nor experiment alone is equipped to answer. CSE provides scientists and engineers of all persuasions with algorithmic inventions and software systems that transcend disciplines and scales. Carried on a wave of digital technology, CSE brings the power of parallelism to bear on troves of data. Mathematics-based advanced computing has become a prevalent means of discovery and innovation in essentially all areas of science, engineering, technology, and society; and the CSE community is at the core of this transformation. However, a combination of disruptive developments---including the architectural complexity of extreme-scale computing, the data revolution that engulfs the planet, and the specialization required to follow the applications to new frontiers---is redefining the scope and reach of the CSE endeavor. This report describes the rapid expansion of CSE and the challenges to sustaining its bold advances. The report also presents strategies and directions for CSE research and education for the next decade. △ Less

Submitted 31 December, 2017; v1 submitted 8 October, 2016; originally announced October 2016.

Comments: Major revision, to appear in SIAM Review

Report number: Argonne National Laboratory Preprint ANL/MCS-P6054-0916 MSC Class: 00A72; 62-07; 68U20; 68W01; 68W10; 97A99; 97M10; 97N80; 97R20; 97R30 ACM Class: G.0; G.4; I.6; J.0; J.2; J.3; J.4; J.6; J.7; K.3.2

An Ensemble-Proper Orthogonal Decomposition Method for the Nonstationary Navier-Stokes Equations

Authors: Max Gunzburger, Nan Jiang, Michael Schneier

Abstract: The definition of partial differential equation (PDE) models usually involves a set of parameters whose values may vary over a wide range. The solution of even a single set of parameter values may be quite expensive. In many cases, e.g., optimization, control, uncertainty quantification, and other settings, solutions are needed for many sets of parameter values. We consider the case of the time-de… ▽ More The definition of partial differential equation (PDE) models usually involves a set of parameters whose values may vary over a wide range. The solution of even a single set of parameter values may be quite expensive. In many cases, e.g., optimization, control, uncertainty quantification, and other settings, solutions are needed for many sets of parameter values. We consider the case of the time-dependent Navier-Stokes equations for which a recently developed ensemble-based method allows for the efficient determination of the multiple solutions corresponding to many parameter sets. The method uses the average of the multiple solutions at any time step to define a linear set of equations that determines the solutions at the next time step. To significantly further reduce the costs of determining multiple solutions of the Navier-Stokes equations, we incorporate a proper orthogonal decomposition (POD) reduced-order model into the ensemble-based method. The stability and convergence results for the ensemble-based method are extended to the ensemble-POD approach. Numerical experiments are provided that illustrate the accuracy and efficiency of computations determined using the new approach. △ Less

Submitted 15 November, 2016; v1 submitted 15 March, 2016; originally announced March 2016.

Numerical Methods for a Class of Nonlocal Diffusion Problems with the Use of Backward SDEs

Authors: Guannan Zhang, Weidong Zhao, Clayton Webster, Max Gunzburger

Abstract: We propose a novel numerical approach for nonlocal diffusion equations [8] with integrable kernels, based on the relationship between the backward Kolmogorov equation and backward stochastic differential equations (BSDEs) driven by Lèvy processes with jumps. The nonlocal diffusion problem under consideration is converted to a BSDE,for which numerical schemes are developed and applied directly. As… ▽ More We propose a novel numerical approach for nonlocal diffusion equations [8] with integrable kernels, based on the relationship between the backward Kolmogorov equation and backward stochastic differential equations (BSDEs) driven by Lèvy processes with jumps. The nonlocal diffusion problem under consideration is converted to a BSDE,for which numerical schemes are developed and applied directly. As a stochastic approach, the proposed method does not require the solution of linear systems, which allows for embarrassingly parallel implementations and also enables adaptive approximation techniques to be incorporated in a straightforward fashion. Moreover, our method is more accurate than classic stochastic approaches due to the use of high-order temporal and spatial discretization schemes. In addition, our approach can handle a broad class of problems with general nonlinear forcing terms as long as they are globally Lipchitz continuous. Rigorous error analysis of the new method is provided as several numerical examples that illustrate the effectiveness and efficiency of the proposed approach. △ Less

Submitted 27 July, 2015; v1 submitted 28 February, 2015; originally announced March 2015.

Peridynamics and Material Interfaces

Authors: Bacim Alali, Max Gunzburger

Abstract: The convergence of a peridynamic model for solid mechanics inside heterogeneous media in the limit of vanishing nonlocality is analyzed. It is shown that the operator of linear peridynamics for an isotropic heterogeneous medium converges to the corresponding operator of linear elasticity when the material properties are sufficiently regular. On the other hand, when the material properties are disc… ▽ More The convergence of a peridynamic model for solid mechanics inside heterogeneous media in the limit of vanishing nonlocality is analyzed. It is shown that the operator of linear peridynamics for an isotropic heterogeneous medium converges to the corresponding operator of linear elasticity when the material properties are sufficiently regular. On the other hand, when the material properties are discontinuous, i.e., when material interfaces are present, it is shown that the operator of linear peridynamics diverges, in the limit of vanishing nonlocality, at material interfaces. Nonlocal interface conditions, whose local limit implies the classical interface conditions of elasticity, are then developed and discussed. A peridynamics material interface model is introduced which generalizes the classical interface model of elasticity. The model consists of a new peridynamics operator along with nonlocal interface conditions. The new peridynamics interface model converges to the classical interface model of linear elasticity. △ Less

Submitted 23 November, 2014; originally announced November 2014.

Power-Law Noises over General Spatial Domains and on Non-Standard Meshes

Authors: Hans-Werner van Wyk, Max Gunzburger, John Burkardt, Miroslav Stoyanov

Abstract: Power-law noises abound in nature and have been observed extensively in both time series and spatially varying environmental parameters. Although, recent years have seen the extension of traditional stochastic partial differential equations to include systems driven by fractional Brownian motion, spatially distributed scale-invariance has received comparatively little attention, especially for par… ▽ More Power-law noises abound in nature and have been observed extensively in both time series and spatially varying environmental parameters. Although, recent years have seen the extension of traditional stochastic partial differential equations to include systems driven by fractional Brownian motion, spatially distributed scale-invariance has received comparatively little attention, especially for parameters defined over non-standard spatial domains. This paper discusses the generalization of power-law noises to general spatial domains by outlining their theoretical underpinnings as well as addressing their numerical simulation on arbitrary meshes. Three computational algorithms are presented for efficiently generating their sample paths, accompanied by numerous numerical illustrations. △ Less

Submitted 17 October, 2014; originally announced October 2014.

MSC Class: 65C02; 60G60

Optimal Point Sets for Total Degree Polynomial Interpolation in Moderate Dimensions

Authors: Max Gunzburger, Aretha L Teckentrup

Abstract: This paper is concerned with Lagrange interpolation by total degree polynomials in moderate dimensions. In particular, we are interested in characterising the optimal choice of points for the interpolation problem, where we define the optimal interpolation points as those which minimise the Lebesgue constant. We give a novel algorithm for numerically computing the location of the optimal points, w… ▽ More This paper is concerned with Lagrange interpolation by total degree polynomials in moderate dimensions. In particular, we are interested in characterising the optimal choice of points for the interpolation problem, where we define the optimal interpolation points as those which minimise the Lebesgue constant. We give a novel algorithm for numerically computing the location of the optimal points, which is independent of the shape of the domain and does not require computations with Vandermonde matrices. We perform a numerical study of the growth of the minimal Lebesgue constant with respect to the degree of the polynomials and the dimension, and report the lowest values known as yet of the Lebesgue constant in the unit cube and the unit ball in up to 10 dimensions. △ Less

Submitted 11 July, 2014; originally announced July 2014.

A Multilevel Stochastic Collocation Method for Partial Differential Equations with Random Input Data

Authors: Aretha L. Teckentrup, Peter Jantsch, Clayton G. Webster, Max Gunzburger

Abstract: Stochastic collocation methods for approximating the solution of partial differential equations with random input data (e.g., coefficients and forcing terms) suffer from the curse of dimensionality whereby increases in the stochastic dimension cause an explosion of the computational effort. We propose and analyze a multilevel version of the stochastic collocation method that, as is the case for mu… ▽ More Stochastic collocation methods for approximating the solution of partial differential equations with random input data (e.g., coefficients and forcing terms) suffer from the curse of dimensionality whereby increases in the stochastic dimension cause an explosion of the computational effort. We propose and analyze a multilevel version of the stochastic collocation method that, as is the case for multilevel Monte Carlo (MLMC) methods, uses hierarchies of spatial approximations to reduce the overall computational complexity. In addition, our proposed approach utilizes, for approximation in stochastic space, a sequence of multi-dimensional interpolants of increasing fidelity which can then be used for approximating statistics of the solution as well as for building high-order surrogates featuring faster convergence rates. A rigorous convergence and computational cost analysis of the new multilevel stochastic collocation method is provided, demonstrating its advantages compared to standard single-level stochastic collocation approximations as well as MLMC methods. Numerical results are provided that illustrate the theory and the effectiveness of the new multilevel method. △ Less

Submitted 22 May, 2014; v1 submitted 9 April, 2014; originally announced April 2014.

A Generalized Nonlocal Calculus with Application to the Peridynamics Model for Solid Mechanics

Authors: Bacim Alali, Kuo Liu, Max Gunzburger

Abstract: A nonlocal vector calculus was introduced in [2] that has proved useful for the analysis of the peridynamics model of nonlocal mechanics and nonlocal diffusion models. A generalization is developed that provides a more general setting for the nonlocal vector calculus that is independent of particular nonlocal models. It is shown that general nonlocal calculus operators are integral operators with… ▽ More A nonlocal vector calculus was introduced in [2] that has proved useful for the analysis of the peridynamics model of nonlocal mechanics and nonlocal diffusion models. A generalization is developed that provides a more general setting for the nonlocal vector calculus that is independent of particular nonlocal models. It is shown that general nonlocal calculus operators are integral operators with specific integral kernels. General nonlocal calculus properties are developed, including nonlocal integration by parts formula and Green's identities. The nonlocal vector calculus introduced in [2] is shown to be recoverable from the general formulation as a special example. This special nonlocal vector calculus is used to reformulate the peridynamics equation of motion in terms of the nonlocal gradient operator and its adjoint. A new example of nonlocal vector calculus operators is introduced, which shows the potential use of the general formulation for general nonlocal models. △ Less

Submitted 2 February, 2014; originally announced February 2014.

Identification of the diffusion parameter in nonlocal steady diffusion problems

Authors: Marta D'Elia, Max Gunzburger

Abstract: The problem of identifying the diffusion parameter appearing in a nonlocal steady diffusion equation is considered. The identification problem is formulated as an optimal control problem having a matching functional as the objective of the control and the parameter function as the control variable. The analysis makes use of a nonlocal vector calculus that allows one to define a variational formula… ▽ More The problem of identifying the diffusion parameter appearing in a nonlocal steady diffusion equation is considered. The identification problem is formulated as an optimal control problem having a matching functional as the objective of the control and the parameter function as the control variable. The analysis makes use of a nonlocal vector calculus that allows one to define a variational formulation of the nonlocal problem. In a manner analogous to the local partial differential equations counterpart, we demonstrate, for certain kernel functions, the existence of at least one optimal solution in the space of admissible parameters. We introduce a Galerkin finite element discretization of the optimal control problem and derive a priori error estimates for the approximate state and control variables. Using one-dimensional numerical experiments, we illustrate the theoretical results and show that by using nonlocal models it is possible to estimate non-smooth and discontinuous diffusion parameters. △ Less

Submitted 31 January, 2015; v1 submitted 9 October, 2013; originally announced October 2013.

Comments: 22 pages, 7 figures

MSC Class: 26A33; 34A08; 34B10; 35A15; 45A05; 76R51; 93E99

The fractional Laplacian operator on bounded domains as a special case of the nonlocal diffusion operator

Authors: Marta D'Elia, Max Gunzburger

Abstract: We analyze a nonlocal diffusion operator having as special cases the fractional Laplacian and fractional differential operators that arise in several applications. In our analysis, a nonlocal vector calculus is exploited to define a weak formulation of the nonlocal problem. We demonstrate that, when sufficient conditions on certain kernel functions hold, the solution of the nonlocal equation conve… ▽ More We analyze a nonlocal diffusion operator having as special cases the fractional Laplacian and fractional differential operators that arise in several applications. In our analysis, a nonlocal vector calculus is exploited to define a weak formulation of the nonlocal problem. We demonstrate that, when sufficient conditions on certain kernel functions hold, the solution of the nonlocal equation converges to the solution of the fractional Laplacian equation on bounded domains as the nonlocal interactions become infinite. We also introduce a continuous Galerkin finite element discretization of the nonlocal weak formulation and we derive a priori error estimates. Through several numerical examples we illustrate the theoretical results and we show that by solving the nonlocal problem it is possible to obtain accurate approximations of the solutions of fractional differential equations circumventing the problem of treating infinite-volume constraints. △ Less

Submitted 27 March, 2013; originally announced March 2013.

Comments: 27 pages, 5 figures

MSC Class: 34B10; 26A33; 34A08; 35A15; 45A05; 45K05; 60G22; 76R50

Efficient and Long-Time Accurate Second-Order Methods for Stokes-Darcy System

Authors: Wenbin Chen, Max Gunzburger, Dong Sun, Xiaoming Wang

Abstract: We propose and study two second-order in time implicit-explicit (IMEX) methods for the coupled Stokes-Darcy system that governs flows in karst aquifers. The first is a combination of a second-order backward differentiation formula and the second-order Gear's extrapolation approach. The second is a combination of the second-order Adams-Moulton and second-order Adams-Bashforth methods. Both algorith… ▽ More We propose and study two second-order in time implicit-explicit (IMEX) methods for the coupled Stokes-Darcy system that governs flows in karst aquifers. The first is a combination of a second-order backward differentiation formula and the second-order Gear's extrapolation approach. The second is a combination of the second-order Adams-Moulton and second-order Adams-Bashforth methods. Both algorithms only require the solution of two decoupled problems at each time step, one Stokes and the other Darcy. Hence, these schemes are very efficient and can be easily implemented using legacy codes. We establish the unconditional and uniform in time stability for both schemes. The uniform in time stability leads to uniform in time control of the error which is highly desirable for modeling physical processes, e.g., contaminant sequestration and release, that occur over very long time scales. Error estimates for fully-discretized schemes using finite element spatial discretizations are derived. Numerical examples are provided that illustrate the accuracy, efficiency, and long-time stability of the two schemes. △ Less

Submitted 2 November, 2012; originally announced November 2012.

MSC Class: 35M13; 35Q35; 65N30; 65N55; 76D07; 76S05

Goal-oriented A Posteriori Error Estimation for Finite Volume Methods

Authors: Qingshan Chen, Max Gunzburger

Abstract: A general framework for goal-oriented a posteriori error estimation for finite volume methods is presented. The framework does not rely on recasting finite volume methods as special cases of finite element methods, but instead directly determines error estimators from the discretized finite volume equations. Thus, the framework can be ap- plied to arbitrary finite volume methods. It also provides… ▽ More A general framework for goal-oriented a posteriori error estimation for finite volume methods is presented. The framework does not rely on recasting finite volume methods as special cases of finite element methods, but instead directly determines error estimators from the discretized finite volume equations. Thus, the framework can be ap- plied to arbitrary finite volume methods. It also provides the proper functional settings to address well-posedness issues for the primal and adjoint problems. Numerical results are presented to illustrate the validity and effectiveness of the a posteriori error estimates and their applicability to adaptive mesh refinement. △ Less

Submitted 23 August, 2011; v1 submitted 1 November, 2010; originally announced November 2010.

MSC Class: 65M08; 65M50; 65M99; 35Q86

Partial and spectral-viscosity models for geophysical flows

Authors: Qingshan Chen, Max Gunzburger, Xiaoming Wang

Abstract: Two models based on the hydrostatic primitive equa- tions are proposed. The first model is the primitive equations with partial viscosity only, and is oriented towards large-scale wave structures in the ocean and atmosphere. The second model is the viscous primitive equations with spectral eddy viscosity, and is oriented towards turbulent geophysical flows. For both models, the existence and uniqu… ▽ More Two models based on the hydrostatic primitive equa- tions are proposed. The first model is the primitive equations with partial viscosity only, and is oriented towards large-scale wave structures in the ocean and atmosphere. The second model is the viscous primitive equations with spectral eddy viscosity, and is oriented towards turbulent geophysical flows. For both models, the existence and uniqueness of global strong solutions is estab- lished. For the second model, the convergence of the solutions to the solutions of the classical primitive equations as eddy viscosity parameters tend to zero is also established. △ Less

Submitted 20 October, 2010; v1 submitted 18 October, 2010; originally announced October 2010.

Comments: The original publication is available at http://www.springerlink.com

MSC Class: 35Q86; 76D03; 76D33; 76F65

Journal ref: Chinese Annals of Mathematics - Series B, 31:579-606, 2010