-
Approximating a branch of solutions to the Navier--Stokes equations by reduced-order modeling
Authors:
Maxim A. Olshanskii,
Leo G. Rebholz
Abstract:
This paper extends a low-rank tensor decomposition (LRTD) reduced order model (ROM) methodology to simulate viscous flows and in particular to predict a smooth branch of solutions for the incompressible Navier-Stokes equations. Additionally, it enhances the LRTD-ROM methodology by introducing a non-interpolatory variant, which demonstrates improved accuracy compared to the interpolatory method uti…
▽ More
This paper extends a low-rank tensor decomposition (LRTD) reduced order model (ROM) methodology to simulate viscous flows and in particular to predict a smooth branch of solutions for the incompressible Navier-Stokes equations. Additionally, it enhances the LRTD-ROM methodology by introducing a non-interpolatory variant, which demonstrates improved accuracy compared to the interpolatory method utilized in previous LRTD-ROM studies. After presenting both the interpolatory and non-interpolatory LRTD-ROM, we demonstrate that with snapshots from a few different viscosities, the proposed method is able to accurately predict flow statistics in the Reynolds number range $[25,400]$. This is a significantly wider and higher range than state of the art (and similar size) ROMs built for use on varying Reynolds number have been successful on. The paper also discusses how LRTD may offer new insights into the properties of parametric solutions.
△ Less
Submitted 6 May, 2024;
originally announced May 2024.
-
Local conservation laws of continuous Galerkin method for the incompressible Navier--Stokes equations in EMAC form
Authors:
Maxim A. Olshanskii,
Leo G. Rebholz
Abstract:
We consider {\it local} balances of momentum and angular momentum for the incompressible Navier-Stokes equations. First, we formulate new weak forms of the physical balances (conservation laws) of these quantities, and prove they are equivalent to the usual conservation law formulations. We then show that continuous Galerkin discretizations of the Navier-Stokes equations using the EMAC form of the…
▽ More
We consider {\it local} balances of momentum and angular momentum for the incompressible Navier-Stokes equations. First, we formulate new weak forms of the physical balances (conservation laws) of these quantities, and prove they are equivalent to the usual conservation law formulations. We then show that continuous Galerkin discretizations of the Navier-Stokes equations using the EMAC form of the nonlinearity preserve discrete analogues of the weak form conservation laws, both in the Eulerian formulation and the Lagrangian formulation (which are not equivalent after discretizations). Numerical tests illustrate the new theory.
△ Less
Submitted 11 September, 2023;
originally announced September 2023.
-
Accelerating and enabling convergence of nonlinear solvers for Navier-Stokes equations by continuous data assimilation
Authors:
Xuejian Li,
Elizabeth V. Hawkins,
Leo G. Rebholz,
Duygu Vargun
Abstract:
This paper considers improving the Picard and Newton iterative solvers for the Navier-Stokes equations in the setting where data measurements or solution observations are available. We construct adapted iterations that use continuous data assimilation (CDA) style nudging to incorporate the known solution data into the solvers. For CDA-Picard, we prove the method has an improved convergence rate co…
▽ More
This paper considers improving the Picard and Newton iterative solvers for the Navier-Stokes equations in the setting where data measurements or solution observations are available. We construct adapted iterations that use continuous data assimilation (CDA) style nudging to incorporate the known solution data into the solvers. For CDA-Picard, we prove the method has an improved convergence rate compared to usual Picard, and the rate improves as more measurement data is incorporated. We also prove that CDA-Picard is contractive for larger Reynolds numbers than usual Picard, and the more measurement data that is incorporated the larger the Reynolds number can be with CDA-Picard still being contractive. For CDA-Newton, we prove that the domain of convergence, with respect to both the initial guess and the Reynolds number, increases as the amount of measurement data is increased. Additionally, for both methods we show that CDA can be implemented as direct enforcement of measurement data into the solution. Numerical results for common benchmark Navier-Stokes tests illustrate the theory.
△ Less
Submitted 24 July, 2023; v1 submitted 1 June, 2023;
originally announced June 2023.
-
Removing splitting/modeling error in projection/penalty methods for Navier-Stokes simulations with continuous data assimilation
Authors:
Elizabeth Hawkins,
Leo G. Rebholz,
Duygu Vargun
Abstract:
We study continuous data assimilation (CDA) applied to projection and penalty methods for the Navier-Stokes (NS) equations. Penalty and projection methods are more efficient than consistent NS discretizations, however are less accurate due to modeling error (penalty) and splitting error (projection). We show analytically and numerically that with measurement data and properly chosen parameters, CD…
▽ More
We study continuous data assimilation (CDA) applied to projection and penalty methods for the Navier-Stokes (NS) equations. Penalty and projection methods are more efficient than consistent NS discretizations, however are less accurate due to modeling error (penalty) and splitting error (projection). We show analytically and numerically that with measurement data and properly chosen parameters, CDA can effectively remove these splitting and modeling errors and provide long time optimally accurate solutions.
△ Less
Submitted 12 February, 2023;
originally announced February 2023.
-
Filtering for Anderson acceleration
Authors:
Sara Pollock,
Leo G. Rebholz
Abstract:
This work introduces, analyzes and demonstrates an efficient and theoretically sound filtering strategy to ensure the condition of the least-squares problem solved at each iteration of Anderson acceleration. The filtering strategy consists of two steps: the first controls the length disparity between columns of the least-squares matrix, and the second enforces a lower bound on the angles between s…
▽ More
This work introduces, analyzes and demonstrates an efficient and theoretically sound filtering strategy to ensure the condition of the least-squares problem solved at each iteration of Anderson acceleration. The filtering strategy consists of two steps: the first controls the length disparity between columns of the least-squares matrix, and the second enforces a lower bound on the angles between subspaces spanned by the columns of that matrix. The combined strategy is shown to control the condition number of the least-squares matrix at each iteration. The method is shown to be effective on a range of problems based on discretizations of partial differential equations. It is shown particularly effective for problems where the initial iterate may lie far from the solution, and which progress through distinct preasymptotic and asymptotic phases.
△ Less
Submitted 23 February, 2023; v1 submitted 23 November, 2022;
originally announced November 2022.
-
Improved convergence of the Arrow-Hurwicz iteration for the Navier-Stokes equation via grad-div stabilization and Anderson acceleration
Authors:
Pelin G. Geredeli,
Leo G. Rebholz,
Duygu Vargun,
Ahmed Zytoon
Abstract:
We consider two modifications of the Arrow-Hurwicz (AH) iteration for solving the incompressible steady Navier-Stokes equations for the purpose of accelerating the algorithm: grad-div stabilization, and Anderson acceleration. AH is a classical iteration for general saddle point linear systems and it was later extended to Navier-Stokes iterations in the 1970's which has recently come under study ag…
▽ More
We consider two modifications of the Arrow-Hurwicz (AH) iteration for solving the incompressible steady Navier-Stokes equations for the purpose of accelerating the algorithm: grad-div stabilization, and Anderson acceleration. AH is a classical iteration for general saddle point linear systems and it was later extended to Navier-Stokes iterations in the 1970's which has recently come under study again. We apply recently developed ideas for grad-div stabilization and divergence-free finite element methods along with Anderson acceleration of fixed point iterations to AH in order to improve its convergence. Analytical and numerical results show that each of these methods improves AH convergence, but the combination of them yields an efficient and effective method that is competitive with more commonly used solvers.
△ Less
Submitted 3 March, 2022;
originally announced March 2022.
-
Full and Reduced Order Model Consistency of the Nonlinearity Discretization in Incompressible Flows
Authors:
Sean Ingimarson,
Leo G. Rebholz,
Traian Iliescu
Abstract:
We investigate both theoretically and numerically the consistency between the nonlinear discretization in full order models (FOMs) and reduced order models (ROMs) for incompressible flows. To this end, we consider two cases: (i) FOM-ROM consistency, i.e., when we use the same nonlinearity discretization in the FOM and ROM; and (ii) FOM-ROM inconsistency, i.e., when we use different nonlinearity di…
▽ More
We investigate both theoretically and numerically the consistency between the nonlinear discretization in full order models (FOMs) and reduced order models (ROMs) for incompressible flows. To this end, we consider two cases: (i) FOM-ROM consistency, i.e., when we use the same nonlinearity discretization in the FOM and ROM; and (ii) FOM-ROM inconsistency, i.e., when we use different nonlinearity discretizations in the FOM and ROM. Analytically, we prove that while the FOM-ROM consistency yields optimal error bounds, FOM-ROM inconsistency yields additional terms dependent on the FOM divergence error, which prevent the ROM from recovering the FOM as the number of modes increases. Computationally, we consider channel flow around a cylinder and Kelvin-Helmholtz instability, and show that FOM-ROM consistency yields significantly more accurate results than FOM-ROM inconsistency.
△ Less
Submitted 6 September, 2022; v1 submitted 12 November, 2021;
originally announced November 2021.
-
Anderson acceleration for a regularized Bingham model
Authors:
Sara Pollock,
Leo G. Rebholz,
Duygu Vargun
Abstract:
This paper studies a finite element discretization of the regularized Bingham equations that describe viscoplastic flow. An efficient nonlinear solver for the discrete model is then proposed and analyzed. The solver is based on Anderson acceleration (AA) applied to a Picard iteration, and we show accelerated convergence of the method by applying AA theory (recently developed by the authors) to the…
▽ More
This paper studies a finite element discretization of the regularized Bingham equations that describe viscoplastic flow. An efficient nonlinear solver for the discrete model is then proposed and analyzed. The solver is based on Anderson acceleration (AA) applied to a Picard iteration, and we show accelerated convergence of the method by applying AA theory (recently developed by the authors) to the iteration, after showing sufficient smoothness properties of the associated fixed point operator. Numerical tests of spatial convergence are provided, as are results of the model for 2D and 3D driven cavity simulations. For each numerical test, the proposed nonlinear solver is also tested and shown to be very effective and robust with respect to the regularization parameter as it goes to zero.
△ Less
Submitted 7 December, 2022; v1 submitted 19 August, 2021;
originally announced August 2021.
-
An efficient algorithm for simulating ensembles of parameterized MHD flow problems
Authors:
Muhammad Mohebujjaman,
Hongwei Wang,
Leo G. Rebholz,
Md. Abdullah Al Mahbub
Abstract:
In this paper, we propose, analyze, and test an efficient algorithm for computing ensemble average of incompressible magnetohydrodynamics (MHD) flows, where instances/members correspond to varying kinematic viscosity, magnetic diffusivity, body forces, and initial conditions. The algorithm is decoupled in Elsässer variables and permits a shared coefficient matrix for all members at each time-step.…
▽ More
In this paper, we propose, analyze, and test an efficient algorithm for computing ensemble average of incompressible magnetohydrodynamics (MHD) flows, where instances/members correspond to varying kinematic viscosity, magnetic diffusivity, body forces, and initial conditions. The algorithm is decoupled in Elsässer variables and permits a shared coefficient matrix for all members at each time-step. Thus, the algorithm is much more computationally efficient than separately computing simulations for each member using usual MHD algorithms. We prove the proposed algorithm is unconditionally stable and convergent. Several numerical tests are given to support the predicted convergence rates. Finally, we test the proposed scheme and observe how the physical behavior changes as the coupling number increases in a lid-driven cavity problem with mean Reynolds number $Re\approx 15000$, and as the deviation of uncertainties in the initial and boundary conditions increases in a channel flow past a step problem.
△ Less
Submitted 11 August, 2021;
originally announced August 2021.
-
Continuous data assimilation and long-time accuracy in a $C^0$ interior penalty method for the Cahn-Hilliard equation
Authors:
Amanda E. Diegel,
Leo G. Rebholz
Abstract:
We propose a numerical approximation method for the Cahn-Hilliard equations that incorporates continuous data assimilation in order to achieve long time accuracy. The method uses a C$^0$ interior penalty spatial discretization of the fourth order Cahn-Hilliard equations, together with a backward Euler temporal discretization. We prove the method is long time stable and long time accurate, for arbi…
▽ More
We propose a numerical approximation method for the Cahn-Hilliard equations that incorporates continuous data assimilation in order to achieve long time accuracy. The method uses a C$^0$ interior penalty spatial discretization of the fourth order Cahn-Hilliard equations, together with a backward Euler temporal discretization. We prove the method is long time stable and long time accurate, for arbitrarily inaccurate initial conditions, provided enough data measurements are incorporated into the simulation. Numerical experiments illustrate the effectiveness of the method on a benchmark test problem.
△ Less
Submitted 28 June, 2021;
originally announced June 2021.
-
Enabling fast convergence of the iterated penalty Picard iteration with $O(1)$ penalty parameter for incompressible Navier-Stokes via Anderson acceleration
Authors:
Leo G. Rebholz,
Duygu Vargun,
Mengying Xiao
Abstract:
This paper considers an enhancement of the classical iterated penalty Picard (IPP) method for the incompressible Navier-Stokes equations, where we restrict our attention to $O(1)$ penalty parameter, and Anderson acceleration (AA) is used to significantly improve its convergence properties. After showing the fixed point operator associated with the IPP iteration is Lipschitz continuous and Lipschit…
▽ More
This paper considers an enhancement of the classical iterated penalty Picard (IPP) method for the incompressible Navier-Stokes equations, where we restrict our attention to $O(1)$ penalty parameter, and Anderson acceleration (AA) is used to significantly improve its convergence properties. After showing the fixed point operator associated with the IPP iteration is Lipschitz continuous and Lipschitz continuously (Frechet) differentiable, we apply a recently developed general theory for AA to conclude that IPP enhanced with AA improves its linear convergence rate by the gain factor associated with the underlying AA optimization problem. Results for several challenging numerical tests are given and show that IPP with penalty parameter 1 and enhanced with AA is a very effective solver.
△ Less
Submitted 19 May, 2021;
originally announced May 2021.
-
A mass-, kinetic energy- and helicity-conserving mimetic dual-field discretization for three-dimensional incompressible Navier-Stokes equations, part I: Periodic domains
Authors:
Yi Zhang,
Artur Palha,
Marc Gerritsma,
Leo G. Rebholz
Abstract:
We introduce a mimetic dual-field discretization which conserves mass, kinetic energy and helicity for three-dimensional incompressible Navier-Stokes equations. The discretization makes use of a conservative dual-field mixed weak formulation where two evolution equations of velocity are employed and dual representations of the solution are sought for each variable. A temporal discretization, which…
▽ More
We introduce a mimetic dual-field discretization which conserves mass, kinetic energy and helicity for three-dimensional incompressible Navier-Stokes equations. The discretization makes use of a conservative dual-field mixed weak formulation where two evolution equations of velocity are employed and dual representations of the solution are sought for each variable. A temporal discretization, which staggers the evolution equations and handles the nonlinearity such that the resulting discrete algebraic systems are linear and decoupled, is constructed. The spatial discretization is mimetic in the sense that the finite dimensional function spaces form a discrete de Rham complex. Conservation of mass, kinetic energy and helicity in the absence of dissipative terms is proven at the discrete level. Proper dissipation rates of kinetic energy and helicity in the viscous case is also proven. Numerical tests supporting the method are provided.
△ Less
Submitted 22 October, 2021; v1 submitted 27 April, 2021;
originally announced April 2021.
-
Continuous data assimilation applied to a velocity-vorticity formulation of the 2D Navier-Stokes equations
Authors:
Matthew Gardner,
Adam Larios,
Leo G. Rebholz,
Duygu Vargun,
Camille Zerfas
Abstract:
We study a continuous data assimilation (CDA) algorithm for a velocity-vorticity formulation of the 2D Navier-Stokes equations in two cases: nudging applied to the velocity and vorticity, and nudging applied to the velocity only. We prove that under a typical finite element spatial discretization and backward Euler temporal discretization, application of CDA preserves the unconditional long-time s…
▽ More
We study a continuous data assimilation (CDA) algorithm for a velocity-vorticity formulation of the 2D Navier-Stokes equations in two cases: nudging applied to the velocity and vorticity, and nudging applied to the velocity only. We prove that under a typical finite element spatial discretization and backward Euler temporal discretization, application of CDA preserves the unconditional long-time stability property of the velocity-vorticity method and provides optimal long-time accuracy. These properties hold if nudging is applied only to the velocity, and if nudging is also applied to the vorticity then the optimal long-time accuracy is achieved more rapidly in time. Numerical tests illustrate the theory, and show its effectiveness on an application problem of channel flow past a flat plate.
△ Less
Submitted 12 June, 2020;
originally announced June 2020.
-
Acceleration of nonlinear solvers for natural convection problems
Authors:
Sara Pollock,
Leo G. Rebholz,
Mengying Xiao
Abstract:
This paper develops an efficient and robust solution technique for the steady Boussinesq model of non-isothermal flow using Anderson acceleration applied to a Picard iteration. After analyzing the fixed point operator associated with the nonlinear iteration to prove that certain stability and regularity properties hold, we apply the authors' recently constructed theory for Anderson acceleration, w…
▽ More
This paper develops an efficient and robust solution technique for the steady Boussinesq model of non-isothermal flow using Anderson acceleration applied to a Picard iteration. After analyzing the fixed point operator associated with the nonlinear iteration to prove that certain stability and regularity properties hold, we apply the authors' recently constructed theory for Anderson acceleration, which yields a convergence result for the Anderson accelerated Picard iteration for the Boussinesq system. The result shows that the leading term in the residual is improved by the gain in the optimization problem, but at the cost of additional higher order terms that can be significant when the residual is large. We perform numerical tests that illustrate the theory, and show that a 2-stage choice of Anderson depth can be advantageous. We also consider Anderson acceleration applied to the Newton iteration for the Boussinesq equations, and observe that the acceleration allows the Newton iteration to converge for significantly higher Rayleigh numbers that it could without acceleration, even with a standard line search.
△ Less
Submitted 14 April, 2020;
originally announced April 2020.
-
Data-Driven Variational Multiscale Reduced Order Models
Authors:
Changhong Mou,
Birgul Koc,
Omer San,
Leo G. Rebholz,
Traian Iliescu
Abstract:
We propose a new data-driven reduced order model (ROM) framework that centers around the hierarchical structure of the variational multiscale (VMS) methodology and utilizes data to increase the ROM accuracy at a modest computational cost. The VMS methodology is a natural fit for the hierarchical structure of the ROM basis: In the first step, we use the ROM projection to separate the scales into th…
▽ More
We propose a new data-driven reduced order model (ROM) framework that centers around the hierarchical structure of the variational multiscale (VMS) methodology and utilizes data to increase the ROM accuracy at a modest computational cost. The VMS methodology is a natural fit for the hierarchical structure of the ROM basis: In the first step, we use the ROM projection to separate the scales into three categories: (i) resolved large scales, (ii) resolved small scales, and (iii) unresolved scales. In the second step, we explicitly identify the VMS-ROM closure terms, i.e., the terms representing the interactions among the three types of scales. In the third step, we use available data to model the VMS-ROM closure terms. Thus, instead of phenomenological models used in VMS for standard numerical discretizations (e.g., eddy viscosity models), we utilize available data to construct new structural VMS-ROM closure models. Specifically, we build ROM operators (vectors, matrices, and tensors) that are closest to the true ROM closure terms evaluated with the available data. We test the new data-driven VMS-ROM in the numerical simulation of four test cases: (i) the 1D Burgers equation with viscosity coefficient $ν= 10^{-3}$; (ii) a 2D flow past a circular cylinder at Reynolds numbers $Re=100$, $Re=500$, and $Re=1000$; (iii) the quasi-geostrophic equations at Reynolds number $Re=450$ and Rossby number $Ro=0.0036$; and (iv) a 2D flow over a backward facing step at Reynolds number $Re=1000$. The numerical results show that the data-driven VMS-ROM is significantly more accurate than standard ROMs.
△ Less
Submitted 10 August, 2020; v1 submitted 15 February, 2020;
originally announced February 2020.
-
Longer time accuracy for incompressible Navier-Stokes simulations with the EMAC formulation
Authors:
Maxim A. Olshanskii,
Leo G. Rebholz
Abstract:
In this paper, we consider the recently introduced EMAC formulation for the incompressible Navier-Stokes (NS) equations, which is the only known NS formulation that conserves energy, momentum and angular momentum when the divergence constraint is only weakly enforced. Since its introduction, the EMAC formulation has been successfully used for a wide variety of fluid dynamics problems. We prove tha…
▽ More
In this paper, we consider the recently introduced EMAC formulation for the incompressible Navier-Stokes (NS) equations, which is the only known NS formulation that conserves energy, momentum and angular momentum when the divergence constraint is only weakly enforced. Since its introduction, the EMAC formulation has been successfully used for a wide variety of fluid dynamics problems. We prove that discretizations using the EMAC formulation are potentially better than those built on the commonly used skew-symmetric formulation, by deriving a better longer time error estimate for EMAC: while the classical results for schemes using the skew-symmetric formulation have Gronwall constants dependent on $\exp(C\cdot Re\cdot T)$ with $Re$ the Reynolds number, it turns out that the EMAC error estimate is free from this explicit exponential dependence on the Reynolds number. Additionally, it is demonstrated how EMAC admits smaller lower bounds on its velocity error, since {incorrect treatment of linear momentum, angular momentum and energy induces} lower bounds for $L^2$ velocity error, and EMAC treats these quantities more accurately. Results of numerical tests for channel flow past a cylinder and 2D Kelvin-Helmholtz instability are also given, both of which show that the advantages of EMAC over the skew-symmetric formulation increase as the Reynolds number gets larger and for longer simulation times.
△ Less
Submitted 25 June, 2020; v1 submitted 4 February, 2020;
originally announced February 2020.
-
Modular grad-div stabilization for the incompressible non-isothermal fluid flows
Authors:
Mine Akbas,
Leo G. Rebholz
Abstract:
This paper considers a modular grad-div stabilization method for approximating solutions of the time-dependent Boussinesq model of non-isothermal flows. The proposed method adds a minimally intrusive step to an existing Boussinesq code, with the key idea being that the penalization of the divergence errors, is only in the extra step (i.e. nothing is added to the original equations). The paper prov…
▽ More
This paper considers a modular grad-div stabilization method for approximating solutions of the time-dependent Boussinesq model of non-isothermal flows. The proposed method adds a minimally intrusive step to an existing Boussinesq code, with the key idea being that the penalization of the divergence errors, is only in the extra step (i.e. nothing is added to the original equations). The paper provides a full mathematical analysis by proving unconditional stability and optimal convergence of the methods considered. Numerical experiments confirm theoretical findings, and show that the algorithms have a similar positive effect as the usual grad-div stabilization.
△ Less
Submitted 31 August, 2020; v1 submitted 27 January, 2020;
originally announced January 2020.
-
Continuous Data Assimilation Reduced Order Models of Fluid Flow
Authors:
Camille Zerfas,
Leo G. Rebholz,
Michael Schneier,
Traian Iliescu
Abstract:
We propose, analyze, and test a novel continuous data assimilation reduced order model (DA-ROM) for simulating incompressible flows. While ROMs have a long history of success on certain problems with recurring dominant structures, they tend to lose accuracy on more complicated problems and over longer time intervals. Meanwhile, continuous data assimilation (DA) has recently been used to improve ac…
▽ More
We propose, analyze, and test a novel continuous data assimilation reduced order model (DA-ROM) for simulating incompressible flows. While ROMs have a long history of success on certain problems with recurring dominant structures, they tend to lose accuracy on more complicated problems and over longer time intervals. Meanwhile, continuous data assimilation (DA) has recently been used to improve accuracy and, in particular, long time accuracy in fluid simulations by incorporating measurement data into the simulation. This paper synthesizes these two ideas, in an attempt to address inaccuracies in ROM by applying DA, especially over long time intervals and when only inaccurate snapshots are available. We prove that with a properly chosen nudging parameter, the proposed DA-ROM algorithm converges exponentially fast in time to the true solution, up to discretization and ROM truncation errors. Finally, we propose a strategy for nudging adaptively in time, by adjusting dissipation arising from the nudging term to better match true solution energy. Numerical tests confirm all results, and show that the DA-ROM strategy with adaptive nudging can be highly effective at providing long time accuracy in ROMs.
△ Less
Submitted 10 March, 2019;
originally announced March 2019.
-
Anderson-accelerated convergence of Picard iterations for incompressible Navier-Stokes equations
Authors:
Sara Pollock,
Leo G. Rebholz,
Mengying Xiao
Abstract:
We propose, analyze and test Anderson-accelerated Picard iterations for solving the incompressible Navier-Stokes equations (NSE). Anderson acceleration has recently gained interest as a strategy to accelerate linear and nonlinear iterations, based on including an optimization step in each iteration. We extend the Anderson-acceleration theory to the steady NSE setting and prove that the acceleratio…
▽ More
We propose, analyze and test Anderson-accelerated Picard iterations for solving the incompressible Navier-Stokes equations (NSE). Anderson acceleration has recently gained interest as a strategy to accelerate linear and nonlinear iterations, based on including an optimization step in each iteration. We extend the Anderson-acceleration theory to the steady NSE setting and prove that the acceleration improves the convergence rate of the Picard iteration based on the success of the underlying optimization problem. The convergence is demonstrated in several numerical tests, with particularly marked improvement in the higher Reynolds number regime. Our tests show it can be an enabling technology in the sense that it can provide convergence when both usual Picard and Newton iterations fail.
△ Less
Submitted 19 October, 2018;
originally announced October 2018.
-
A proof that Anderson acceleration improves the convergence rate in linearly converging fixed point methods (but not in those converging quadratically)
Authors:
Claire Evans,
Sara Pollock,
Leo G. Rebholz,
Mengying Xiao
Abstract:
This paper provides the first proof that Anderson acceleration (AA) improves the convergence rate of general fixed point iterations. AA has been used for decades to speed up nonlinear solvers in many applications, however a rigorous mathematical justification of the improved convergence rate has remained lacking. The key ideas of the analysis presented here are relating the difference of consecuti…
▽ More
This paper provides the first proof that Anderson acceleration (AA) improves the convergence rate of general fixed point iterations. AA has been used for decades to speed up nonlinear solvers in many applications, however a rigorous mathematical justification of the improved convergence rate has remained lacking. The key ideas of the analysis presented here are relating the difference of consecutive iterates to residuals based on performing the inner-optimization in a Hilbert space setting, and explicitly defining the gain in the optimization stage to be the ratio of improvement over a step of the unaccelerated fixed point iteration. The main result we prove is that AA improves the convergence rate of a fixed point iteration to first order by a factor of the gain at each step. In addition to improving the convergence rate, our results indicate that AA increases the radius of convergence. Lastly, our estimate shows that while the linear convergence rate is improved, additional quadratic terms arise in the estimate, which shows why AA does not typically improve convergence in quadratically converging fixed point iterations. Results of several numerical tests are given which illustrate the theory.
△ Less
Submitted 20 February, 2019; v1 submitted 19 October, 2018;
originally announced October 2018.
-
Simple and efficient continuous data assimilation of evolution equations via algebraic nudging
Authors:
Leo G. Rebholz,
Camille Zerfas
Abstract:
We introduce, analyze and test a new interpolation operator for use with continuous data assimilation (DA) of evolution equations that are discretized spatially with the finite element method. The interpolant is constructed as an approximation of the L2 projection operator onto piecewise constant functions on a coarse mesh, but which allows nudging to be done completely at the linear algebraic lev…
▽ More
We introduce, analyze and test a new interpolation operator for use with continuous data assimilation (DA) of evolution equations that are discretized spatially with the finite element method. The interpolant is constructed as an approximation of the L2 projection operator onto piecewise constant functions on a coarse mesh, but which allows nudging to be done completely at the linear algebraic level, independent of the rest of the discretization, with a diagonal matrix that is simple to construct. We prove the new operator maintains stability and accuracy properties, and we apply it to algorithms for both fluid transport DA and incompressible Navier Stokes DA. For both applications we prove the DA solutions with arbitrary initial conditions converge to the true solution (up to optimal discretization error) exponentially fast in time, and are thus long-time accurate. Results of several numerical tests are given, which both illustrate the theory and demonstrate its usefulness on practical problems.
△ Less
Submitted 8 October, 2018;
originally announced October 2018.
-
Pressure-induced locking in mixed methods for time-dependent (Navier-)Stokes equations
Authors:
Alexander Linke,
Leo G. Rebholz
Abstract:
We consider inf-sup stable mixed methods for the time-dependent incompressible Stokes and Navier--Stokes equations, extending earlier work on the steady (Navier-)Stokes Problem. A locking phenomenon is identified for classical inf-sup stable methods like the Taylor-Hood or the Crouzeix-Raviart elements by a novel, elegant and simple numerical analysis and corresponding numerical experiments, whene…
▽ More
We consider inf-sup stable mixed methods for the time-dependent incompressible Stokes and Navier--Stokes equations, extending earlier work on the steady (Navier-)Stokes Problem. A locking phenomenon is identified for classical inf-sup stable methods like the Taylor-Hood or the Crouzeix-Raviart elements by a novel, elegant and simple numerical analysis and corresponding numerical experiments, whenever the momentum balance is dominated by forces of a gradient type. More precisely, a reduction of the $L^2$ convergence order for high order methods, and even a complete stall of the $L^2$ convergence order for lowest-order methods on preasymptotic meshes is predicted by the analysis and practically observed. On the other hand, it is also shown that (structure-preserving) pressure-robust mixed methods do not suffer from this locking phenomenon, even if they are of lowest-order. A connection to well-balanced schemes for (vectorial) hyperbolic conservation laws like the shallow water or the compressible Euler equations is made.
△ Less
Submitted 21 August, 2018;
originally announced August 2018.
-
Physically-Constrained Data-Driven, Filtered Reduced Order Modeling of Fluid Flows
Authors:
M. Mohebujjaman,
L. G. Rebholz,
T. Iliescu
Abstract:
In our earlier work, we proposed a data-driven filtered reduced order model (DDF-ROM) framework for the numerical simulation of fluid flows, which can be formally written as \begin{equation*}
\boxed{
\text{
DDF-ROM = Galerkin-ROM + Correction
}
} \end{equation*} The new DDF-ROM was constructed by using ROM spatial filtering and data-driven ROM closure modeling (for the Correction term) a…
▽ More
In our earlier work, we proposed a data-driven filtered reduced order model (DDF-ROM) framework for the numerical simulation of fluid flows, which can be formally written as \begin{equation*}
\boxed{
\text{
DDF-ROM = Galerkin-ROM + Correction
}
} \end{equation*} The new DDF-ROM was constructed by using ROM spatial filtering and data-driven ROM closure modeling (for the Correction term) and was successfully tested in the numerical simulation of a 2D channel flow past a circular cylinder at Reynolds numbers $Re=100, Re=500$ and $Re=1000$.
In this paper, we propose a {\it physically-constrained} DDF-ROM (CDDF-ROM), which aims at improving the physical accuracy of the DDF-ROM. The new physical constraints require that the CDDF-ROM operators satisfy the same type of physical laws (i.e., the nonlinear operator should conserve energy and the ROM closure term should be dissipative) as those satisfied by the fluid flow equations. To implement these physical constraints, in the data-driven modeling step of the DDF-ROM, we replace the unconstrained least squares problem with a constrained least squares problem. We perform a numerical investigation of the new CDDF-ROM and standard DDF-ROM for a 2D channel flow past a circular cylinder at Reynolds numbers $Re=100, Re=500$ and $Re=1000$. To this end, we consider a reproductive regime as well as a predictive (i.e., cross-validation) regime in which we use as little as $50\%$ of the original training data. The numerical investigation clearly shows that the new CDDF-ROM is significantly more accurate than the DDF-ROM in both regimes.
△ Less
Submitted 30 May, 2018;
originally announced June 2018.
-
Global in time stability and accuracy of IMEX-FEM data assimilation schemes for the Navier-Stokes equations
Authors:
Adam Larios,
Leo G. Rebholz,
Camille Zerfas
Abstract:
We study numerical schemes for incompressible Navier-Stokes equations using IMEX temporal discretizations, finite element spacial discretizations, and equipped with continuous data assimilation (a technique recently developed by Azouani, Olson, and Titi in 2014). We analyze stability and accuracy of the proposed methods, and are able to prove well-posedness, long time stability, and long time accu…
▽ More
We study numerical schemes for incompressible Navier-Stokes equations using IMEX temporal discretizations, finite element spacial discretizations, and equipped with continuous data assimilation (a technique recently developed by Azouani, Olson, and Titi in 2014). We analyze stability and accuracy of the proposed methods, and are able to prove well-posedness, long time stability, and long time accuracy estimates, under restrictions of the time step size and data assimilation parameter. We give results for several numerical tests that illustrate the theory, and show that, for good results, the choice of discretization parameter and element choices can be critical.
△ Less
Submitted 10 May, 2018;
originally announced May 2018.
-
Efficient discretizations for the EMAC formulation of the incompressible Navier-Stokes equations
Authors:
Sergey Charnyi,
Timo Heister,
Maxim A. Olshanskii,
Leo G. Rebholz
Abstract:
We study discretizations of the incompressible Navier-Stokes equations, written in the newly developed energy-momentum-angular momentum conserving (EMAC) formulation. We consider linearizations of the problem, which at each time step will reduce the computational cost, but can alter the conservation properties. We show that a skew-symmetrized linearization delivers the correct balance of (only) en…
▽ More
We study discretizations of the incompressible Navier-Stokes equations, written in the newly developed energy-momentum-angular momentum conserving (EMAC) formulation. We consider linearizations of the problem, which at each time step will reduce the computational cost, but can alter the conservation properties. We show that a skew-symmetrized linearization delivers the correct balance of (only) energy and that the Newton linearization conserves momentum and angular momentum, but conserves energy only up to the nonlinear residual. Numerical tests show that linearizing with 2 Newton steps at each time step is very effective at preserving all conservation laws at once, and giving accurate answers on long time intervals. The tests also show that the skew-symmetrized linearization is significantly less accurate. The tests also show that the Newton linearization of EMAC finite element formulation compares favorably to other traditionally used finite element formulation of the incompressible Navier-Stokes equations in primitive variables.
△ Less
Submitted 3 December, 2017;
originally announced December 2017.
-
The analogue of grad-div stabilization in DG methods for incompressible flows: Limiting behavior and extension to tensor-product meshes
Authors:
Mine Akbas,
Alexander Linke,
Leo G. Rebholz,
Philipp W. Schroeder
Abstract:
Grad-div stabilization is a classical remedy in conforming mixed finite element methods for incompressible flow problems, for mitigating velocity errors that are sometimes called poor mass conservation. Such errors arise due to the relaxation of the divergence constraint in classical mixed methods, and are excited whenever the spatial discretization has to deal with comparably large and complicate…
▽ More
Grad-div stabilization is a classical remedy in conforming mixed finite element methods for incompressible flow problems, for mitigating velocity errors that are sometimes called poor mass conservation. Such errors arise due to the relaxation of the divergence constraint in classical mixed methods, and are excited whenever the spatial discretization has to deal with comparably large and complicated pressures. In this contribution, an analogue of grad-div stabilization for Discontinuous Galerkin methods is studied. Here, the key is the penalization of the jumps of the normal velocities over facets of the triangulation, which controls the measure-valued part of the distributional divergence of the discrete velocity solution. Our contribution is twofold: first, we characterize the limit for arbitrarily large penalization parameters, which shows that the stabilized nonconforming Discontinuous Galerkin methods remain robust and accurate in this limit; second, we extend these ideas to the case of non-simplicial meshes; here, broken grad-div stabilization must be used in addition to the normal velocity jump penalization, in order to get the desired pressure robustness effect. The analysis is performed for the Stokes equations, and more complex flows and Crouzeix-Raviart elements are considered in numerical examples that also show the relevance of the theory in practical settings.
△ Less
Submitted 25 July, 2018; v1 submitted 13 November, 2017;
originally announced November 2017.
-
Data-Driven Filtered Reduced Order Modeling Of Fluid Flows
Authors:
X. Xie,
M. Mohebujjaman,
L. G. Rebholz,
T. Iliescu
Abstract:
We propose a data-driven filtered reduced order model (DDF-ROM) framework for the numerical simulation of fluid flows. The novel DDF-ROM framework consists of two steps: (i) In the first step, we use explicit ROM spatial filtering of the nonlinear PDE to construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of the nonlinearity in the given PDE). (ii) In the sec…
▽ More
We propose a data-driven filtered reduced order model (DDF-ROM) framework for the numerical simulation of fluid flows. The novel DDF-ROM framework consists of two steps: (i) In the first step, we use explicit ROM spatial filtering of the nonlinear PDE to construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of the nonlinearity in the given PDE). (ii) In the second step, we use data-driven modeling to close the filtered ROM, i.e., to model the interaction between the resolved and unresolved modes. To this end, we use a quadratic ansatz to model this interaction and close the filtered ROM. To find the new coefficients in the closed filtered ROM, we solve an optimization problem that minimizes the difference between the full order model data and our ansatz. We emphasize that the new DDF-ROM is built on general ideas of spatial filtering and optimization and is independent of (restrictive) phenomenological arguments.
We investigate the DDF-ROM in the numerical simulation of a 2D channel flow past a circular cylinder at Reynolds number $Re=100$. The DDF-ROM is significantly more accurate than the standard projection ROM. Furthermore, the computational costs of the DDF-ROM and the standard projection ROM are similar, both costs being orders of magnitude lower than the computational cost of the full order model. We also compare the new DDF-ROM with modern ROM closure models in the numerical simulation of the 1D Burgers equation. The DDF-ROM is more accurate and significantly more efficient than these ROM closure models.
△ Less
Submitted 11 September, 2017;
originally announced September 2017.
-
On well-posedness of a velocity-vorticity formulation of the Navier-Stokes equations with no-slip boundary conditions
Authors:
Maxim A. Olshanskii,
Leo G. Rebholz,
Abner J. Salgado
Abstract:
We study well-posedness of a velocity-vorticity formulation of the Navier--Stokes equations, supplemented with no-slip velocity boundary conditions, a no-penetration vorticity boundary condition, along with a natural vorticity boundary condition depending on a pressure functional. In the stationary case we prove existence and uniqueness of a suitable weak solution to the system under a small data…
▽ More
We study well-posedness of a velocity-vorticity formulation of the Navier--Stokes equations, supplemented with no-slip velocity boundary conditions, a no-penetration vorticity boundary condition, along with a natural vorticity boundary condition depending on a pressure functional. In the stationary case we prove existence and uniqueness of a suitable weak solution to the system under a small data condition. The topic of the paper is driven by recent developments of vorticity based numerical methods for the Navier--Stokes equations.
△ Less
Submitted 7 August, 2017;
originally announced August 2017.
-
A Modular Regularized Variational Multiscale Proper Orthogonal Decomposition for Incompressible Flows
Authors:
Fatma G. Eroglu,
Songul Kaya,
Leo G. Rebholz
Abstract:
In this paper, we propose, analyze and test a post-processing implementation of a projection-based variational multiscale (VMS) method with proper orthogonal decomposition (POD) for the incompressible Navier-Stokes equations. The projection-based VMS stabilization is added as a separate post-processing step to the standard POD approximation, and since the stabilization step is completely decoupled…
▽ More
In this paper, we propose, analyze and test a post-processing implementation of a projection-based variational multiscale (VMS) method with proper orthogonal decomposition (POD) for the incompressible Navier-Stokes equations. The projection-based VMS stabilization is added as a separate post-processing step to the standard POD approximation, and since the stabilization step is completely decoupled, the method can easily be incorporated into existing codes, and stabilization parameters can be tuned independent from the time evolution step. We present a theoretical analysis of the method, and give results for several numerical tests on benchmark problems which both illustrate the theory and show the proposed method's effectiveness.
△ Less
Submitted 15 May, 2017;
originally announced May 2017.
-
Calibrated Filtered Reduced Order Modeling
Authors:
X. Xie,
M. Mohebujjaman,
L. G. Rebholz,
T. Iliescu
Abstract:
We propose a calibrated filtered reduced order model (CF-ROM) framework for the numerical simulation of general nonlinear PDEs that are amenable to reduced order modeling. The novel CF-ROM framework consists of two steps: (i) In the first step, we use explicit ROM spatial filtering of the nonlinear PDE to construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of…
▽ More
We propose a calibrated filtered reduced order model (CF-ROM) framework for the numerical simulation of general nonlinear PDEs that are amenable to reduced order modeling. The novel CF-ROM framework consists of two steps: (i) In the first step, we use explicit ROM spatial filtering of the nonlinear PDE to construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of the nonlinearity in the given PDE). (ii) In the second step, we use a calibration procedure to close the filtered ROM, i.e., to model the interaction between the resolved and unresolved modes. To this end, we use a linear or quadratic ansatz to model this interaction and close the filtered ROM. To find the new coefficients in the closed filtered ROM, we solve an optimization problem that minimizes the difference between the full order model data and our ansatz. Although we use a fluid dynamics setting to illustrate how to construct and use the CF-ROM framework, we emphasize that it is built on general ideas of spatial filtering and optimization and is independent of (restrictive) phenomenological arguments. Thus, the CF-ROM framework can be applied to a wide variety of PDEs.
△ Less
Submitted 20 February, 2017;
originally announced February 2017.
-
On conservation laws of Navier-Stokes Galerkin discretizations
Authors:
Sergey Charnyi,
Timo Heister,
Maxim A. Olshanskii,
Leo G. Rebholz
Abstract:
We study conservation properties of Galerkin methods for the incompressible Navier-Stokes equations, without the divergence constraint strongly enforced. In typical discretizations such as the mixed finite element method, the conservation of mass is enforced only weakly, and this leads to discrete solutions which may not conserve energy, momentum, angular momentum, helicity, or vorticity, even tho…
▽ More
We study conservation properties of Galerkin methods for the incompressible Navier-Stokes equations, without the divergence constraint strongly enforced. In typical discretizations such as the mixed finite element method, the conservation of mass is enforced only weakly, and this leads to discrete solutions which may not conserve energy, momentum, angular momentum, helicity, or vorticity, even though the physics of the Navier-Stokes equations dictate that they should. We aim in this work to construct discrete formulations that conserve as many physical laws as possible without utilizing a strong enforcement of the divergence constraint, and doing so leads us to a new formulation that conserves each of energy, momentum, angular momentum, enstrophy in 2D, helicity and vorticity (for reference, the usual convective formulation does not conserve most of these quantities). Several numerical experiments are performed, which verify the theory and test the new formulation.
△ Less
Submitted 20 January, 2017; v1 submitted 31 May, 2016;
originally announced May 2016.
-
Unconditional long-time stability of a velocity-vorticity method for the 2D Navier-Stokes equations
Authors:
Timo Heister,
Maxim A. Olshanskii,
Leo G. Rebholz
Abstract:
We prove unconditional long-time stability for a particular velocity-vorticity discretization of the 2D Navier-Stokes equations. The scheme begins with a formulation that uses the Lamb vector to couple the usual velocity-pressure system to the vorticity dynamics equation, and then discretizes with the finite element method in space and implicit-explicit BDF2 in time, with the vorticity equation de…
▽ More
We prove unconditional long-time stability for a particular velocity-vorticity discretization of the 2D Navier-Stokes equations. The scheme begins with a formulation that uses the Lamb vector to couple the usual velocity-pressure system to the vorticity dynamics equation, and then discretizes with the finite element method in space and implicit-explicit BDF2 in time, with the vorticity equation decoupling at each time step. We prove the method's vorticity and velocity are both long-time stable in the $L^2$ and $H^1$ norms, without any timestep restriction. Moreover, our analysis avoids the use of Gronwall-type estimates, which leads us to stability bounds with only polynomial (instead of exponential) dependence on the Reynolds number. Numerical experiments are given that demonstrate the effectiveness of the method.
△ Less
Submitted 25 November, 2015;
originally announced November 2015.
-
Analysis of a Reduced-Order Approximate Deconvolution Model and its interpretation as a Navier-Stokes-Voigt regularization
Authors:
L. C. Berselli,
T. -Y. Kim,
L. G. Rebholz
Abstract:
We study mathematical and physical properties of a family of recently introduced, reduced-order approximate deconvolution models. We first show a connection between these models and the NS-Voigt model, and that NS-Voigt can be re-derived in the approximate deconvolution framework. We then study the energy balance and spectra of the model, and provide results of some turbulent flow computations tha…
▽ More
We study mathematical and physical properties of a family of recently introduced, reduced-order approximate deconvolution models. We first show a connection between these models and the NS-Voigt model, and that NS-Voigt can be re-derived in the approximate deconvolution framework. We then study the energy balance and spectra of the model, and provide results of some turbulent flow computations that backs up the theory. Analysis of global attractors for the model is also provided, as is a detailed analysis of the Voigt model's treatment of pulsatile flow.
△ Less
Submitted 20 April, 2015;
originally announced April 2015.
