-
An augmented Lagrangian trust-region method with inexact gradient evaluations to accelerate constrained optimization problems using model hyperreduction
Authors:
Tianshu Wen,
Matthew J. Zahr
Abstract:
We present an augmented Lagrangian trust-region method to efficiently solve constrained optimization problems governed by large-scale nonlinear systems with application to partial differential equation-constrained optimization. At each major augmented Lagrangian iteration, the expensive optimization subproblem involving the full nonlinear system is replaced by an empirical quadrature-based hyperre…
▽ More
We present an augmented Lagrangian trust-region method to efficiently solve constrained optimization problems governed by large-scale nonlinear systems with application to partial differential equation-constrained optimization. At each major augmented Lagrangian iteration, the expensive optimization subproblem involving the full nonlinear system is replaced by an empirical quadrature-based hyperreduced model constructed on-the-fly. To ensure convergence of these inexact augmented Lagrangian subproblems, we develop a bound-constrained trust-region method that allows for inexact gradient evaluations, and specialize it to our specific setting that leverages hyperreduced models. This approach circumvents a traditional training phase because the models are built on-the-fly in accordance with the requirements of the trust-region convergence theory. Two numerical experiments (constrained aerodynamic shape design) demonstrate the convergence and efficiency of the proposed work. A speedup of 12.7x (for all computational costs, even costs traditionally considered "offline" such as snapshot collection and data compression) relative to a standard optimization approach that does not leverage model reduction is shown.
△ Less
Submitted 23 May, 2024;
originally announced May 2024.
-
Preconditioned iterative solvers for constrained high-order implicit shock tracking methods
Authors:
Jakob Vandergrift,
Matthew J. Zahr
Abstract:
High-order implicit shock tracking (fitting) is a class of high-order numerical methods that use numerical optimization to simultaneously compute a high-order approximation to a conservation law solution and align elements of the computational mesh with non-smooth features. This alignment ensures that non-smooth features are perfectly represented by inter-element jumps and high-order basis functio…
▽ More
High-order implicit shock tracking (fitting) is a class of high-order numerical methods that use numerical optimization to simultaneously compute a high-order approximation to a conservation law solution and align elements of the computational mesh with non-smooth features. This alignment ensures that non-smooth features are perfectly represented by inter-element jumps and high-order basis functions approximate smooth regions of the solution without nonlinear stabilization, which leads to accurate approximations on traditionally coarse meshes. In this work, we devise a family of preconditioners for the saddle point linear system that defines the step toward optimality at each iteration of the optimization solver so Krylov solvers can be effectively used. Our preconditioners integrate standard preconditioners from constrained optimization with popular preconditioners for discontinuous Galerkin discretizations such as block Jacobi, block incomplete LU factorizations with minimum discarded fill reordering, and p-multigrid. Thorough studies are performed using two inviscid compressible flow problems to evaluate the effectivity of each preconditioner in this family and their sensitivity to critical shock tracking parameters such as the mesh and Hessian regularization, linearization state, and resolution of the solution space.
△ Less
Submitted 27 June, 2024; v1 submitted 28 February, 2024;
originally announced February 2024.
-
Symmetric, Optimization-based, Cross-element Compatible Nodal Distributions for High-order Finite Elements
Authors:
Julian M. Kaufmann,
Matthew J. Zahr
Abstract:
In high-order and high-dimensional finite elements, ill-conditioned nodal distributions are often computationally cost-prohibitive. As a result, uniform distributions quickly fall apart. For tensor-product like elements, Gauss-Legendre-Lobatto (GLL) nodal distributions are often used as a substitute. Besides these, other efficient nodal distributions are difficult to create due to a desired symmet…
▽ More
In high-order and high-dimensional finite elements, ill-conditioned nodal distributions are often computationally cost-prohibitive. As a result, uniform distributions quickly fall apart. For tensor-product like elements, Gauss-Legendre-Lobatto (GLL) nodal distributions are often used as a substitute. Besides these, other efficient nodal distributions are difficult to create due to a desired symmetry within elements and conformity with neighboring elements. In this paper, we provide a general framework to construct symmetric, well-conditioned, cross-element compatible nodal distributions which can be used for high-order and high-dimensional finite elements. Starting from the inherent symmetries in any potential element, the framework is used to build up nodal groups in a structured and efficient manner utilizing the natural coordinates of each element, while ensuring nodes stay within the elements. By constructing constrained symmetry groups, the vertices, edges, and faces, of all elements are required to conform to their respective lower-dimensional distributions. Optimizing over these groups yields the desired optimized nodal distributions. We demonstrate the strength of this framework by creating and comparing optimized nodal distributions with GLL distributions (in elements such as the line, quadrilateral, and hexahedron), and its robustness by generating optimized nodal distributions for otherwise difficult elements (such as the triangle, tetrahedron, and triangular prism).
△ Less
Submitted 23 January, 2024;
originally announced January 2024.
-
An adaptive model reduction method leveraging locally supported basis functions
Authors:
Han Gao,
Matthew J. Zahr
Abstract:
We propose a new method, the continuous Galerkin method with globally and locally supported basis functions (CG-GL), to address the parametric robustness issues of reduced-order models (ROMs) by incorporating solution-based adaptivity with locally supported finite element basis functions. The CG-GL method combines the accuracy of locally supported basis functions with the efficiency of globally su…
▽ More
We propose a new method, the continuous Galerkin method with globally and locally supported basis functions (CG-GL), to address the parametric robustness issues of reduced-order models (ROMs) by incorporating solution-based adaptivity with locally supported finite element basis functions. The CG-GL method combines the accuracy of locally supported basis functions with the efficiency of globally supported data-driven basis functions. Efficient output-based dual-weighted residual error estimates are derived and implemented for the CG-GL method and used to drive efficient online trial space adaptation. An empirical quadrature procedure is introduced for rapid evaluation of nonlinear terms that does not require retraining throughout the adaptation process. Two numerical experiments demonstrate the potential of the CG-GL method to produce accurate approximations with limited training and its tunable tradeoff between accuracy and computational cost.
△ Less
Submitted 8 October, 2023;
originally announced October 2023.
-
A space-time high-order implicit shock tracking method for shock-dominated unsteady flows
Authors:
Charles J. Naudet,
Matthew J. Zahr
Abstract:
High-order implicit shock tracking (fitting) is a class of high-order, optimization-based numerical methods to approximate solutions of conservation laws with non-smooth features by aligning elements of the computational mesh with non-smooth features. This ensures the non-smooth features are perfectly represented by inter-element jumps and high-order basis functions approximate smooth regions of t…
▽ More
High-order implicit shock tracking (fitting) is a class of high-order, optimization-based numerical methods to approximate solutions of conservation laws with non-smooth features by aligning elements of the computational mesh with non-smooth features. This ensures the non-smooth features are perfectly represented by inter-element jumps and high-order basis functions approximate smooth regions of the solution without nonlinear stabilization, which leads to accurate approximations on traditionally coarse meshes. In this work, we extend implicit shock tracking to time-dependent problems using a slab-based space-time approach. This is achieved by reformulating a time-dependent conservation law as a steady conservation law in one higher dimension and applying existing implicit shock tracking techniques. To avoid computations over the entire time domain and unstructured mesh generation in higher dimensions, we introduce a general procedure to generate conforming, simplex-only meshes of space-time slabs in such a way that preserves features (e.g., curved elements, refinement regions) from previous time slabs. The use of space-time slabs also simplifies the shock tracking problem by reducing temporal complexity. Several practical adaptations of the implicit shock tracking solvers are developed for the space-time setting including 1) a self-adjusting temporal boundary, 2) nondimensionalization of a space-time slab, 3) adaptive mesh refinement, and 4) shock boundary conditions, which lead to accurate solutions on coarse space-time grids, even for problem with complex flow features such as curved shocks, shock formation, shock-shock and shock-boundary interaction, and triple points.
△ Less
Submitted 27 January, 2024; v1 submitted 8 August, 2023;
originally announced August 2023.
-
Accelerated solutions of convection-dominated partial differential equations using implicit feature tracking and empirical quadrature
Authors:
Marzieh Alireza Mirhoseini,
Matthew J. Zahr
Abstract:
This work introduces an empirical quadrature-based hyperreduction procedure and greedy training algorithm to effectively reduce the computational cost of solving convection-dominated problems with limited training. The proposed approach circumvents the slowly decaying $n$-width limitation of linear model reduction techniques applied to convection-dominated problems by using a nonlinear approximati…
▽ More
This work introduces an empirical quadrature-based hyperreduction procedure and greedy training algorithm to effectively reduce the computational cost of solving convection-dominated problems with limited training. The proposed approach circumvents the slowly decaying $n$-width limitation of linear model reduction techniques applied to convection-dominated problems by using a nonlinear approximation manifold systematically defined by composing a low-dimensional affine space with bijections of the underlying domain. The reduced-order model is defined as the solution of a residual minimization problem over the nonlinear manifold. An online-efficient method is obtained by using empirical quadrature to approximate the optimality system such that it can be solved with mesh-independent operations. The proposed reduced-order model is trained using a greedy procedure to systematically sample the parameter domain. The effectiveness of the proposed approach is demonstrated on two shock-dominated computational fluid dynamics benchmarks.
△ Less
Submitted 13 September, 2023; v1 submitted 24 May, 2023;
originally announced May 2023.
-
High-order implicit shock tracking boundary conditions for flows with parametrized shocks
Authors:
Tianci Huang,
Charles Naudet,
Matthew J. Zahr
Abstract:
High-order implicit shock tracking (fitting) is a class of high-order, optimization-based numerical methods to approximate solutions of conservation laws with non-smooth features by aligning elements of the computational mesh with non-smooth features. This ensures the non-smooth features are perfectly represented by inter-element jumps and high-order basis functions approximate smooth regions of t…
▽ More
High-order implicit shock tracking (fitting) is a class of high-order, optimization-based numerical methods to approximate solutions of conservation laws with non-smooth features by aligning elements of the computational mesh with non-smooth features. This ensures the non-smooth features are perfectly represented by inter-element jumps and high-order basis functions approximate smooth regions of the solution without nonlinear stabilization, which leads to accurate approximations on traditionally coarse meshes. In this work, we introduce a robust implicit shock tracking framework specialized for problems with parameter-dependent lead shocks (i.e., shocks separating a farfield condition from the downstream flow), which commonly arise in high-speed aerodynamics and astrophysics applications. After a shock-aligned mesh is produced at one parameter configuration, all elements upstream of the lead shock are removed and the nodes on the lead shock are positioned for new parameter configurations using the implicit shock tracking solver. The proposed framework can be used for most many-query applications involving parametrized lead shocks such as optimization, uncertainty quantification, parameter sweeps, "what-if" scenarios, or parameter-based continuation. We demonstrate the robustness and flexibility of the framework using a one-dimensional space-time Riemann problem, and two- and three-dimensional supersonic and hypersonic benchmark problems.
△ Less
Submitted 22 April, 2023;
originally announced April 2023.
-
An adaptive, training-free reduced-order model for convection-dominated problems based on hybrid snapshots
Authors:
Victor Zucatti,
Matthew J. Zahr
Abstract:
The vast majority of reduced-order models (ROMs) first obtain a low dimensional representation of the problem from high-dimensional model (HDM) training data which is afterwards used to obtain a system of reduced complexity. Unfortunately, convection-dominated problems generally have a slowly decaying Kolmogorov n-width, which makes obtaining an accurate ROM built solely from training data very ch…
▽ More
The vast majority of reduced-order models (ROMs) first obtain a low dimensional representation of the problem from high-dimensional model (HDM) training data which is afterwards used to obtain a system of reduced complexity. Unfortunately, convection-dominated problems generally have a slowly decaying Kolmogorov n-width, which makes obtaining an accurate ROM built solely from training data very challenging. The accuracy of a ROM can be improved through enrichment with HDM solutions; however, due to the large computational expense of HDM evaluations for complex problems, they can only be used parsimoniously to obtain relevant computational savings. In this work, we exploit the local spatial and temporal coherence often exhibited by these problems to derive an accurate, cost-efficient approach that repeatedly combines HDM and ROM evaluations without a separate training phase. Our approach obtains solutions at a given time step by either fully solving the HDM or by combining partial HDM and ROM solves. A dynamic sampling procedure identifies regions that require the HDM solution for global accuracy and the reminder of the flow is reconstructed using the ROM. Moreover, solutions combining both HDM and ROM solves use spatial filtering to eliminate potential spurious oscillations that may develop. We test the proposed method on inviscid compressible flow problems and demonstrate speedups up to an order of magnitude.
△ Less
Submitted 13 September, 2023; v1 submitted 4 January, 2023;
originally announced January 2023.
-
A globally convergent method to accelerate large-scale optimization using on-the-fly model hyperreduction: application to shape optimization
Authors:
Tianshu Wen,
Matthew J. Zahr
Abstract:
We present a numerical method to efficiently solve optimization problems governed by large-scale nonlinear systems of equations, including discretized partial differential equations, using projection-based reduced-order models accelerated with hyperreduction (empirical quadrature) and embedded in a trust-region framework that guarantees global convergence. The proposed framework constructs a hyper…
▽ More
We present a numerical method to efficiently solve optimization problems governed by large-scale nonlinear systems of equations, including discretized partial differential equations, using projection-based reduced-order models accelerated with hyperreduction (empirical quadrature) and embedded in a trust-region framework that guarantees global convergence. The proposed framework constructs a hyperreduced model on-the-fly during the solution of the optimization problem, which completely avoids an offline training phase. This ensures all snapshot information is collected along the optimization trajectory, which avoids wasting samples in remote regions of the parameters space that are never visited, and inherently avoids the curse of dimensionality of sampling in a high-dimensional parameter space. At each iteration of the proposed algorithm, a reduced basis and empirical quadrature weights are constructed precisely to ensure the global convergence criteria of the trust-region method are satisfied, ensuring global convergence to a local minimum of the original (unreduced) problem. Numerical experiments are performed on two fluid shape optimization problems to verify the global convergence of the method and demonstrate its computational efficiency; speedups over 18x (accounting for all computational cost, even cost that is traditionally considered "offline" such as snapshot collection and data compression) relative to standard optimization approaches that do not leverage model reduction are shown.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
-
Model reduction of convection-dominated partial differential equations via optimization-based implicit feature tracking
Authors:
Marzieh Alireza Mirhoseini,
Matthew J. Zahr
Abstract:
This work introduces a new approach to reduce the computational cost of solving partial differential equations (PDEs) with convection-dominated solutions: model reduction with implicit feature tracking. Traditional model reduction techniques use an affine subspace to reduce the dimensionality of the solution manifold and, as a result, yield limited reduction and require extensive training due to t…
▽ More
This work introduces a new approach to reduce the computational cost of solving partial differential equations (PDEs) with convection-dominated solutions: model reduction with implicit feature tracking. Traditional model reduction techniques use an affine subspace to reduce the dimensionality of the solution manifold and, as a result, yield limited reduction and require extensive training due to the slowly decaying Kolmogorov $n$-width of convection-dominated problems. The proposed approach circumvents the slowly decaying $n$-width limitation by using a nonlinear approximation manifold systematically defined by composing a low-dimensional affine space with a space of bijections of the underlying domain. Central to the implicit feature tracking approach is a residual minimization problem over the reduced nonlinear manifold that simultaneously determines the reduced coordinates in the affine space and the domain map** that minimize the residual of the unreduced PDE discretization. The nonlinear trial manifold is constructed by using the proposed residual minimization formulation to determine domain map**s that cause parametrized features to align in a reference domain for a set of training parameters. Because the feature is stationary in the reference domain, i.e., the convective nature of solution removed, the snapshots are effectively compressed to define an affine subspace. The space of domain map**s, originally constructed using high-order finite elements, are also compressed in a way that ensures the boundaries of the original domain are maintained. Several numerical experiments are provided, including transonic and supersonic, inviscid, compressible flows, to demonstrate the potential of the method to yield accurate approximations to convection-dominated problems with limited training.
△ Less
Submitted 29 September, 2021;
originally announced September 2021.
-
Accurate quantification of blood flow wall shear stress using simulation-based imaging: a synthetic, comparative study
Authors:
Charles J. Naudet,
Johannes Toger,
Matthew J. Zahr
Abstract:
Simulation-based imaging (SBI) is a blood flow imaging technique that optimally fits a computational fluid dynamics (CFD) simulation to low-resolution, noisy magnetic resonance (MR) flow data to produce a high-resolution velocity field. In this work, we study the effectivity of SBI in predicting wall shear stress (WSS) relative to standard magnetic resonance imaging (MRI) postprocessing techniques…
▽ More
Simulation-based imaging (SBI) is a blood flow imaging technique that optimally fits a computational fluid dynamics (CFD) simulation to low-resolution, noisy magnetic resonance (MR) flow data to produce a high-resolution velocity field. In this work, we study the effectivity of SBI in predicting wall shear stress (WSS) relative to standard magnetic resonance imaging (MRI) postprocessing techniques using two synthetic numerical experiments: flow through an idealized, two-dimensional stenotic vessel and a model of an adult aorta. In particular, we study the sensitivity of these two approaches with respect to the Reynolds number of the underlying flow, the resolution of the MRI data, and the noise in the MRI data. We found that the SBI WSS reconstruction: 1) is insensitive to Reynolds number over the range considered (Re $\leq$ 1000), 2) improves as the amount of MRI data increases and provides accurate reconstructions with as little as three MRI voxels per diameter, and 3) degrades linearly as the noise in the data increases with a slope determined by the resolution of the MRI data. We also consider the sensitivity of SBI to the resolution of the CFD mesh and found there is flexibility in the mesh used for SBI, although the WSS reconstruction becomes more sensitive to other parameters, particularly the resolution of the MRI data, for coarser meshes. This indicates a fundamental trade-off between scan time (i.e., MRI data quality and resolution) and reconstruction time using SBI, which is inherently different than the trade-off between scan time and reconstruction quality observed in standard MRI postprocessing techniques.
△ Less
Submitted 29 September, 2021;
originally announced September 2021.
-
A robust, high-order implicit shock tracking method for simulation of complex, high-speed flows
Authors:
Tianci Huang,
Matthew J. Zahr
Abstract:
High-order implicit shock tracking is a new class of numerical methods to approximate solutions of conservation laws with non-smooth features. These methods align elements of the computational mesh with non-smooth features to represent them perfectly, allowing high-order basis functions to approximate smooth regions of the solution without the need for nonlinear stabilization, which leads to accur…
▽ More
High-order implicit shock tracking is a new class of numerical methods to approximate solutions of conservation laws with non-smooth features. These methods align elements of the computational mesh with non-smooth features to represent them perfectly, allowing high-order basis functions to approximate smooth regions of the solution without the need for nonlinear stabilization, which leads to accurate approximations on traditionally coarse meshes. The hallmark of these methods is the underlying optimization formulation whose solution is a feature-aligned mesh and the corresponding high-order approximation to the flow; the key challenge is robustly solving the central optimization problem. In this work, we develop a robust optimization solver for high-order implicit shock tracking methods so they can be reliably used to simulate complex, high-speed, compressible flows in multiple dimensions. The proposed method integrates practical robustness measures into a sequential quadratic programming method, including dimension- and order-independent simplex element collapses, mesh smoothing, and element-wise solution re-initialization, which prove to be necessary to reliably track complex discontinuity surfaces, such as curved and reflecting shocks, shock formation, and shock-shock interaction. A series of nine numerical experiments -- including two- and three-dimensional compressible flows with complex discontinuity surfaces -- are used to demonstrate: 1) the robustness of the solver, 2) the meshes produced are high-quality and track continuous, non-smooth features in addition to discontinuities, 3) the method achieves the optimal convergence rate of the underlying discretization even for flows containing discontinuities, and 4) the method produces highly accurate solutions on extremely coarse meshes relative to approaches based on shock capturing.
△ Less
Submitted 13 January, 2022; v1 submitted 30 April, 2021;
originally announced May 2021.
-
A globally convergent method to accelerate topology optimization using on-the-fly model reduction
Authors:
Masayuki Yano,
Tianci Huang,
Matthew J. Zahr
Abstract:
We present a globally convergent method to accelerate density-based topology optimization using projection-based reduced-order models (ROMs) and trust-region methods. To accelerate topology optimization, we replace the large-scale finite element simulation, which dominates the computational cost, with ROMs that reduce the cost of objective function and gradient evaluations by orders of magnitude.…
▽ More
We present a globally convergent method to accelerate density-based topology optimization using projection-based reduced-order models (ROMs) and trust-region methods. To accelerate topology optimization, we replace the large-scale finite element simulation, which dominates the computational cost, with ROMs that reduce the cost of objective function and gradient evaluations by orders of magnitude. To guarantee convergence, we first introduce a trust-region method that employs generalized trust-region constraints and prove it is globally convergent. We then devise a class of globally convergent ROM-accelerated topology optimization methods informed by two theories: the aforementioned trust-region theory, which identifies the ROM accuracy conditions required to guarantee the method converges to a critical point of the original topology optimization problem; a posteriori error estimation theory for projection-based ROMs, which informs ROM construction procedure to meet the accuracy conditions. This leads to trust-region methods that construct and update the ROM on-the-fly during optimization; the methods are guaranteed to converge to a critical point of the original, unreduced topology optimization problem, regardless of starting point. Numerical experiments on three different structural topology optimization problems demonstrate the proposed reduced topology optimization methods accelerate convergence to the optimal design by up to an order of magnitude.
△ Less
Submitted 10 December, 2020; v1 submitted 12 April, 2020;
originally announced April 2020.
-
Implicit shock tracking using an optimization-based high-order discontinuous Galerkin method
Authors:
Matthew J. Zahr,
Andrew Shi,
Per-Olof Persson
Abstract:
A novel framework for resolving discontinuous solutions of conservation laws, e.g., contact lines, shock waves, and interfaces, using implicit tracking and a high-order discontinuous Galerkin (DG) discretization was introduced in [38]. Central to the framework is an optimization problem whose solution is a discontinuity-aligned mesh and the corresponding high-order approximation to the flow that d…
▽ More
A novel framework for resolving discontinuous solutions of conservation laws, e.g., contact lines, shock waves, and interfaces, using implicit tracking and a high-order discontinuous Galerkin (DG) discretization was introduced in [38]. Central to the framework is an optimization problem whose solution is a discontinuity-aligned mesh and the corresponding high-order approximation to the flow that does not require explicit meshing of the unknown discontinuity surface. The method was shown to deliver highly accurate solutions on coarse, high-order discretizations without nonlinear stabilization and recover optimal convergence rates even for problems with discontinuous solutions. This work extends the implicit tracking framework such that robustness is improved and convergence accelerated. In particular, we introduce an improved formulation of the central optimization problem and an associated sequential quadratic programming (SQP) solver. The new error-based objective function penalizes violation of the DG residual in an enriched test space and is shown to have excellent tracking properties. The SQP solver simultaneously converges the nodal coordinates of the mesh and DG solution to their optimal values and is equipped with a number of features to ensure robust, fast convergence: Levenberg-Marquardt approximation of the Hessian with weighted elliptic regularization, backtracking line search, and rigorous convergence criteria. We use the proposed method to solve a range of inviscid conservation laws of varying difficulty. We show the method is able to deliver accurate solutions on coarse, high-order meshes and the SQP solver is robust and usually able to drive the first-order optimality system to tight tolerances.
△ Less
Submitted 3 March, 2020; v1 submitted 23 December, 2019;
originally announced December 2019.
-
Non-intrusive model reduction of large-scale, nonlinear dynamical systems using deep learning
Authors:
Han Gao,
Jian-Xun Wang,
Matthew J. Zahr
Abstract:
Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For nonlinear systems, significant cost reduction is only possible with an additional layer of approximation to reduce the computational bottleneck of evaluating th…
▽ More
Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For nonlinear systems, significant cost reduction is only possible with an additional layer of approximation to reduce the computational bottleneck of evaluating the projected nonlinear terms. Prevailing methods to approximate the nonlinear terms are code intrusive, potentially requiring years of development time to integrate into an existing codebase, and have been known to lack parametric robustness.
This work develops a non-intrusive method to efficiently and accurately approximate the expensive nonlinear terms that arise in reduced nonlinear dynamical system using deep neural networks. The neural network is trained using only the simulation data used to construct the reduced basis and evaluations of the nonlinear terms at these snapshots. Once trained, the neural network-based reduced-order model only requires forward and backward propagation through the network to evaluate the nonlinear term and its derivative, which are used to integrate the reduced dynamical system at a new parameter configuration. We provide two numerical experiments---the dynamical systems result from the semi-discretization of parametrized, nonlinear, hyperbolic partial differential equations---that show, in addition to non-intrusivity, the proposed approach provides more stable and accurate approximations to each dynamical system across a large number of training and testing points than the popular empirical interpolation method.
△ Less
Submitted 9 June, 2020; v1 submitted 9 November, 2019;
originally announced November 2019.
-
High-order partitioned spectral deferred correction solvers for multiphysics problems
Authors:
Daniel Z. Huang,
Will Pazner,
Per-Olof Persson,
Matthew J. Zahr
Abstract:
We present an arbitrarily high-order, conditionally stable, partitioned spectral deferred correction (SDC) method for solving multiphysics problems using a sequence of pre-existing single-physics solvers. This method extends the work in [1, 2], which used implicit-explicit Runge-Kutta methods (IMEX) to build high-order, partitioned multiphysics solvers. We consider a generic multiphysics problem m…
▽ More
We present an arbitrarily high-order, conditionally stable, partitioned spectral deferred correction (SDC) method for solving multiphysics problems using a sequence of pre-existing single-physics solvers. This method extends the work in [1, 2], which used implicit-explicit Runge-Kutta methods (IMEX) to build high-order, partitioned multiphysics solvers. We consider a generic multiphysics problem modeled as a system of coupled ordinary differential equations (ODEs), coupled through coupling terms that can depend on the state of each subsystem; therefore the method applies to both a semi-discretized system of partial differential equations (PDEs) or problems naturally modeled as coupled systems of ODEs. The sufficient conditions to build arbitrarily high-order partitioned SDC schemes are derived. Based on these conditions, various of partitioned SDC schemes are designed. The stability of the first-order partitioned SDC scheme is analyzed in detail on a coupled, linear model problem. We show that the scheme is conditionally stable, and under conditions on the coupling strength, the scheme can be unconditionally stable. We demonstrate the performance of the proposed partitioned solvers on several classes of multiphysics problems including a simple linear system of ODEs, advection-diffusion-reaction systems, and fluid-structure interaction problems with both incompressible and compressible flows, where we verify the design order of the SDC schemes and study various stability properties. We also directly compare the accuracy, stability, and cost of the proposed partitioned SDC solver with the partitioned IMEX method in [1, 2] on this suite of test problems. The results suggest that the high-order partitioned SDC solvers are more robust than the partitioned IMEX solvers for the numerical examples considered in this work, while the IMEX methods require fewer implicit solves.
△ Less
Submitted 3 April, 2020; v1 submitted 3 September, 2019;
originally announced September 2019.
-
A high-order partitioned solver for general multiphysics problems and its applications in optimization
Authors:
Daniel Z. Huang,
Per-Olof Persson,
Matthew J. Zahr
Abstract:
A high-order accurate adjoint-based optimization framework is presented for unsteady multiphysics problems. The fully discrete adjoint solver relies on the high-order, linearly stable, partitioned solver introduced in [1], where different subsystems are modeled and discretized separately. The coupled system of semi-discretized ordinary differential equations is taken as a monolithic system and par…
▽ More
A high-order accurate adjoint-based optimization framework is presented for unsteady multiphysics problems. The fully discrete adjoint solver relies on the high-order, linearly stable, partitioned solver introduced in [1], where different subsystems are modeled and discretized separately. The coupled system of semi-discretized ordinary differential equations is taken as a monolithic system and partitioned using an implicit-explicit Runge-Kutta (IMEX-RK) discretization [2]. Quantities of interest (QoI) that take the form of space-time integrals are discretized in a solver-consistent manner. The corresponding adjoint equations are derived to compute exact gradients of QoI, which can be solved in a partitioned manner, i.e. subsystem-by-subsystem and substage-by-substage, thanks to the partitioned primal solver. These quantities of interest and their gradients are then used in the context of gradient-based PDE-constrained optimization. The present optimization framework is applied to two fluid-structure interaction problems: 1D piston problem with a three-field formulation and a 2D energy harvesting problem with a two-field formulation.
△ Less
Submitted 26 December, 2018;
originally announced December 2018.
-
An efficient, globally convergent method for optimization under uncertainty using adaptive model reduction and sparse grids
Authors:
Matthew J. Zahr,
Kevin T. Carlberg,
Drew P. Kouri
Abstract:
This work introduces a new method to efficiently solve optimization problems constrained by partial differential equations (PDEs) with uncertain coefficients. The method leverages two sources of inexactness that trade accuracy for speed: (1) stochastic collocation based on dimension-adaptive sparse grids (SGs), which approximates the stochastic objective function with a limited number of quadratur…
▽ More
This work introduces a new method to efficiently solve optimization problems constrained by partial differential equations (PDEs) with uncertain coefficients. The method leverages two sources of inexactness that trade accuracy for speed: (1) stochastic collocation based on dimension-adaptive sparse grids (SGs), which approximates the stochastic objective function with a limited number of quadrature nodes, and (2) projection-based reduced-order models (ROMs), which generate efficient approximations to PDE solutions. These two sources of inexactness lead to inexact objective function and gradient evaluations, which are managed by a trust-region method that guarantees global convergence by adaptively refining the sparse grid and reduced-order model until a proposed error indicator drops below a tolerance specified by trust-region convergence theory. A key feature of the proposed method is that the error indicator---which accounts for errors incurred by both the sparse grid and reduced-order model---must be only an asymptotic error bound, i.e., a bound that holds up to an arbitrary constant that need not be computed. This enables the method to be applicable to a wide range of problems, including those where sharp, computable error bounds are not available; this distinguishes the proposed method from previous works. Numerical experiments performed on a model problem from optimal flow control under uncertainty verify global convergence of the method and demonstrate the method's ability to outperform previously proposed alternatives.
△ Less
Submitted 16 May, 2019; v1 submitted 31 October, 2018;
originally announced November 2018.
-
High-order, linearly stable, partitioned solvers for general multiphysics problems based on implicit-explicit Runge-Kutta schemes
Authors:
Daniel Z. Huang,
Per-Olof Persson,
Matthew J. Zahr
Abstract:
This work introduces a general framework for constructing high-order, linearly stable, partitioned solvers for multiphysics problems from a monolithic implicit-explicit Runge-Kutta (IMEX-RK) discretization of the semi-discrete equations. The generic multiphysics problem is modeled as a system of n systems of partial differential equations where the ith subsystem is coupled to the other subsystems…
▽ More
This work introduces a general framework for constructing high-order, linearly stable, partitioned solvers for multiphysics problems from a monolithic implicit-explicit Runge-Kutta (IMEX-RK) discretization of the semi-discrete equations. The generic multiphysics problem is modeled as a system of n systems of partial differential equations where the ith subsystem is coupled to the other subsystems through a coupling term that can depend on the state of all the other subsystems. This coupled system of partial differential equations reduces to a coupled system of ordinary differential equations via the method of lines where an appropriate spatial discretization is applied to each subsystem. The coupled system of ordinary differential equations is taken as a monolithic system and discretized using an IMEX-RK discretization with a specific implicit-explicit decomposition that introduces the concept of a predictor for the coupling term. We propose four coupling predictors that enable the monolithic system to be solved in a partitioned manner and preserve the IMEX-RK structure and therefore the design order of accuracy of the monolithic scheme. The four partitioned solvers that result from these predictors are high-order accurate, allow for maximum re-use of existing single-physics software, and two of the four solvers allow the subsystems to be solved in parallel at a given stage and time step. We also analyze the stability of a coupled, linear model problem and show that one of the partitioned solvers achieves unconditional linear stability, while the others are unconditionally stable only for certain values of the coupling strength. We demonstrate the performance of the proposed partitioned solvers on several classes of multiphysics problems including a simple linear system of ODEs, advection-diffusion-reaction systems, FSI problems, and particle-laden flows.
△ Less
Submitted 1 September, 2018; v1 submitted 30 March, 2018;
originally announced March 2018.
-
An optimization-based approach for high-order accurate discretization of conservation laws with discontinuous solutions
Authors:
Matthew J. Zahr,
Per-Olof Persson
Abstract:
This work introduces a novel discontinuity-tracking framework for resolving discontinuous solutions of conservation laws with high-order numerical discretizations that support inter-element solution discontinuities, such as discontinuous Galerkin methods. The proposed method aims to align inter-element boundaries with discontinuities in the solution by deforming the computational mesh. A discontin…
▽ More
This work introduces a novel discontinuity-tracking framework for resolving discontinuous solutions of conservation laws with high-order numerical discretizations that support inter-element solution discontinuities, such as discontinuous Galerkin methods. The proposed method aims to align inter-element boundaries with discontinuities in the solution by deforming the computational mesh. A discontinuity-aligned mesh ensures the discontinuity is represented through inter-element jumps while smooth basis functions interior to elements are only used to approximate smooth regions of the solution, thereby avoiding Gibbs' phenomena that create well-known stability issues. Therefore, very coarse high-order discretizations accurately resolve the piecewise smooth solution throughout the domain, provided the discontinuity is tracked. Central to the proposed discontinuity-tracking framework is a discrete PDE-constrained optimization formulation that simultaneously aligns the computational mesh with discontinuities in the solution and solves the discretized conservation law on this mesh. The optimization objective is taken as a combination of the the deviation of the finite-dimensional solution from its element-wise average and a mesh distortion metric to simultaneously penalize Gibbs' phenomena and distorted meshes. We advocate a gradient-based, full space solver where the mesh and conservation law solution converge to their optimal values simultaneously and therefore never require the solution of the discrete conservation law on a non-aligned mesh. The merit of the proposed method is demonstrated on a number of one- and two-dimensional model problems including 2D supersonic flow around a bluff body. We demonstrate optimal $\mathcal{O}(h^{p+1})$ convergence rates in the $L^1$ norm for up to polynomial order $p=6$ and show that accurate solutions can be obtained on extremely coarse meshes.
△ Less
Submitted 20 March, 2018; v1 submitted 9 December, 2017;
originally announced December 2017.
-
An Adjoint Method for a High-Order Discretization of Deforming Domain Conservation Laws for Optimization of Flow Problems
Authors:
Matthew J. Zahr,
Per-Olof Persson
Abstract:
The fully discrete adjoint equations and the corresponding adjoint method are derived for a globally high- order accurate discretization of conservation laws on parametrized, deforming domains. The conservation law on the deforming domain is transformed into one on a fixed reference domain by the introduction of a time-dependent map** that encapsulates the domain deformation and parametrization,…
▽ More
The fully discrete adjoint equations and the corresponding adjoint method are derived for a globally high- order accurate discretization of conservation laws on parametrized, deforming domains. The conservation law on the deforming domain is transformed into one on a fixed reference domain by the introduction of a time-dependent map** that encapsulates the domain deformation and parametrization, resulting in an Arbitrary Lagrangian-Eulerian form of the governing equations. A high-order discontinuous Galerkin method is used to discretize the transformed equation in space and a high-order diagonally implicit Runge- Kutta scheme is used for the temporal discretization. Quantities of interest that take the form of space-time integrals are discretized in a solver-consistent manner. The corresponding fully discrete adjoint method is used to compute exact gradients of quantities of interest along the manifold of solutions of the fully discrete conservation law.
The adjoint method is used to solve two optimal shape and control problems governed by the isentropic, compressible Navier-Stokes equations. The first optimization problem seeks the energetically optimal trajectory of a 2D airfoil given a required initial and final spatial position. The optimization solver, driven by gradients computed via the adjoint method, reduced the total energy required to complete the specified mission nearly an order of magnitude. The second optimization problem seeks the energetically optimal flap** motion and time-morphed geometry of a 2D airfoil given an equality constraint on the x-directed impulse generated on the airfoil. The optimization solver satisfied the impulse constraint to greater than 8 digits of accuracy and reduced the required energy between a factor of 2 and 10, depending on the value of the impulse constraint, as compared to the nominal configuration.
△ Less
Submitted 19 September, 2016; v1 submitted 14 December, 2015;
originally announced December 2015.
-
A Fully Discrete Adjoint Method for Optimization of Flow Problems on Deforming Domains with Time-Periodicity Constraints
Authors:
Matthew J. Zahr,
Per-Olof Persson,
Jon Wilkening
Abstract:
A variety of shooting methods for computing fully discrete time-periodic solutions of partial differential equations, including Newton-Krylov and optimization-based methods, are discussed and used to determine the periodic, compressible, viscous flow around a 2D flap** airfoil. The Newton-Krylov method uses matrix-free GMRES to solve the linear systems of equations that arise in the nonlinear it…
▽ More
A variety of shooting methods for computing fully discrete time-periodic solutions of partial differential equations, including Newton-Krylov and optimization-based methods, are discussed and used to determine the periodic, compressible, viscous flow around a 2D flap** airfoil. The Newton-Krylov method uses matrix-free GMRES to solve the linear systems of equations that arise in the nonlinear iterations, with matrix-vector products computed via the linearized sensitivity evolution equations. The adjoint method is used to compute gradients for the gradient-based optimization shooting methods. The Newton-Krylov method is shown to exhibit superior convergence to the optimal solution for these fluid problems, and fully leverages quality starting data.
The central contribution of this work is the derivation of the adjoint equations and the corresponding adjoint method for fully discrete, time-periodically constrained partial differential equations. These adjoint equations constitute a linear, two-point boundary value problem that is provably solvable. The periodic adjoint method is used to compute gradients of quantities of interest along the manifold of time-periodic solutions of the discrete partial differential equation, which is verified against a second-order finite difference approximation. These gradients are then used in a gradient-based optimization framework to determine the energetically optimal flap** motion of a 2D airfoil in compressible, viscous flow over a single cycle, such that the time-averaged thrust is identically zero. In less than 20 optimization iterations, the flap** energy was reduced nearly an order of magnitude and the thrust constraint satisfied to 5 digits of accuracy.
△ Less
Submitted 12 August, 2016; v1 submitted 2 December, 2015;
originally announced December 2015.
-
Progressive construction of a parametric reduced-order model for PDE-constrained optimization
Authors:
Matthew J. Zahr,
Charbel Farhat
Abstract:
An adaptive approach to using reduced-order models as surrogates in PDE-constrained optimization is introduced that breaks the traditional offline-online framework of model order reduction. A sequence of optimization problems constrained by a given Reduced-Order Model (ROM) is defined with the goal of converging to the solution of a given PDE-constrained optimization problem. For each reduced opti…
▽ More
An adaptive approach to using reduced-order models as surrogates in PDE-constrained optimization is introduced that breaks the traditional offline-online framework of model order reduction. A sequence of optimization problems constrained by a given Reduced-Order Model (ROM) is defined with the goal of converging to the solution of a given PDE-constrained optimization problem. For each reduced optimization problem, the constraining ROM is trained from sampling the High-Dimensional Model (HDM) at the solution of some of the previous problems in the sequence. The reduced optimization problems are equipped with a nonlinear trust-region based on a residual error indicator to keep the optimization trajectory in a region of the parameter space where the ROM is accurate. A technique for incorporating sensitivities into a Reduced-Order Basis (ROB) is also presented, along with a methodology for computing sensitivities of the reduced-order model that minimizes the distance to the corresponding HDM sensitivity, in a suitable norm. The proposed reduced optimization framework is applied to subsonic aerodynamic shape optimization and shown to reduce the number of queries to the HDM by a factor of 4-5, compared to the optimization problem solved using only the HDM, with errors in the optimal solution far less than 0.1%.
△ Less
Submitted 28 July, 2014;
originally announced July 2014.
