-
Rank Reduction Autoencoders -- Enhancing interpolation on nonlinear manifolds
Authors:
Jad Mounayer,
Sebastian Rodriguez,
Chady Ghnatios,
Charbel Farhat,
Francisco Chinesta
Abstract:
The efficiency of classical Autoencoders (AEs) is limited in many practical situations. When the latent space is reduced through autoencoders, feature extraction becomes possible. However, overfitting is a common issue, leading to ``holes'' in AEs' interpolation capabilities. On the other hand, increasing the latent dimension results in a better approximation with fewer non-linearly coupled featur…
▽ More
The efficiency of classical Autoencoders (AEs) is limited in many practical situations. When the latent space is reduced through autoencoders, feature extraction becomes possible. However, overfitting is a common issue, leading to ``holes'' in AEs' interpolation capabilities. On the other hand, increasing the latent dimension results in a better approximation with fewer non-linearly coupled features (e.g., Koopman theory or kPCA), but it doesn't necessarily lead to dimensionality reduction, which makes feature extraction problematic. As a result, interpolating using Autoencoders gets harder. In this work, we introduce the Rank Reduction Autoencoder (RRAE), an autoencoder with an enlarged latent space, which is constrained to have a small pre-specified number of dominant singular values (i.e., low-rank). The latent space of RRAEs is large enough to enable accurate predictions while enabling feature extraction. As a result, the proposed autoencoder features a minimal rank linear latent space. To achieve what's proposed, two formulations are presented, a strong and a weak one, that build a reduced basis accurately representing the latent space. The first formulation consists of a truncated SVD in the latent space, while the second one adds a penalty term to the loss function. We show the efficiency of our formulations by using them for interpolation tasks and comparing the results to other autoencoders on both synthetic data and MNIST.
△ Less
Submitted 22 May, 2024;
originally announced May 2024.
-
Neural-Network-Augmented Projection-Based Model Order Reduction for Mitigating the Kolmogorov Barrier to Reducibility of CFD Models
Authors:
Joshua L Barnett,
Charbel Farhat,
Yvon Maday
Abstract:
Inspired by our previous work on mitigating the Kolmogorov barrier using a quadratic approximation manifold, we propose in this paper a computationally tractable approach for combining a projection-based reduced-order model (PROM) and an artificial neural network (ANN) for mitigating the Kolmogorov barrier to reducibility of convection-dominated flow problems. The main objective the PROM-ANN conce…
▽ More
Inspired by our previous work on mitigating the Kolmogorov barrier using a quadratic approximation manifold, we propose in this paper a computationally tractable approach for combining a projection-based reduced-order model (PROM) and an artificial neural network (ANN) for mitigating the Kolmogorov barrier to reducibility of convection-dominated flow problems. The main objective the PROM-ANN concept that we propose is to reduce the dimensionality of the online approximation of the solution beyond what is possible using affine and quadratic approximation manifolds. In contrast to previous approaches for constructing arbitrarily nonlinear manifold approximations for nonlinear model reduction that exploited one form or another of ANN, the training of the PROM-ANN we propose in this paper does not involve data whose dimension scales with that of the high-dimensional model; and this PROM-ANN is hyperreducible using any well-established hyperreduction method. Hence, unlike many other ANN-based approaches, the PROM-ANN concept we propose in this paper is practical for large-scale and industry-relevant CFD problems. Its potential is demonstrated here for a parametric, shock-dominated, benchmark problem.
△ Less
Submitted 17 December, 2022;
originally announced December 2022.
-
Quadratic Approximation Manifold for Mitigating the Kolmogorov Barrier in Nonlinear Projection-Based Model Order Reduction
Authors:
Joshua Barnett,
Charbel Farhat
Abstract:
A quadratic approximation manifold is presented for performing nonlinear, projection-based, model order reduction (PMOR). It constitutes a departure from the traditional affine subspace approximation that is aimed at mitigating the Kolmogorov barrier for nonlinear PMOR, particularly for convection-dominated transport problems. It builds on the data-driven approach underlying the traditional constr…
▽ More
A quadratic approximation manifold is presented for performing nonlinear, projection-based, model order reduction (PMOR). It constitutes a departure from the traditional affine subspace approximation that is aimed at mitigating the Kolmogorov barrier for nonlinear PMOR, particularly for convection-dominated transport problems. It builds on the data-driven approach underlying the traditional construction of projection-based reduced-order models (PROMs); is application-independent; is linearization-free; and therefore is robust for highly nonlinear problems. Most importantly, this approximation leads to quadratic PROMs that deliver the same accuracy as their traditional counterparts using however a much smaller dimension -- typically, $n_2 \sim \sqrt n_1$, where $n_2$ and $n_1$ denote the dimensions of the quadratic and traditional PROMs, respectively. The computational advantages of the proposed high-order approach to nonlinear PMOR over the traditional approach are highlighted for the detached-eddy simulation-based prediction of the Ahmed body turbulent wake flow, which is a popular CFD benchmark problem in the automotive industry. For a fixed accuracy level, these advantages include: a reduction of the total offline computational cost by a factor greater than five; a reduction of its online wall clock time by a factor greater than 32; and a reduction of the wall clock time of the underlying high-dimensional model by a factor greater than two orders of magnitude.
△ Less
Submitted 5 April, 2022;
originally announced April 2022.
-
Mesh sampling and weighting for the hyperreduction of nonlinear Petrov-Galerkin reduced-order models with local reduced-order bases
Authors:
Sebastian Grimberg,
Charbel Farhat,
Radek Tezaur,
Charbel Bou-Mosleh
Abstract:
The energy-conserving sampling and weighting (ECSW) method is a hyperreduction method originally developed for accelerating the performance of Galerkin projection-based reduced-order models (PROMs) associated with large-scale finite element models, when the underlying projected operators need to be frequently recomputed as in parametric and/or nonlinear problems. In this paper, this hyperreduction…
▽ More
The energy-conserving sampling and weighting (ECSW) method is a hyperreduction method originally developed for accelerating the performance of Galerkin projection-based reduced-order models (PROMs) associated with large-scale finite element models, when the underlying projected operators need to be frequently recomputed as in parametric and/or nonlinear problems. In this paper, this hyperreduction method is extended to Petrov-Galerkin PROMs where the underlying high-dimensional models can be associated with arbitrary finite element, finite volume, and finite difference semi-discretization methods. Its scope is also extended to cover local PROMs based on piecewise-affine approximation subspaces, such as those designed for mitigating the Kolmogorov $n$-width barrier issue associated with convection-dominated flow problems. The resulting ECSW method is shown in this paper to be robust and accurate. In particular, its offline phase is shown to be fast and parallelizable, and the potential of its online phase for large-scale applications of industrial relevance is demonstrated for turbulent flow problems with $O(10^7)$ and $O(10^8)$ degrees of freedom. For such problems, the online part of the ECSW method proposed in this paper for Petrov-Galerkin PROMs is shown to enable wall-clock time and CPU time speedup factors of several orders of magnitude while delivering exceptional accuracy.
△ Less
Submitted 6 August, 2020;
originally announced August 2020.
-
A Computationally Tractable Framework for Nonlinear Dynamic Multiscale Modeling of Membrane Fabric
Authors:
Philip Avery,
Daniel Z. Huang,
Wanli He,
Johanna Ehlers,
Armen Derkevorkian,
Charbel Farhat
Abstract:
A general-purpose computational homogenization framework is proposed for the nonlinear dynamic analysis of membranes exhibiting complex microscale and/or mesoscale heterogeneity characterized by in-plane periodicity that cannot be effectively treated by a conventional method, such as woven fabrics. The framework is a generalization of the "finite element squared" (or FE2) method in which a localiz…
▽ More
A general-purpose computational homogenization framework is proposed for the nonlinear dynamic analysis of membranes exhibiting complex microscale and/or mesoscale heterogeneity characterized by in-plane periodicity that cannot be effectively treated by a conventional method, such as woven fabrics. The framework is a generalization of the "finite element squared" (or FE2) method in which a localized portion of the periodic subscale structure is modeled using finite elements. The numerical solution of displacement driven problems involving this model can be adapted to the context of membranes by a variant of the Klinkel-Govindjee method[1] originally proposed for using finite strain, three-dimensional material models in beam and shell elements. This approach relies on numerical enforcement of the plane stress constraint and is enabled by the principle of frame invariance. Computational tractability is achieved by introducing a regression-based surrogate model informed by a physics-inspired training regimen in which FE$^2$ is utilized to simulate a variety of numerical experiments including uniaxial, biaxial and shear straining of a material coupon. Several alternative surrogate models are evaluated including an artificial neural network. The framework is demonstrated and validated for a realistic Mars landing application involving supersonic inflation of a parachute canopy made of woven fabric.
△ Less
Submitted 27 January, 2021; v1 submitted 11 July, 2020;
originally announced July 2020.
-
Model Reduction Framework with a New Take on Active Subspaces for Optimization Problems with Linearized Fluid-Structure Interaction Constraints
Authors:
Gabriele Boncoraglio,
Charbel Farhat,
Charbel Bou-Mosleh
Abstract:
In this paper, a new take on the concept of an active subspace for reducing the dimension of the design parameter space in a multidisciplinary analysis and optimization (MDAO) problem is proposed. The new approach is intertwined with the concepts of adaptive parameter sampling, projection-based model order reduction, and a database of linear, projection-based reduced-order models equipped with int…
▽ More
In this paper, a new take on the concept of an active subspace for reducing the dimension of the design parameter space in a multidisciplinary analysis and optimization (MDAO) problem is proposed. The new approach is intertwined with the concepts of adaptive parameter sampling, projection-based model order reduction, and a database of linear, projection-based reduced-order models equipped with interpolation on matrix manifolds, in order to construct an efficient computational framework for MDAO. The framework is fully developed for MDAO problems with linearized fluid-structure interaction constraints. It is applied to the aeroelastic tailoring, under flutter constraints, of two different flight systems: a flexible configuration of NASA's Common Research Model; and NASA's Aeroelastic Research Wing #2 (ARW-2). The obtained results illustrate the feasibility of the computational framework for realistic MDAO problems and highlight the benefits of the new approach for constructing an active subspace in both terms of solution optimality and wall-clock time reduction
△ Less
Submitted 13 February, 2020;
originally announced February 2020.
-
On the stability of projection-based model order reduction for convection-dominated laminar and turbulent flows
Authors:
Sebastian Grimberg,
Charbel Farhat,
Noah Youkilis
Abstract:
In the literature on projection-based nonlinear model order reduction for fluid dynamics problems, it is often claimed that due to modal truncation, a projection-based reduced-order model (PROM) does not resolve the dissipative regime of the turbulent energy cascade and therefore is numerically unstable. Efforts at addressing this claim have ranged from attempting to model the effects of the trunc…
▽ More
In the literature on projection-based nonlinear model order reduction for fluid dynamics problems, it is often claimed that due to modal truncation, a projection-based reduced-order model (PROM) does not resolve the dissipative regime of the turbulent energy cascade and therefore is numerically unstable. Efforts at addressing this claim have ranged from attempting to model the effects of the truncated modes to enriching the classical subspace of approximation in order to account for the truncated phenomena. This paper challenges this claim. Exploring the relationship between projection-based model order reduction and semi-discretization and using numerical evidence from three relevant flow problems, it argues in an orderly manner that the real culprit behind most if not all reported numerical instabilities of PROMs for turbulence and convection-dominated turbulent flow problems is the Galerkin framework that has been used for constructing the PROMs. The paper also shows that alternatively, a Petrov-Galerkin framework can be used to construct numerically stable PROMs for convection-dominated laminar as well as turbulent flow problems that are numerically stable and accurate, without resorting to additional closure models or tailoring of the subspace of approximation. It also shows that such alternative PROMs deliver significant speedup factors.
△ Less
Submitted 27 January, 2020;
originally announced January 2020.
-
Modeling, simulation and validation of supersonic parachute inflation dynamics during Mars landing
Authors:
Daniel Z. Huang,
Philip Avery,
Charbel Farhat,
Jason Rabinovitch,
Armen Derkevorkian,
Lee D Peterson
Abstract:
A high fidelity multi-physics Eulerian computational framework is presented for the simulation of supersonic parachute inflation during Mars landing. Unlike previous investigations in this area, the framework takes into account an initial folding pattern of the parachute, the flow compressibility effect on the fabric material porosity, and the interactions between supersonic fluid flows and the su…
▽ More
A high fidelity multi-physics Eulerian computational framework is presented for the simulation of supersonic parachute inflation during Mars landing. Unlike previous investigations in this area, the framework takes into account an initial folding pattern of the parachute, the flow compressibility effect on the fabric material porosity, and the interactions between supersonic fluid flows and the suspension lines. Several adaptive mesh refinement (AMR)-enabled, large edge simulation (LES)-based, simulations of a full-size disk-gap-band (DGB) parachute inflating in the low-density, low-pressure, carbon dioxide (CO2) Martian atmosphere are reported. The comparison of the drag histories and the first peak forces between the simulation results and experimental data collected during the NASA Curiosity Rover's Mars atmospheric entry shows reasonable agreements. Furthermore, a rudimentary material failure analysis is performed to provide an estimate of the safety factor for the parachute decelerator system. The proposed framework demonstrates the potential of using Computational Fluid Dynamics (CFD) and Fluid-Structure Interaction (FSI)-based simulation tools for future supersonic parachute design.
△ Less
Submitted 3 December, 2019;
originally announced December 2019.
-
An Embedded Boundary Approach for Resolving the Contribution of Cable Subsystems to Fully Coupled Fluid-Structure Interaction
Authors:
Daniel Z. Huang,
Philip Avery,
Charbel Farhat
Abstract:
Cable subsystems characterized by long, slender, and flexible structural elements are featured in numerous engineering systems. In each of them, interaction between an individual cable and the surrounding fluid is inevitable. Such a Fluid-Structure Interaction (FSI) has received little attention in the literature, possibly due to the inherent complexity associated with fluid and structural semi-di…
▽ More
Cable subsystems characterized by long, slender, and flexible structural elements are featured in numerous engineering systems. In each of them, interaction between an individual cable and the surrounding fluid is inevitable. Such a Fluid-Structure Interaction (FSI) has received little attention in the literature, possibly due to the inherent complexity associated with fluid and structural semi-discretizations of disparate spatial dimensions. This paper proposes an embedded boundary approach for filling this gap, where the dynamics of the cable are captured by a standard finite element representation $\mathcal C$ of its centerline, while its geometry is represented by a discrete surface $Σ_h$ that is embedded in the fluid mesh. The proposed approach is built on master-slave kinematics between $\mathcal C$ and $Σ_h$, a simple algorithm for computing the motion/deformation of $Σ_h$ based on the dynamic state of $\mathcal C$, and an energy-conserving method for transferring to $\mathcal C$ the loads computed on $Σ_h$. Its effectiveness is demonstrated for two highly nonlinear applications featuring large deformations and/or motions of a cable subsystem and turbulent flows: an aerial refueling model problem, and a challenging supersonic parachute inflation problem. The proposed approach is verified using numerical data, and validated using real flight data.
△ Less
Submitted 6 November, 2019; v1 submitted 11 August, 2019;
originally announced August 2019.
-
Fast Neural Network Predictions from Constrained Aerodynamics Datasets
Authors:
Cristina White,
Daniela Ushizima,
Charbel Farhat
Abstract:
Incorporating computational fluid dynamics in the design process of jets, spacecraft, or gas turbine engines is often challenged by the required computational resources and simulation time, which depend on the chosen physics-based computational models and grid resolutions. An ongoing problem in the field is how to simulate these systems faster but with sufficient accuracy. While many approaches in…
▽ More
Incorporating computational fluid dynamics in the design process of jets, spacecraft, or gas turbine engines is often challenged by the required computational resources and simulation time, which depend on the chosen physics-based computational models and grid resolutions. An ongoing problem in the field is how to simulate these systems faster but with sufficient accuracy. While many approaches involve simplified models of the underlying physics, others are model-free and make predictions based only on existing simulation data. We present a novel model-free approach in which we reformulate the simulation problem to effectively increase the size of constrained pre-computed datasets and introduce a novel neural network architecture (called a cluster network) with an inductive bias well-suited to highly nonlinear computational fluid dynamics solutions. Compared to the state-of-the-art in model-based approximations, we show that our approach is nearly as accurate, an order of magnitude faster, and easier to apply. Furthermore, we show that our method outperforms other model-free approaches.
△ Less
Submitted 5 December, 2019; v1 submitted 25 January, 2019;
originally announced February 2019.