-
In Situ Framework for Coupling Simulation and Machine Learning with Application to CFD
Authors:
Riccardo Balin,
Filippo Simini,
Cooper Simpson,
Andrew Shao,
Alessandro Rigazzi,
Matthew Ellis,
Stephen Becker,
Alireza Doostan,
John A. Evans,
Kenneth E. Jansen
Abstract:
Recent years have seen many successful applications of machine learning (ML) to facilitate fluid dynamic computations. As simulations grow, generating new training datasets for traditional offline learning creates I/O and storage bottlenecks. Additionally, performing inference at runtime requires non-trivial coupling of ML framework libraries with simulation codes. This work offers a solution to b…
▽ More
Recent years have seen many successful applications of machine learning (ML) to facilitate fluid dynamic computations. As simulations grow, generating new training datasets for traditional offline learning creates I/O and storage bottlenecks. Additionally, performing inference at runtime requires non-trivial coupling of ML framework libraries with simulation codes. This work offers a solution to both limitations by simplifying this coupling and enabling in situ training and inference workflows on heterogeneous clusters. Leveraging SmartSim, the presented framework deploys a database to store data and ML models in memory, thus circumventing the file system. On the Polaris supercomputer, we demonstrate perfect scaling efficiency to the full machine size of the data transfer and inference costs thanks to a novel co-located deployment of the database. Moreover, we train an autoencoder in situ from a turbulent flow simulation, showing that the framework overhead is negligible relative to a solver time step and training epoch.
△ Less
Submitted 22 June, 2023;
originally announced June 2023.
-
Turbulent boundary layer with strong favorable pressure gradient and curvature effects: Streamline coordinate and scaling analysis
Authors:
Aviral Prakash,
Riccardo Balin,
John A. Evans,
Kenneth E. Jansen
Abstract:
Direct numerical simulation (DNS) of a turbulent boundary layer over the Gaussian (Boeing) bump is performed. This boundary layer exhibits a series of adverse and favorable pressure gradients and convex and concave curvature effects before separating. These effects on turbulent boundary layers are characterized and compared to a lower Reynolds number flow over the same geometry. The momentum budge…
▽ More
Direct numerical simulation (DNS) of a turbulent boundary layer over the Gaussian (Boeing) bump is performed. This boundary layer exhibits a series of adverse and favorable pressure gradients and convex and concave curvature effects before separating. These effects on turbulent boundary layers are characterized and compared to a lower Reynolds number flow over the same geometry. The momentum budgets are analyzed in the streamline-aligned coordinate system upstream of the separation region. These momentum budgets allow the simplification of equations to facilitate an integral analysis. Integral analysis-based scalings for Reynolds stresses in the inner and outer regions of the boundary layer are also formulated. These proposed scalings exhibit a better collapse of Reynolds stress profiles compared to friction velocity scaling and Zagarola-Smits scaling in the strong favorable pressure gradient region and in the mild adverse pressure region that precedes it in this flow.
△ Less
Submitted 9 June, 2023;
originally announced June 2023.
-
Invariant Data-Driven Subgrid Stress Modeling on Anisotropic Grids for Large Eddy Simulation
Authors:
Aviral Prakash,
Kenneth E. Jansen,
John A. Evans
Abstract:
We present a new approach for constructing data-driven subgrid stress models for large eddy simulation of turbulent flows using anisotropic grids. The key to our approach is a Galilean, rotationally, reflectionally and unit invariant model form that also embeds filter anisotropy in such a way that an important subgrid stress identity is satisfied. We use this model form to train a data-driven subg…
▽ More
We present a new approach for constructing data-driven subgrid stress models for large eddy simulation of turbulent flows using anisotropic grids. The key to our approach is a Galilean, rotationally, reflectionally and unit invariant model form that also embeds filter anisotropy in such a way that an important subgrid stress identity is satisfied. We use this model form to train a data-driven subgrid stress model using only a small amount of anisotropically filtered DNS data and a simple and inexpensive neural network architecture. A priori and a posteriori tests indicate that the trained data-driven model generalizes well to filter anisotropy ratios, Reynolds numbers and flow physics outside the training dataset.
△ Less
Submitted 17 July, 2023; v1 submitted 1 December, 2022;
originally announced December 2022.
-
Optimal Clip** of Structural Subgrid Stress Closures for Large Eddy Simulation
Authors:
Aviral Prakash,
Kenneth E. Jansen,
John A. Evans
Abstract:
Structural subgrid stress models for large eddy simulation often allow for backscatter of energy from unresolved to resolved turbulent scales, but excessive model backscatter can eventually result in numerical instability. A commonly employed strategy to overcome this issue is to set predicted subgrid stresses to zero in regions of model backscatter. This clip** procedure improves the stability…
▽ More
Structural subgrid stress models for large eddy simulation often allow for backscatter of energy from unresolved to resolved turbulent scales, but excessive model backscatter can eventually result in numerical instability. A commonly employed strategy to overcome this issue is to set predicted subgrid stresses to zero in regions of model backscatter. This clip** procedure improves the stability of structural models, however, at the cost of reduced correlation between the predicted subgrid stresses and the exact subgrid stresses. In this article, we propose an alternative strategy that removes model backscatter from model predictions through the solution of a constrained minimization problem. This procedure, which we refer to as optimal clip**, results in a parameter-free mixed model, and it yields predicted subgrid stresses in higher correlation with the exact subgrid stresses as compared with those attained with the traditional clip** procedure. We perform a series of a priori and a posteriori tests to investigate the impact of applying the traditional and optimal clip** procedures to Clark's gradient subgrid stress model, and we observe that optimal clip** leads to a significant improvement in model predictions as compared to the traditional clip** procedure.
△ Less
Submitted 22 February, 2022; v1 submitted 22 January, 2022;
originally announced January 2022.
-
Invariant Data-Driven Subgrid Stress Modeling in the Strain-Rate Eigenframe for Large Eddy Simulation
Authors:
Aviral Prakash,
Kenneth E. Jansen,
John A. Evans
Abstract:
We present a new approach for constructing data-driven subgrid stress models for large eddy simulation of turbulent flows. The key to our approach is representation of model input and output tensors in the filtered strain rate eigenframe. Provided inputs and outputs are selected and non-dimensionalized in a suitable manner, this yields a model form that is symmetric, Galilean invariant, rotational…
▽ More
We present a new approach for constructing data-driven subgrid stress models for large eddy simulation of turbulent flows. The key to our approach is representation of model input and output tensors in the filtered strain rate eigenframe. Provided inputs and outputs are selected and non-dimensionalized in a suitable manner, this yields a model form that is symmetric, Galilean invariant, rotationally invariant, reflectionally invariant, and unit invariant. We use this model form to train a simple and efficient neural network model using only one time step of filtered direct numerical simulation data from a forced homogeneous isotropic turbulence simulation. We demonstrate the accuracy of this model as well as the model's ability to generalize to previously unseen filter widths, Reynolds numbers, and flow physics using a priori and a posteriori tests.
△ Less
Submitted 9 February, 2022; v1 submitted 24 June, 2021;
originally announced June 2021.
-
Direct Numerical Simulation of a Turbulent Boundary Layer with Strong Pressure Gradients
Authors:
Riccardo Balin,
Kenneth E. Jansen
Abstract:
The turbulent boundary layer over a Gaussian shaped bump is computed by direct numerical simulation (DNS) of the incompressible Navier-Stokes equations. The two-dimensional bump causes a series of strong pressure gradients alternating in rapid succession. At the inflow, the momentum thickness Reynolds number is approximately 1,000 and the boundary layer thickness is 1/8 of the bump height. DNS res…
▽ More
The turbulent boundary layer over a Gaussian shaped bump is computed by direct numerical simulation (DNS) of the incompressible Navier-Stokes equations. The two-dimensional bump causes a series of strong pressure gradients alternating in rapid succession. At the inflow, the momentum thickness Reynolds number is approximately 1,000 and the boundary layer thickness is 1/8 of the bump height. DNS results show that the strong favorable pressure gradient (FPG) causes the boundary layer to enter a relaminarization process. The near-wall turbulence is significantly weakened and becomes intermittent, however relaminarization does not complete. The streamwise velocity profiles deviate above the standard logarithmic law and the Reynolds shear stress is reduced. The strong acceleration also suppresses the wall-shear normalized turbulent kinetic energy production rate. At the bump peak, where the FPG switches to an adverse gradient (APG), the near-wall turbulence is suddenly enhanced through a partial retransition process. This results in a new highly energized internal layer which is more resilient to the strong APG and only produces incipient flow separation on the downstream side. In the strong FPG and APG regions, the inner and outer layers become largely independent of each other. The near-wall region responds to the pressure gradients and determines the skin friction. The outer layer behaves similarly to a free-shear layer subject to pressure gradients and mean streamline curvature effects. Results from a RANS simulation of the bump are also discussed and clearly show the lack of predictive capacity of the near-wall pressure gradient effects on the mean flow.
△ Less
Submitted 16 October, 2020;
originally announced October 2020.
-
Direct Numerical Simulation of a Turbulent Boundary Layer on a Flat Plate Using Synthetic Turbulence Generation
Authors:
James R. Wright,
Riccardo Balin,
John W. Patterson,
John A. Evans,
Kenneth E. Jansen
Abstract:
The turbulent boundary layer over a flat plate is computed by direct numerical simulation (DNS) of the incompressible Navier-Stokes equations as a test bed for a synthetic turbulence generator (STG) inflow boundary condition. The inlet momentum thickness Reynolds number is approximately 1,000. The study provides validation of the ability of the STG to develop accurate turbulence in 5 to 7 boundary…
▽ More
The turbulent boundary layer over a flat plate is computed by direct numerical simulation (DNS) of the incompressible Navier-Stokes equations as a test bed for a synthetic turbulence generator (STG) inflow boundary condition. The inlet momentum thickness Reynolds number is approximately 1,000. The study provides validation of the ability of the STG to develop accurate turbulence in 5 to 7 boundary layer thicknesses downstream of the boundary condition. Also tested was the effect of changes in the stabilization scheme on the development of the boundary layer. Moreover, the grid resolution required for both the development region and the downstream flow is investigated when using a stabilized finite element method.
△ Less
Submitted 11 February, 2021; v1 submitted 8 October, 2020;
originally announced October 2020.
-
Interactive Geometry Modification of High Performance Finite Element Simulations
Authors:
Corey Wetterer-Nelson,
Kenneth E. Jansen,
John A. Evans
Abstract:
In the context of high performance finite element analysis, the cost of iteratively modifying a computational domain via re-meshing and restarting the analysis becomes time prohibitive as the size of simulations increases. In this paper, we demonstrate a new interactive simulation pipeline targeting high performance finite element simulations where the computational domain is modifiable in situ, t…
▽ More
In the context of high performance finite element analysis, the cost of iteratively modifying a computational domain via re-meshing and restarting the analysis becomes time prohibitive as the size of simulations increases. In this paper, we demonstrate a new interactive simulation pipeline targeting high performance finite element simulations where the computational domain is modifiable in situ, that is, while the simulation is ongoing. This pipeline is designed to be modular so that it may interface with any existing finite element simulation framework. A server-client architecture is employed to manage simulation mesh data existing on a high performance computing resource while user-prescribed freeform geometric modifications take place on a separate workstation. We employ existing in situ visualization techniques to rapidly inform the user of simulation progression, enabling computational steering. By expressing the simulation domain in a reduced fashion on the client application, this pipeline manages highly refined finite element simulation domains on the server while maintaining good performance on the client application.
△ Less
Submitted 19 May, 2021; v1 submitted 30 April, 2020;
originally announced May 2020.
-
S-Frame Discrepancy Correction Models for Data-Informed Reynolds Stress Closure
Authors:
Eric L. Peters,
Riccardo Balin,
Kenneth E. Jansen,
Alireza Doostan,
John A. Evans
Abstract:
Despite their well-known limitations, RANS models remain the most commonly employed tool for modeling turbulent flows in engineering practice. RANS models are predicated on the solution of the RANS equations, but these equations involve an unclosed term, the Reynolds stress tensor, which must be modeled. The Reynolds stress tensor is often modeled as an algebraic function of mean flow field variab…
▽ More
Despite their well-known limitations, RANS models remain the most commonly employed tool for modeling turbulent flows in engineering practice. RANS models are predicated on the solution of the RANS equations, but these equations involve an unclosed term, the Reynolds stress tensor, which must be modeled. The Reynolds stress tensor is often modeled as an algebraic function of mean flow field variables and turbulence variables. This introduces a discrepancy between the Reynolds stress tensor predicted by the model and the exact Reynolds stress tensor. This discrepancy can result in inaccurate mean flow field predictions. In this paper, we introduce a data-informed approach for arriving at Reynolds stress models with improved predictive performance. Our approach relies on learning the components of the Reynolds stress discrepancy tensor associated with a given Reynolds stress model in the mean strain-rate tensor eigenframe. These components are typically smooth and hence simple to learn using state-of-the-art machine learning strategies and regression techniques. Our approach automatically yields Reynolds stress models that are symmetric, and it yields Reynolds stress models that are both Galilean and frame invariant provided the inputs are themselves Galilean and frame invariant. To arrive at computable models of the discrepancy tensor, we employ feed-forward neural networks and an input space spanning the integrity basis of the mean strain-rate tensor, the mean rotation-rate tensor, the mean pressure gradient, and the turbulent kinetic energy gradient, and we introduce a framework for dimensional reduction of the input space to further reduce computational cost. Numerical results illustrate the effectiveness of the proposed approach for data-informed Reynolds stress closure for a suite of turbulent flow problems of increasing complexity.
△ Less
Submitted 19 April, 2020;
originally announced April 2020.
-
Boundary Layer Adaptivity For Incompressible Turbulent Flows
Authors:
Kedar C. Chitale,
Michel Rasquin,
Onkar Sahni,
Mark S. Shephard,
Kenneth E. Jansen
Abstract:
Boundary layers in turbulent flows require fine grid spacings near the walls which depend on the choice of turbulence model. To satisfy these requirements a semi-structured mesh is generally used in this area with orthogonal and layered elements. Adaptation of such a mesh needs to take into account the flow physics along with the standard error indicator approach. In this paper a novel methodology…
▽ More
Boundary layers in turbulent flows require fine grid spacings near the walls which depend on the choice of turbulence model. To satisfy these requirements a semi-structured mesh is generally used in this area with orthogonal and layered elements. Adaptation of such a mesh needs to take into account the flow physics along with the standard error indicator approach. In this paper a novel methodology which combines Hessian based error indicators with flow physics to drive mesh adaptation is illustrated. Particular focus is on the thickness adaptation of the layered mesh. The technique is applied to two turbulent incompressible flow cases and its effectiveness is studied.
△ Less
Submitted 3 May, 2014;
originally announced May 2014.
-
Finite Element Flow Simulations of the EUROLIFT DLR-F11 High Lift Configuration
Authors:
Kedar C. Chitale,
Michel Rasquin,
Jeff Martin,
Kenneth E. Jansen
Abstract:
This paper presents flow simulation results of the EUROLIFT DLR-F11 multi-element wing configuration, obtained with a highly scalable finite element solver, PHASTA. This work was accomplished as a part of the 2nd high lift prediction workshop. In-house meshes were constructed with increasing mesh density for analysis. A solution adaptive approach was used as an alternative and its effectiveness wa…
▽ More
This paper presents flow simulation results of the EUROLIFT DLR-F11 multi-element wing configuration, obtained with a highly scalable finite element solver, PHASTA. This work was accomplished as a part of the 2nd high lift prediction workshop. In-house meshes were constructed with increasing mesh density for analysis. A solution adaptive approach was used as an alternative and its effectiveness was studied by comparing its results with the ones obtained with other meshes. Comparisons between the numerical solution obtained with unsteady RANS turbulence model and available experimental results are provided for verification and discussion. Based on the observations, future direction for adaptive research and simulations with higher fidelity turbulence models is outlined.
△ Less
Submitted 26 February, 2014;
originally announced February 2014.
-
Anisotropic Boundary Layer Adaptivity of Multi-Element Wings
Authors:
Kedar C. Chitale,
Michel Rasquin,
Onkar Sahni,
Mark S. Shephard,
Kenneth E. Jansen
Abstract:
Multi-element wings are popular in the aerospace community due to their high lift performance. Turbulent flow simulations of these configurations require very fine mesh spacings especially near the walls, thereby making use of a boundary layer mesh necessary. However, it is difficult to accurately determine the required mesh resolution a priori to the simulations. In this paper we use an anisotrop…
▽ More
Multi-element wings are popular in the aerospace community due to their high lift performance. Turbulent flow simulations of these configurations require very fine mesh spacings especially near the walls, thereby making use of a boundary layer mesh necessary. However, it is difficult to accurately determine the required mesh resolution a priori to the simulations. In this paper we use an anisotropic adaptive meshing approach including adaptive control of elements in the boundary layers and study its effectiveness for two multi-element wing configurations. The results are compared with experimental data as well as nested refinements to show the efficiency of adaptivity driven by error indicators, where superior resolution in wakes and near the tip region through adaptivity are highlighted.
△ Less
Submitted 26 February, 2014;
originally announced February 2014.
-
Outflow boundary conditions for 3D simulations of non-periodic blood flow and pressure fields in deformable arteries
Authors:
Irene Vignon-Clementel,
C. A. Figueroa,
K. E. Jansen,
C. A. Taylor
Abstract:
The simulation of blood flow and pressure in arteries requires outflow boundary conditions that incorporate models of downstream domains. We previously described a coupled multidomain method to couple analytical models of the downstream domains with 3D numerical models of the upstream vasculature. This prior work either included pure resistance boundary conditions or impedance boundary conditions…
▽ More
The simulation of blood flow and pressure in arteries requires outflow boundary conditions that incorporate models of downstream domains. We previously described a coupled multidomain method to couple analytical models of the downstream domains with 3D numerical models of the upstream vasculature. This prior work either included pure resistance boundary conditions or impedance boundary conditions based on assumed periodicity of the solution. However, flow and pressure in arteries are not necessarily periodic in time due to heart rate variability, respiration, complex transitional flow or acute physiological changes. We present herein an approach for prescribing lumped parameter outflow boundary conditions that accommodate transient phenomena. We have applied this method to compute haemodynamic quantities in different physiologically relevant cardiovascular models, including patient-specific examples, to study non-periodic flow phenomena often observed in normal subjects and in patients with acquired or congenital cardiovascular disease. The relevance of using boundary conditions that accommodate transient phenomena compared with boundary conditions that assume periodicity of the solution is discussed.
△ Less
Submitted 3 December, 2010;
originally announced December 2010.