Showing 1–7 of 7 results for author: Echekki, T

Probabilistic transfer learning methodology to expedite high fidelity simulation of reactive flows

Authors: Bruno S. Soriano, Ki Sung Jung, Tarek Echekki, Jacqueline H. Chen, Mohammad Khalil

Abstract: Reduced order models based on the transport of a lower dimensional manifold representation of the thermochemical state, such as Principal Component (PC) transport and Machine Learning (ML) techniques, have been developed to reduce the computational cost associated with the Direct Numerical Simulations (DNS) of reactive flows. Both PC transport and ML normally require an abundance of data to exhibi… ▽ More Reduced order models based on the transport of a lower dimensional manifold representation of the thermochemical state, such as Principal Component (PC) transport and Machine Learning (ML) techniques, have been developed to reduce the computational cost associated with the Direct Numerical Simulations (DNS) of reactive flows. Both PC transport and ML normally require an abundance of data to exhibit sufficient predictive accuracy, which might not be available due to the prohibitive cost of DNS or experimental data acquisition. To alleviate such difficulties, similar data from an existing dataset or domain (source domain) can be used to train ML models, potentially resulting in adequate predictions in the domain of interest (target domain). This study presents a novel probabilistic transfer learning (TL) framework to enhance the trust in ML models in correctly predicting the thermochemical state in a lower dimensional manifold and a sparse data setting. The framework uses Bayesian neural networks, and autoencoders, to reduce the dimensionality of the state space and diffuse the knowledge from the source to the target domain. The new framework is applied to one-dimensional freely-propagating flame solutions under different data sparsity scenarios. The results reveal that there is an optimal amount of knowledge to be transferred, which depends on the amount of data available in the target domain and the similarity between the domains. TL can reduce the reconstruction error by one order of magnitude for cases with large sparsity. The new framework required 10 times less data for the target domain to reproduce the same error as in the abundant data scenario. Furthermore, comparisons with a state-of-the-art deterministic TL strategy show that the probabilistic method can require four times less data to achieve the same reconstruction error. △ Less

Submitted 17 May, 2024; originally announced May 2024.

Transfer learning for predicting source terms of principal component transport in chemically reactive flow

Authors: Ki Sung Jung, Tarek Echekki, Jacqueline H. Chen, Mohammad Khalil

Abstract: The objective of this study is to evaluate whether the number of requisite training samples can be reduced with the use of various transfer learning models for predicting, for example, the chemical source terms of the data-driven reduced-order model that represents the homogeneous ignition process of a hydrogen/air mixture. Principal component analysis is applied to reduce the dimensionality of th… ▽ More The objective of this study is to evaluate whether the number of requisite training samples can be reduced with the use of various transfer learning models for predicting, for example, the chemical source terms of the data-driven reduced-order model that represents the homogeneous ignition process of a hydrogen/air mixture. Principal component analysis is applied to reduce the dimensionality of the hydrogen/air mixture in composition space. Artificial neural networks (ANNs) are used to tabulate the reaction rates of principal components, and subsequently, a system of ordinary differential equations is solved. As the number of training samples decreases at the target task (i.e.,for T0 > 1000 K and various phi), the reduced-order model fails to predict the ignition evolution of a hydrogen/air mixture. Three transfer learning strategies are then applied to the training of the ANN model with a sparse dataset. The performance of the reduced-order model with a sparse dataset is found to be remarkably enhanced if the training of the ANN model is restricted by a regularization term that controls the degree of knowledge transfer from source to target tasks. To this end, a novel transfer learning method is introduced, parameter control via partial initialization and regularization (PaPIR), whereby the amount of knowledge transferred is systemically adjusted for the initialization and regularization of the ANN model in the target task. It is found that an additional performance gain can be achieved by changing the initialization scheme of the ANN model in the target task when the task similarity between source and target tasks is relatively low. △ Less

Submitted 1 December, 2023; originally announced December 2023.

Comments: 41 pages, 14 figures

A Framework for Combustion Chemistry Acceleration with DeepONets

Authors: Anuj Kumar, Tarek Echekki

Abstract: A combustion chemistry acceleration scheme is developed based on deep operator networks (DeepONets). The scheme is based on the identification of combustion reaction dynamics through a modified DeepOnet architecture such that the solutions of thermochemical scalars are projected to new solutions in small and flexible time increments. The approach is designed to efficiently implement chemistry acce… ▽ More A combustion chemistry acceleration scheme is developed based on deep operator networks (DeepONets). The scheme is based on the identification of combustion reaction dynamics through a modified DeepOnet architecture such that the solutions of thermochemical scalars are projected to new solutions in small and flexible time increments. The approach is designed to efficiently implement chemistry acceleration without the need for computationally expensive integration of stiff chemistry. An additional framework of latent-space dynamics identification with modified DeepOnet is also proposed which enhances the computational efficiency and widens the applicability of the proposed scheme. The scheme is demonstrated on simple chemical kinetics of hydrogen oxidation to more complex chemical kinetics of n-dodecane high- and low-temperature oxidations. The proposed framework accurately learns the chemical kinetics and efficiently reproduces species and temperature temporal profiles corresponding to each application. In addition, a very large speed-up with a great extrapolation capability is also observed with the proposed scheme. △ Less

Submitted 6 April, 2023; originally announced April 2023.

Comments: 10 pages, Conference paper (submitted to 13th National Meeting of the Combustion Institute, At College Station, Texas)

Generalized Joint Probability Density Function Formulation inTurbulent Combustion using DeepONet

Authors: Rishikesh Ranade, Kevin Gitushi, Tarek Echekki

Abstract: Joint probability density function (PDF)-based models in turbulent combustion provide direct closure for turbulence-chemistry interactions. The joint PDFs capture the turbulent flame dynamics at different spatial locations and hence it is crucial to represent them accurately. The jointPDFs are parameterized on the unconditional means of thermo-chemical state variables, which can be high dimensiona… ▽ More Joint probability density function (PDF)-based models in turbulent combustion provide direct closure for turbulence-chemistry interactions. The joint PDFs capture the turbulent flame dynamics at different spatial locations and hence it is crucial to represent them accurately. The jointPDFs are parameterized on the unconditional means of thermo-chemical state variables, which can be high dimensional. Thus, accurate construction of joint PDFs at various spatial locations may require an exorbitant amount of data. In a previous work, we introduced a framework that alleviated data requirements by constructing joint PDFs in a lower dimensional space using principal component analysis (PCA) in conjunction with Kernel Density Estimation (KDE). However, constructing the principal component (PC) joint PDFs is still computationally expensive as they are required to be calculated at each spatial location in the turbulent flame. In this work, we propose the concept of a generalized joint PDF model using the Deep Operator Network (DeepONet). The DeepONet is a machine learning model that is parameterized on the unconditional means of PCs at a given spatial location and discrete PC coordinates and predicts the joint probability density value for the corresponding PC coordinate. We demonstrate the accuracy and generalizability of the DeepONet on the Sandia flames, D, E and F. The DeepONet is trained based on the PC joint PDFs observed inflame E and yields excellent predictions of joint PDFs shapes at different spatial locations of flamesD and F, which are not seen during training △ Less

Submitted 5 April, 2021; originally announced April 2021.

An Efficient Machine-Learning Approach for PDF Tabulation in Turbulent Combustion Closure

Authors: Rishikesh Ranade, Genong Li, Shao** Li, Tarek Echekki

Abstract: Probability density function (PDF) based turbulent combustion modelling is limited by the need to store multi-dimensional PDF tables that can take up large amounts of memory. A significant saving in storage can be achieved by using various machine-learning techniques that represent the thermo-chemical quantities of a PDF table using mathematical functions. These functions can be computationally mo… ▽ More Probability density function (PDF) based turbulent combustion modelling is limited by the need to store multi-dimensional PDF tables that can take up large amounts of memory. A significant saving in storage can be achieved by using various machine-learning techniques that represent the thermo-chemical quantities of a PDF table using mathematical functions. These functions can be computationally more expensive than the existing interpolation methods used for thermo-chemical quantities. More importantly, the training time can amount to a considerable portion of the simulation time. In this work, we address these issues by introducing an adaptive training algorithm that relies on multi-layer perception (MLP) neural networks for regression and self-organizing maps (SOMs) for clustering data to tabulate using different networks. The algorithm is designed to address both the multi-dimensionality of the PDF table as well as the computational efficiency of the proposed algorithm. SOM clustering divides the PDF table into several parts based on similarities in data. Each cluster of data is trained using an MLP algorithm on simple network architectures to generate local functions for thermo-chemical quantities. The algorithm is validated for the so-called DLR-A turbulent jet diffusion flame using both RANS and LES simulations and the results of the PDF tabulation are compared to the standard linear interpolation method. The comparison yields a very good agreement between the two tabulation techniques and establishes the MLP-SOM approach as a viable method for PDF tabulation. △ Less

Submitted 17 May, 2020; originally announced May 2020.

Journal ref: Combustion Science and Technology, 1-20 (2019)

A Framework for Data-Based Turbulent Combustion Closure: A Posteriori Validation

Authors: Rishikesh Ranade, Tarek Echekki

Abstract: In this work, we demonstrate a framework for develo** closure models in turbulent combustion using experimental multi-scalar measurements. The framework is based on the construction of conditional means and joint scalar PDFs from experimental data based on the parameterization of composition space using principal component analysis (PCA). The resulting principal components (PCs) act as both cond… ▽ More In this work, we demonstrate a framework for develo** closure models in turbulent combustion using experimental multi-scalar measurements. The framework is based on the construction of conditional means and joint scalar PDFs from experimental data based on the parameterization of composition space using principal component analysis (PCA). The resulting principal components (PCs) act as both conditioning variables and transport variables. Their chemical source terms are constructed starting from instantaneous temperature and species measurements using a variant of the pairwise mixing stirred reactor (PMSR) approach. A multi-dimensional kernel density estimation (KDE) approach is used to construct the joint PDFs in PC space. Convolutions of these joint PDFs with conditional means are used to determine the unconditional means for the closure terms: the mean PCs chemical source terms and the density. These means are parameterized in terms of the mean PCs using artificial neural networks (ANN). The framework is demonstrated a posteriori using the data from the Sandia piloted turbulent jet flames D, E and F by performing RANS calculations. The radial profiles of mean and RMS of temperature and measured species mass fractions agree well with the experimental means for these flames. △ Less

Submitted 8 September, 2019; originally announced September 2019.

A Framework for Data-Based Turbulent Combustion Closure: A Priori Validation

Authors: Rishikesh Ranade, Tarek Echekki

Abstract: Experimental multi-scalar measurements in laboratory flames have provided important databases for the validation of turbulent combustion closure models. In this work, we present a framework for data-based closure in turbulent combustion and establish an a priori validation of this framework. The approach is based on the construction of joint probability density functions (PDFs) and conditional sta… ▽ More Experimental multi-scalar measurements in laboratory flames have provided important databases for the validation of turbulent combustion closure models. In this work, we present a framework for data-based closure in turbulent combustion and establish an a priori validation of this framework. The approach is based on the construction of joint probability density functions (PDFs) and conditional statistics using experimental data based on the parameterization of the composition space using principal component analysis (PCA). The PCA on the data identifies key parameters, principal components (PCs), on which joint scalar PDFs and conditional scalar means can be constructed. To enable a generic implementation for the construction of joint scalar PDFs, we use the multi-dimensional kernel density estimation (KDE) approach. An a priori validation of the PCA-KDE approach is carried out using the Sandia piloted jet turbulent flames D, E and F. The analysis of the results suggests that a few PCs are adequate to reproduce the statistics, resulting in a low-dimensional representation of the joint scalars PDFs and the scalars' conditional means. A reconstruction of the scalars' means and RMS statistics are in agreement with the corresponding statistics extracted directly from the experimental data. We also propose one strategy to recover missing species and construct conditional means for the reaction rates based on a variation of the pairwise-mixing stirred reactor (PMSR) model. The model is demonstrated using numerical simulations based on the one-dimensional turbulence (ODT) model for the same flames. △ Less

Submitted 20 May, 2019; originally announced May 2019.