Showing 1–37 of 37 results for author: Pawar, S

Comparison of Two-Moment and Three-Moment Bulk Microphysics Schemes in Thunderstorm Simulations over Indian Subcontinent

Authors: Chandrima Mallick, Ushnanshu Dutta, Moumita Bhowmik, Greeshma M. Mohan, Anupam Hazra, S. D. Pawar, Jen-** Chen

Abstract: We have performed three-dimensional thunderstorm real simulations using the two-moment and three-moment bulk microphysics schemes in the Weather Research and Forecasting (WRF) model. We have analyzed three cases to understand the potential differences between the double-moment (Morrison-2M) and National Taiwan University triple-moment (NTU-3M) microphysics parameterizations in capturing the charac… ▽ More We have performed three-dimensional thunderstorm real simulations using the two-moment and three-moment bulk microphysics schemes in the Weather Research and Forecasting (WRF) model. We have analyzed three cases to understand the potential differences between the double-moment (Morrison-2M) and National Taiwan University triple-moment (NTU-3M) microphysics parameterizations in capturing the characteristics of lightning events over the Indian subcontinent. Despite general resemblances in these schemes, the simulations reveal distinct differences in storm structure, cloud hydrometeors formation, and precipitation. The lightning flash counts from the in situ lightning detection network (LDN) are also used to compare the simulation of storms. The Lightning Potential Index (LPI) is computed for Morrison-2M and NTU-3M microphysics schemes and compared it with the Lightning Detection Network (LDN) observation. In most cases, the Morrison-2M shows more LPI than the NTU-3M scheme. Both the schemes also differ in simulating rainfall and other thermodynamical, dynamical, and microphysical parameters in the model. Here, we have attempted to identify the basic differences between these two schemes, which may be responsible for the discrepancies in the simulations. In particular, the Morrison-2M produced much higher surface precipitation rates. The effects on the size distributions cloud hydrometeors between two microphysical schemes are important to simulate the biases in the precipitation and lightning flash counts. The inclusions of ice crystal shapes are responsible for many of the key differences between the two microphysics simulations. Different approaches in treating cloud ice, snow, and graupel may have an impact on the simulation of lightning and precipitation. Results show that the simulation of lightning events is sensitive to microphysical parameterization schemes in NWP models. △ Less

Submitted 19 April, 2024; originally announced April 2024.

Dynamics of Minimal Networks of Limit Cycle Oscillators

Authors: Andrea Elizabeth Biju, Sneha Srikanth, Krishna Manoj, Samadhan A. Pawar, R. I. Sujith

Abstract: The framework of mutually coupled oscillators on a network has served as a convenient tool for investigating the impact of various parameters on the dynamics of real-world systems. Compared to large networks of oscillators, minimal networks are more susceptible to changes in coupling parameters, the number of oscillators, and network topologies. In this study, we systematically explore the influen… ▽ More The framework of mutually coupled oscillators on a network has served as a convenient tool for investigating the impact of various parameters on the dynamics of real-world systems. Compared to large networks of oscillators, minimal networks are more susceptible to changes in coupling parameters, the number of oscillators, and network topologies. In this study, we systematically explore the influence of these parameters on the dynamics of a minimal network comprising Stuart-Landau oscillators coupled with a distance-dependent time delay. We examine three network topologies: ring, chain, and star. Specifically, for ring networks, we study the effects of increasing nonlocality from local to global coupling on the overall dynamics of the system. Our findings reveal the existence of various synchronized states, including splay and cluster states, a partially synchronized state such as chimeric quasiperiodicity, and an oscillation quenching state such as amplitude death in these networks. Moreover, through an analysis of long-lived transients, we discover novel amplitude-modulated states within ring networks. Interestingly, we observe that increasing nonlocality diminishes the influence of the number of oscillators on the overall behavior in these networks. Furthermore, we note that chain networks, unlike ring networks, do not exhibit perfect synchrony among the coupled oscillators. In contrast, star networks demonstrate greater stability and are unaffected by the number of oscillators within the network. The insights from this study deepen our understanding of the dynamics of minimal networks and have implications for various fields, ranging from biology to engineering. △ Less

Submitted 29 July, 2023; originally announced July 2023.

Comments: 14 pages, 11 figures

Spatiotemporal Patterns Corresponding to Phase Synchronization and Generalized Synchronization States of Thermoacoustic Instability

Authors: Samadhan A. Pawar, P. R. Midhun, K. V. Reeja, Abin Krishnan, Krishna Manoj, R. I. Sujith

Abstract: Thermoacoustic instability in turbulent combustion systems emerges from the complex interplay among the flame, flow, and acoustic subsystems. While the onset of thermoacoustic instability exhibits global order in system dynamics, the characteristics of local interactions between subsystems responsible for this order are not well understood. In this study, we utilize the framework of synchronizatio… ▽ More Thermoacoustic instability in turbulent combustion systems emerges from the complex interplay among the flame, flow, and acoustic subsystems. While the onset of thermoacoustic instability exhibits global order in system dynamics, the characteristics of local interactions between subsystems responsible for this order are not well understood. In this study, we utilize the framework of synchronization to elucidate the spatiotemporal interactions among heat release rate fluctuations in the flame, velocity fluctuations in the flow, and acoustic pressure fluctuations in a turbulent combustor. We examine two forms of thermoacoustic instability, characterized by phase synchronization and generalized synchronization of the acoustic pressure and global heat release rate oscillations. Despite the presence of global synchrony, we uncover a coexistence of frequency synchrony and desynchrony in the local interaction of these oscillations within the reaction field. In regions of frequency-locked oscillations, various phase-locking patterns occur, including phase synchrony and partial phase synchrony. We discover that the local development of small pockets of phase synchrony and strong amplitude correlation between these oscillations is sufficient to trigger global phase synchronization in the system. Furthermore, as the global dynamics approach generalized synchronization, these local regions of synchrony expand throughout the reaction field. Additionally, through coupled analysis of acoustic pressure and local flow velocity fluctuations, we infer that the spatial region of flow-acoustic synchrony plays a significant role in governing thermoacoustic instabilities. Our findings imply that, in turbulent combustors, an intrinsic local balance between order, partial order, and disorder within the coupled subsystems sustains the global order during thermoacoustic instability. △ Less

Submitted 29 July, 2023; originally announced July 2023.

Comments: 35 pages, 12 figures

FlashBench: A lightning nowcasting framework based on the hybrid deep learning and physics-based dynamical models

Authors: Manmeet Singh, Vaisakh S. B., Dipjyoti Mudiar, Deewakar Chakraborty, V. Gopalakrishnan, Bhupendra Bahadur Singh, Shikha Singh, Rakesh Ghosh, Rajib Chattopadhyay, Bipin Kumar, S. D. Pawar, S. A. Rao

Abstract: Lightning strikes are a well-known danger, and are a leading cause of accidental fatality worldwide. Unfortunately, lightning hazards seldom make headlines in international media coverage because of their infrequency and the low number of casualties each incidence. According to readings from the TRMM LIS lightning sensor, thunderstorms are more common in the tropics while being extremely rare in t… ▽ More Lightning strikes are a well-known danger, and are a leading cause of accidental fatality worldwide. Unfortunately, lightning hazards seldom make headlines in international media coverage because of their infrequency and the low number of casualties each incidence. According to readings from the TRMM LIS lightning sensor, thunderstorms are more common in the tropics while being extremely rare in the polar regions. To improve the precision of lightning forecasts, we develop a technique similar to LightNet's, with one key modification. We didn't just base our model off the results of preliminary numerical simulations; we also factored in the observed fields' time-dependent development. The effectiveness of the lightning forecast rose dramatically once this adjustment was made. The model was tested in a case study during a thunderstorm. Using lightning parameterization in the WRF model simulation, we compared the simulated fields. As the first of its type, this research has the potential to set the bar for how regional lightning predictions are conducted in the future because of its data-driven approach. In addition, we have built a cloud-based lightning forecast system based on Google Earth Engine. With this setup, lightning forecasts over West India may be made in real time, giving critically important information for the area. △ Less

Submitted 17 May, 2023; originally announced May 2023.

Numerical assessments of a nonintrusive surrogate model based on recurrent neural networks and proper orthogonal decomposition: Rayleigh Benard convection

Authors: Saeed Akbari, Suraj Pawar, Omer San

Abstract: Recent developments in diagnostic and computing technologies offer to leverage numerous forms of nonintrusive modeling approaches from data where machine learning can be used to build computationally cheap and accurate surrogate models. To this end, we present a nonlinear proper orthogonal decomposition (POD) framework, denoted as NLPOD, to forge a nonintrusive reduced-order model for the Boussine… ▽ More Recent developments in diagnostic and computing technologies offer to leverage numerous forms of nonintrusive modeling approaches from data where machine learning can be used to build computationally cheap and accurate surrogate models. To this end, we present a nonlinear proper orthogonal decomposition (POD) framework, denoted as NLPOD, to forge a nonintrusive reduced-order model for the Boussinesq equations. In our NLPOD approach, we first employ the POD procedure to obtain a set of global modes to build a linear-fit latent space and utilize an autoencoder network to compress the projection of this latent space through a nonlinear unsupervised map** of POD coefficients. Then, long short-term memory (LSTM) neural network architecture is utilized to discover temporal patterns in this low-rank manifold. While performing a detailed sensitivity analysis for hyperparameters of the LSTM model, the trade-off between accuracy and efficiency is systematically analyzed for solving a canonical Rayleigh-Benard convection system. △ Less

Submitted 10 December, 2022; originally announced December 2022.

Prospects of federated machine learning in fluid dynamics

Authors: Omer San, Suraj Pawar, Adil Rasheed

Abstract: Physics-based models have been mainstream in fluid dynamics for develo** predictive models. In recent years, machine learning has offered a renaissance to the fluid community due to the rapid developments in data science, processing units, neural network based technologies, and sensor adaptations. So far in many applications in fluid dynamics, machine learning approaches have been mostly focused… ▽ More Physics-based models have been mainstream in fluid dynamics for develo** predictive models. In recent years, machine learning has offered a renaissance to the fluid community due to the rapid developments in data science, processing units, neural network based technologies, and sensor adaptations. So far in many applications in fluid dynamics, machine learning approaches have been mostly focused on a standard process that requires centralizing the training data on a designated machine or in a data center. In this letter, we present a federated machine learning approach that enables localized clients to collaboratively learn an aggregated and shared predictive model while kee** all the training data on each edge device. We demonstrate the feasibility and prospects of such decentralized learning approach with an effort to forge a deep learning surrogate model for reconstructing spatiotemporal fields. Our results indicate that federated machine learning might be a viable tool for designing highly accurate predictive decentralized digital twins relevant to fluid dynamics. △ Less

Submitted 15 August, 2022; originally announced August 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2207.12245

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Authors: Omer San, Suraj Pawar, Adil Rasheed

Abstract: A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many tran… ▽ More A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL (MMRL) to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Decentralized digital twins of complex dynamical systems

Authors: Omer San, Suraj Pawar, Adil Rasheed

Abstract: In this paper, we introduce a decentralized digital twin (DDT) framework for dynamical systems and discuss the prospects of the DDT modeling paradigm in computational science and engineering applications. The DDT approach is built on a federated learning concept, a branch of machine learning that encourages knowledge sharing without sharing the actual data. This approach enables clients to collabo… ▽ More In this paper, we introduce a decentralized digital twin (DDT) framework for dynamical systems and discuss the prospects of the DDT modeling paradigm in computational science and engineering applications. The DDT approach is built on a federated learning concept, a branch of machine learning that encourages knowledge sharing without sharing the actual data. This approach enables clients to collaboratively learn an aggregated model while kee** all the training data on each client. We demonstrate the feasibility of the DDT framework with various dynamical systems, which are often considered prototypes for modeling complex transport phenomena in spatiotemporally extended systems. Our results indicate that federated machine learning might be a key enabler for designing highly accurate decentralized digital twins in complex nonlinear spatiotemporal systems. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Equation-free surrogate modeling of geophysical flows at the intersection of machine learning and data assimilation

Authors: Suraj Pawar, Omer San

Abstract: There is a growing interest in develo** data-driven reduced-order models for atmospheric and oceanic flows that are trained on data obtained either from high-resolution simulations or satellite observations. The data-driven models are non-intrusive in nature and offer significant computational savings compared to large-scale numerical models. These low-dimensional models can be utilized to reduc… ▽ More There is a growing interest in develo** data-driven reduced-order models for atmospheric and oceanic flows that are trained on data obtained either from high-resolution simulations or satellite observations. The data-driven models are non-intrusive in nature and offer significant computational savings compared to large-scale numerical models. These low-dimensional models can be utilized to reduce the computational burden of generating forecasts and estimating model uncertainty without losing the key information needed for data assimilation to produce accurate state estimates. This paper aims at exploring an equation-free surrogate modeling approach at the intersection of machine learning and data assimilation in Earth system modeling. With this objective, we introduce an end-to-end non-intrusive reduced-order modeling (NIROM) framework equipped with contributions in modal decomposition, time series prediction, optimal sensor placement, and sequential data assimilation. Specifically, we use proper orthogonal decomposition (POD) to identify the dominant structures of the flow, and a long short-term memory network to model the dynamics of the POD modes. The NIROM is integrated within the deterministic ensemble Kalman filter (DEnKF) to incorporate sparse and noisy observations at optimal sensor locations obtained through QR pivoting. The feasibility and the benefit of the proposed framework are demonstrated for the NOAA Optimum Interpolation Sea Surface Temperature (SST) V2 dataset. Our results indicate that the NIROM is stable for long-term forecasting and can model dynamics of SST with a reasonable level of accuracy. Furthermore, the prediction accuracy of the NIROM gets improved by one order of magnitude by the DEnKF algorithm. This work provides a way forward toward transitioning these methods to fuse information from Earth system models and observations to achieve accurate forecasts. △ Less

Submitted 26 May, 2022; originally announced May 2022.

Multi-fidelity reinforcement learning framework for shape optimization

Authors: Sahil Bhola, Suraj Pawar, Prasanna Balaprakash, Romit Maulik

Abstract: Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases where classical optimization or control methods are limited. One key limitation of conventional DRL methods is their episode-hungry nature which proves to be a… ▽ More Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases where classical optimization or control methods are limited. One key limitation of conventional DRL methods is their episode-hungry nature which proves to be a bottleneck for tasks which involve costly evaluations of a numerical forward model. In this article, we address this limitation of DRL by introducing a controlled transfer learning framework that leverages a multi-fidelity simulation setting. Our strategy is deployed for an airfoil shape optimization problem at high Reynolds numbers, where our framework can learn an optimal policy for generating efficient airfoil shapes by gathering knowledge from multi-fidelity environments and reduces computational costs by over 30\%. Furthermore, our formulation promotes policy exploration and generalization to new environments, thereby preventing over-fitting to data from solely one fidelity. Our results demonstrate this framework's applicability to other scientific DRL scenarios where multi-fidelity environments can be used for policy learning. △ Less

Submitted 22 February, 2022; originally announced February 2022.

Frame invariant neural network closures for Kraichnan turbulence

Authors: Suraj Pawar, Omer San, Adil Rasheed, Prakash Vedula

Abstract: Numerical simulations of geophysical and atmospheric flows have to rely on parameterizations of subgrid scale processes due to their limited spatial resolution. Despite substantial progress in develo** parameterization (or closure) models for subgrid scale (SGS) processes using physical insights and mathematical approximations, they remain imperfect and can lead to inaccurate predictions. In rec… ▽ More Numerical simulations of geophysical and atmospheric flows have to rely on parameterizations of subgrid scale processes due to their limited spatial resolution. Despite substantial progress in develo** parameterization (or closure) models for subgrid scale (SGS) processes using physical insights and mathematical approximations, they remain imperfect and can lead to inaccurate predictions. In recent years, machine learning has been successful in extracting complex patterns from high-resolution spatio-temporal data, leading to improved parameterization models, and ultimately better coarse grid prediction. However, the inability to satisfy known physics and poor generalization hinders the application of these models for real-world problems. In this work, we propose a frame invariant closure approach to improve the accuracy and generalizability of deep learning-based subgrid scale closure models by embedding physical symmetries directly into the structure of the neural network. Specifically, we utilized specialized layers within the convolutional neural network in such a way that desired constraints are theoretically guaranteed without the need for any regularization terms. We demonstrate our framework for a two-dimensional decaying turbulence test case mostly characterized by the forward enstrophy cascade. We show that our frame invariant SGS model (i) accurately predicts the subgrid scale source term, (ii) respects the physical symmetries such as translation, Galilean, and rotation invariance, and (iii) is numerically stable when implemented in coarse-grid simulation with generalization to different initial conditions and Reynolds number. This work builds a bridge between extensive physics-based theories and data-driven modeling paradigms, and thus represents a promising step towards the development of physically consistent data-driven turbulence closure models. △ Less

Submitted 9 January, 2022; originally announced January 2022.

Hyperparameter Search using Genetic Algorithm for Surrogate Modeling of Geophysical Flows

Authors: Suraj Pawar, Omer San, Gary G. Yen

Abstract: The computational models for geophysical flows are computationally very expensive to employ in multi-query tasks such as data assimilation, uncertainty quantification, and hence surrogate models sought to alleviate the computational burden associated with these full order models. Researchers have started applying machine learning algorithms, particularly neural networks, to build data-driven surro… ▽ More The computational models for geophysical flows are computationally very expensive to employ in multi-query tasks such as data assimilation, uncertainty quantification, and hence surrogate models sought to alleviate the computational burden associated with these full order models. Researchers have started applying machine learning algorithms, particularly neural networks, to build data-driven surrogate models for geophysical flows. The performance of the neural network highly relies upon its architecture design and selection of other hyperparameters. These neural networks are usually manually designed through trial and error to maximize their performance. This often requires domain knowledge of the neural network as well as the problems of interest. This limitation can be addressed by using an evolutionary algorithm to automatically design architecture and select optimal hyperparameters of the neural network. In this paper, we apply the genetic algorithm to effectively design the long short-term memory (LSTM) neural network to build the non-intrusive reduced order model of the sea-surface temperature field. △ Less

Submitted 7 January, 2022; originally announced January 2022.

Mitigation of limit cycle oscillations in a turbulent thermoacoustic system via delayed acoustic self-feedback

Authors: Ankit Sahay, Abhishek Kushwaha, Samadhan A. Pawar, Midhun P. R., Jayesh M. Dhadphale, R. I. Sujith

Abstract: We report the occurrence of amplitude death (AD) of limit cycle oscillations in a bluff body stabilized turbulent combustor through delayed acoustic self-feedback. Such feedback control is achieved by coupling the acoustic field of the combustor to itself through a single coupling tube attached near the anti-node position of the acoustic standing wave. We observe that the amplitude and dominant fr… ▽ More We report the occurrence of amplitude death (AD) of limit cycle oscillations in a bluff body stabilized turbulent combustor through delayed acoustic self-feedback. Such feedback control is achieved by coupling the acoustic field of the combustor to itself through a single coupling tube attached near the anti-node position of the acoustic standing wave. We observe that the amplitude and dominant frequency of the limit cycle oscillations gradually decrease as the length of the coupling tube is increased. Complete suppression (AD) of these oscillations is observed when the length of the coupling tube is nearly 3/8 times the wavelength of the fundamental acoustic mode of the combustor. Meanwhile, as we approach this state of amplitude death, the dynamical behavior of acoustic pressure changes from the state of limit cycle oscillations to low-amplitude chaotic oscillations via intermittency. We also study the change in the nature of the coupling between the unsteady flame dynamics and the acoustic field as the length of the coupling tube is increased. We find that the temporal synchrony between these oscillations changes from the state of synchronized periodicity to desynchronized aperiodicity through intermittent synchronization. Furthermore, we reveal that the application of delayed acoustic self-feedback with optimum feedback parameters completely disrupts the positive feedback loop between hydrodynamic, acoustic, and heat release rate fluctuations present in the combustor during thermoacoustic instability, thus mitigating instability. We anticipate this method to be a viable and cost-effective option to mitigate thermoacoustic oscillations in turbulent combustion systems used in practical propulsion and power systems. △ Less

Submitted 11 April, 2023; v1 submitted 7 January, 2022; originally announced January 2022.

Comments: 11 pages, 8 figures

Journal ref: Chaos 33(4), 2023, 043118

Self-coupling: An Effective Method to Mitigate Thermoacoustic Instability

Authors: Sneha Srikanth, Ankit Sahay, Samadhan A. Pawar, Krishna Manoj, R. I. Sujith

Abstract: The presence of undesirable large-amplitude self-sustained oscillations in combustors resulting from thermoacoustic instability can lead to performance loss and structural damage to components of gas turbine and rocket engines. Traditional feedback controls to mitigate thermoacoustic instability possess electromechanical components, which are expensive to maintain regularly and unreliable in the h… ▽ More The presence of undesirable large-amplitude self-sustained oscillations in combustors resulting from thermoacoustic instability can lead to performance loss and structural damage to components of gas turbine and rocket engines. Traditional feedback controls to mitigate thermoacoustic instability possess electromechanical components, which are expensive to maintain regularly and unreliable in the harsh environments of combustors. In this study, we demonstrate the quenching of thermoacoustic instability through self-coupling -- a method wherein a hollow tube is used to provide acoustic self-feedback to a thermoacoustic system. Through experiments and modeling, we identify the optimal coupling conditions for attaining amplitude death, i.e., complete suppression of thermoacoustic instabilities, in a horizontal Rijke tube. We examine the effect of both system and coupling parameters on the occurrence of amplitude death. We thereby show that the parametric regions of amplitude death occur when the coupling tube length is close to an odd multiple of the length of the Rijke tube. The optimal location of the coupling tube for achieving amplitude death is near the anti-node of the acoustic standing wave in the Rijke tube. Furthermore, we find that self-coupling mitigates thermoacoustic instability in a Rijke tube more effectively than mutual coupling of two identical Rijke tubes. Thus, we believe that self-coupling can prove to be a simple, cost-effective solution for mitigating thermoacoustic instability in gas turbine combustors. △ Less

Submitted 18 January, 2022; v1 submitted 28 December, 2021; originally announced December 2021.

Comments: 12 pages, 8 figures

Journal ref: Nonlinear Dyn 110, 2022

Thermodynamic constraints on the assembly and diversity of microbial ecosystems are different near to and far from equilibrium

Authors: Jacob Cook, Samraat Pawar, Robert G. Endres

Abstract: Non-equilibrium thermodynamics has long been an area of substantial interest to ecologists because most fundamental biological processes, such as protein synthesis and respiration, are inherently energy-consuming. Microbial communities are a natural system to decipher this mechanistic basis because their interactions in the form of substrate consumption, metabolite production, and cross-feeding ca… ▽ More Non-equilibrium thermodynamics has long been an area of substantial interest to ecologists because most fundamental biological processes, such as protein synthesis and respiration, are inherently energy-consuming. Microbial communities are a natural system to decipher this mechanistic basis because their interactions in the form of substrate consumption, metabolite production, and cross-feeding can be described explicitly in thermodynamic terms. Previous work has considered how thermodynamic constraints impact competition between pairs of species, but restrained from analysing how this manifests in complex dynamical systems. To address this gap, we develop a thermodynamic microbial community model with fully reversible reaction kinetics, which allows direct consideration of free-energy dissipation. This also allows species to interact via products rather than just substrates, increasing the dynamical complexity, and allowing a more nuanced classification of interaction types to emerge. Using this model, we find that community diversity increases with substrate lability, because greater free-energy availability allows for faster generation of niches. Thus, more niches are generated in the time frame of community establishment, leading to higher final species diversity. We also find that allowing species to make use of near-to-equilibrium reactions increases diversity in a low free-energy regime. In such a regime, two new thermodynamic interaction types that we identify here reach comparable strengths to the conventional (competition and facilitation) types, emphasising the key role that thermodynamics plays in community dynamics. Our results suggest that accounting for realistic thermodynamic constraints is vital for understanding the dynamics of real-world microbial communities. △ Less

Submitted 16 November, 2021; originally announced November 2021.

Comments: 23 pages, 5 figures

Multi-fidelity information fusion with concatenated neural networks

Authors: Suraj Pawar, Omer San, Prakash Vedula, Adil Rasheed, Trond Kvamsdal

Abstract: Recently, computational modeling has shifted towards the use of deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by lowering the computational burden, training deep learning models needs a huge amount of data. This big data is not always available for scientific problems and l… ▽ More Recently, computational modeling has shifted towards the use of deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by lowering the computational burden, training deep learning models needs a huge amount of data. This big data is not always available for scientific problems and leads to poorly generalizable data-driven models. This gap can be furnished by leveraging information from physics-based models. Exploiting prior knowledge about the problem at hand, this study puts forth a concatenated neural network approach to build more tailored, effective, and efficient machine learning models. For our analysis, without losing its generalizability and modularity, we focus on the development of predictive models for laminar and turbulent boundary layer flows. In particular, we combine the self-similarity solution and power-law velocity profile (low-fidelity models) with the noisy data obtained either from experiments or computational fluid dynamics simulations (high-fidelity models) through a concatenated neural network. We illustrate how the knowledge from these simplified models results in reducing uncertainties associated with deep learning models. The proposed framework produces physically consistent models that attempt to achieve better generalization than data-driven models obtained purely based on data. While we demonstrate our framework for a problem relevant to fluid mechanics, its workflow and principles can be adopted for many scientific problems where empirical models are prevalent. In line with grand demands in novel physics-guided machine learning principles, this work builds a bridge between extensive physics-based theories and data-driven modeling paradigms and paves the way for using hybrid modeling approaches for next-generation digital twin technologies. △ Less

Submitted 8 October, 2021; originally announced October 2021.

Coupled interaction between acoustics and unsteady flame dynamics during the transition to thermoacoustic instability in a multi-element rocket combustor

Authors: Praveen Kasthuri, Samadhan A. Pawar, Rohan Gejji, William Anderson, R. I. Sujith

Abstract: Rocket engine combustors are prone to transverse instabilities that are characterized by large amplitude high frequency oscillations in the acoustic pressure and the heat release rate. We study the coupled interaction between the acoustic pressure and the CH* intensity oscillations in a 2D multi-element self-excited model rocket combustor during the transition from a stable state to thermoacoustic… ▽ More Rocket engine combustors are prone to transverse instabilities that are characterized by large amplitude high frequency oscillations in the acoustic pressure and the heat release rate. We study the coupled interaction between the acoustic pressure and the CH* intensity oscillations in a 2D multi-element self-excited model rocket combustor during the transition from a stable state to thermoacoustic instability through intermittency. We show the emergence of synchronization between these oscillations from desynchronization through intermittent phase synchronization during the onset of thermoacoustic instability. We find substantial evidence that the intensities of the jet flames close to the end wall is higher than that observed near the center of the combustor as a result of its strong coupling to the local acoustic field. Using concepts from recurrence theory, we distinguish the type of synchronization between the acoustic pressure and the CH* intensity oscillations at the end wall and the center of the combustor during thermoacoustic instability. Analyzing the local CH* intensity oscillations, we observe that the longitudinally propagating jet flames experience substantial transverse displacement with flame merging effects during thermoacoustic instability. Furthermore, we differentiate the interaction of the jet flames with the shock wave during intermittency and thermoacoustic instability at both the end wall and the center of the combustor. We also discerned the change from stochastic to deterministic nature in the local CH* intensity oscillations during the transition to thermoacoustic instability. Our results demonstrate that only the first few transverse modes contribute to the generation of acoustic power from the reacting flow, in spite of the pressure oscillations featuring several harmonics. △ Less

Submitted 7 October, 2021; originally announced October 2021.

On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues

Authors: Shady E. Ahmed, Suraj Pawar, Omer San, Adil Rasheed, Traian Iliescu, Bernd R. Noack

Abstract: For over a century, reduced order models (ROMs) have been a fundamental discipline of theoretical fluid mechanics. Early examples include Galerkin models inspired by the Orr-Sommerfeld stability equation and numerous vortex models, of which the von Kármán vortex street is one of the most prominent. Subsequent ROMs typically relied on first principles, like mathematical Galerkin models, weakly nonl… ▽ More For over a century, reduced order models (ROMs) have been a fundamental discipline of theoretical fluid mechanics. Early examples include Galerkin models inspired by the Orr-Sommerfeld stability equation and numerous vortex models, of which the von Kármán vortex street is one of the most prominent. Subsequent ROMs typically relied on first principles, like mathematical Galerkin models, weakly nonlinear stability theory, and two- and three-dimensional vortex models. Aubry et al. [N. Aubry, P. Holmes, J. Lumley, and E. Stone, Journal of Fluid Mechanics, 192, 115-173 (1988)] pioneered data-driven proper orthogonal decomposition (POD) modeling. In early POD modeling, available data was used to build an optimal basis, which was then utilized in a classical Galerkin procedure to construct the ROM. But data has made a profound impact on ROMs beyond the Galerkin expansion. In this paper, we take a modest step and illustrate the impact of data-driven modeling on one significant ROM area. Specifically, we focus on ROM closures, which are correction terms that are added to classical ROMs in order to model the effect of the discarded ROM modes in under-resolved simulations. Through simple examples, we illustrate the main modeling principles used to construct classical ROMs, motivate and introduce modern ROM closures, and show how data-driven modeling, artificial intelligence, and machine learning have changed the standard ROM methodology over the last two decades. Finally, we outline our vision on how state-of-the-art data-driven modeling can continue to reshape the field of reduced order modeling. △ Less

Submitted 23 August, 2021; v1 submitted 28 June, 2021; originally announced June 2021.

Model fusion with physics-guided machine learning

Authors: Suraj Pawar, Omer San, Aditya Nair, Adil Rasheed, Trond Kvamsdal

Abstract: The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatio-temporal scales have enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their genera… ▽ More The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatio-temporal scales have enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their generalizability. This is particularly essential when data-driven models are employed within outer-loop applications like optimization. In this work, we put forth a physics-guided machine learning (PGML) framework that leverages the interpretable physics-based model with a deep learning model. The PGML framework is capable of enhancing the generalizability of data-driven models and effectively protect against or inform about the inaccurate predictions resulting from extrapolation. We apply the PGML framework as a novel model fusion approach combining the physics-based Galerkin projection model and long-short term memory (LSTM) network for parametric model order reduction of fluid flows. We demonstrate the improved generalizability of the PGML framework against a purely data-driven approach through the injection of physics features into intermediate LSTM layers. Our quantitative analysis shows that the overall model uncertainty can be reduced through the PGML approach especially for test data coming from a distribution different than the training data. Moreover, we demonstrate that our approach can be used as an inverse diagnostic tool providing a confidence score associated with models and observations. The proposed framework also allows for multi-fidelity computing by making use of low-fidelity models in the online deployment of quantified data-driven models. △ Less

Submitted 9 April, 2021; originally announced April 2021.

A nonintrusive hybrid neural-physics modeling of incomplete dynamical systems: Lorenz equations

Authors: Suraj Pawar, Omer San, Adil Rasheed, Ionel M. Navon

Abstract: This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of dynamics of some variables is unknown, but reasonably accurate observational data can be obtained for the evolution of the state of the system. In this work, we prop… ▽ More This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of dynamics of some variables is unknown, but reasonably accurate observational data can be obtained for the evolution of the state of the system. In this work, we propose machine learning to account for missing physics and then data assimilation to correct the prediction. In particular, we devise an effective methodology based on a recurrent neural network to model the unknown dynamics. A long short-term memory (LSTM) based correction term is added to the predictive model in order to take into account hidden physics. Since LSTM introduces a black-box approach for the unknown part of the model, we investigate whether the proposed hybrid neural-physical model can be further corrected through a sequential data assimilation step. We apply this framework to the weakly nonlinear Lorenz model that displays quasiperiodic oscillations, the highly nonlinear Lorenz model, and two-scale Lorenz model. The hybrid neural-physics model yields accurate results for the weakly nonlinear Lorenz model with the predicted state close to the true Lorenz model trajectory. For the highly nonlinear Lorenz model and the two-scale Lorenz model, the hybrid neural-physics model deviates from the true state due to the accumulation of prediction error from one time step to the next time step. The ensemble Kalman filter approach takes into account the prediction error and updates the diverged prediction using available observations in order to provide a more accurate state estimate. The successful synergistic integration of neural network and data assimilation for low-dimensional system shows the potential benefits of the proposed hybrid-neural physics model for complex systems. △ Less

Submitted 13 August, 2021; v1 submitted 31 March, 2021; originally announced April 2021.

Hybrid analysis and modeling for next generation of digital twins

Authors: Suraj Pawar, Shady E. Ahmed, Omer San, Adil Rasheed

Abstract: The physics-based modeling has been the workhorse for many decades in many scientific and engineering applications ranging from wind power, weather forecasting, and aircraft design. Recently, data-driven models are increasingly becoming popular in many branches of science and engineering due to their non-intrusive nature and online learning capability. Despite the robust performance of data-driven… ▽ More The physics-based modeling has been the workhorse for many decades in many scientific and engineering applications ranging from wind power, weather forecasting, and aircraft design. Recently, data-driven models are increasingly becoming popular in many branches of science and engineering due to their non-intrusive nature and online learning capability. Despite the robust performance of data-driven models, they are faced with challenges of poor generalizability and difficulty in interpretation. These challenges have encouraged the integration of physics-based models with data-driven models, herein denoted hybrid analysis and modeling (HAM). We propose two different frameworks under the HAM paradigm for applications relevant to wind energy in order to bring the physical realism within emerging digital twin technologies. The physics-guided machine learning (PGML) framework reduces the uncertainty of neural network predictions by embedding physics-based features from a simplified model at intermediate layers and its performance is demonstrated for the aerodynamic force prediction task. Our results show that the proposed PGML framework achieves approximately 75\% reduction in uncertainty for smaller angle of attacks. The interface learning (IL) framework illustrates how different solvers can be coupled to produce a multi-fidelity model and is successfully applied for the Boussinesq equations that govern a broad class of transport processes. The IL approach paves the way for seamless integration of multi-scale, multi-physics and multi-fidelity models (M^3 models). △ Less

Submitted 14 January, 2021; originally announced January 2021.

Comments: arXiv admin note: text overlap with arXiv:2012.13343

Physics guided machine learning using simplified theories

Authors: Suraj Pawar, Omer San, Burak Aksoylu, Adil Rasheed, Trond Kvamsdal

Abstract: Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences. In this letter, we introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines. The chief idea in our approach is to augment the knowledge of the simplif… ▽ More Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences. In this letter, we introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines. The chief idea in our approach is to augment the knowledge of the simplified theories with the underlying learning process. To emphasise on their physical importance, our architecture consists of adding certain features at intermediate layers rather than in the input layer. To demonstrate our approach, we select a canonical airfoil aerodynamic problem with the enhancement of the potential flow theory. We include features obtained by a panel method that can be computed efficiently for an unseen configuration in our training procedure. By addressing the generalizability concerns, our results suggest that the proposed feature enhancement approach can be effectively used in many scientific machine learning applications, especially for the systems where we can use a theoretical, empirical, or simplified model to guide the learning module. △ Less

Submitted 18 December, 2020; originally announced December 2020.

Distributed deep reinforcement learning for simulation control

Authors: Suraj Pawar, Romit Maulik

Abstract: Several applications in the scientific simulation of physical systems can be formulated as control/optimization problems. The computational models for such systems generally contain hyperparameters, which control solution fidelity and computational expense. The tuning of these parameters is non-trivial and the general approach is to manually `spot-check' for good combinations. This is because opti… ▽ More Several applications in the scientific simulation of physical systems can be formulated as control/optimization problems. The computational models for such systems generally contain hyperparameters, which control solution fidelity and computational expense. The tuning of these parameters is non-trivial and the general approach is to manually `spot-check' for good combinations. This is because optimal hyperparameter configuration search becomes impractical when the parameter space is large and when they may vary dynamically. To address this issue, we present a framework based on deep reinforcement learning (RL) to train a deep neural network agent that controls a model solve by varying parameters dynamically. First, we validate our RL framework for the problem of controlling chaos in chaotic systems by dynamically changing the parameters of the system. Subsequently, we illustrate the capabilities of our framework for accelerating the convergence of a steady-state CFD solver by automatically adjusting the relaxation factors of discretized Navier-Stokes equations during run-time. The results indicate that the run-time control of the relaxation factors by the learned policy leads to a significant reduction in the number of iterations for convergence compared to the random selection of the relaxation factors. Our results point to potential benefits for learning adaptive hyperparameter learning strategies across different geometries and boundary conditions with implications for reduced computational campaign expenses. \footnote{Data and codes available at \url{https://github.com/Romit-Maulik/PAR-RL}} △ Less

Submitted 8 December, 2020; v1 submitted 21 September, 2020; originally announced September 2020.

Dynamics of coupled thermoacoustic oscillators under asymmetric forcing: Experiments and theoretical modeling

Authors: Ankit Sahay, Amitesh Roy, Samadhan A. Pawar, R. I. Sujith

Abstract: Quenching of limit cycle oscillations (LCO), either through mutual coupling or external forcing, has attracted wide attention in several fields of science and engineering. However, the simultaneous utilization of these coupling schemes in quenching of LCO has rarely been studied despite its practical applicability. We study the dynamics of two thermoacoustic oscillators simultaneously subjected to… ▽ More Quenching of limit cycle oscillations (LCO), either through mutual coupling or external forcing, has attracted wide attention in several fields of science and engineering. However, the simultaneous utilization of these coupling schemes in quenching of LCO has rarely been studied despite its practical applicability. We study the dynamics of two thermoacoustic oscillators simultaneously subjected to mutual coupling and asymmetric external forcing through experiments and theoretical modeling. We investigate the forced response of both identical and non-identical thermoacoustic oscillators for two different amplitudes of LCO. Under mutual coupling alone, identical thermoacoustic oscillators display the occurrence of partial amplitude death and amplitude death, whereas under forcing alone, asynchronous quenching of LCO is observed at non-resonant conditions. When the oscillators are simultaneously subjected to mutual coupling and asymmetric forcing, we observe a larger parametric region of oscillation quenching than when the two mechanisms are utilized individually. This enhancement in the region of oscillation quenching is due to the complementary effect of amplitude death and asynchronous quenching. However, a forced response of coupled non-identical oscillators shows that the effect of forcing is insignificant on synchronization and quenching of oscillations in the oscillator which is not directly forced. Finally, we qualitatively capture the experimental results using a reduced-order theoretical model of two coupled Rijke tubes which are coupled through dissipative and time-delay coupling and asymmetrically forced. We believe that these findings offer fresh insights into the combined effects of mutual and forced synchronization in a system of coupled nonlinear oscillators. △ Less

Submitted 24 February, 2021; v1 submitted 23 August, 2020; originally announced August 2020.

Comments: 26 pages, 14 figures

Journal ref: Phys. Rev. Applied 15, 044011 (2021)

Interface learning in fluid dynamics: statistical inference of closures within micro-macro coupling models

Authors: Suraj Pawar, Shady E. Ahmed, Omer San

Abstract: Many complex multiphysics systems in fluid dynamics involve using solvers with varied levels of approximations in different regions of the computational domain to resolve multiple spatiotemporal scales present in the flow. The accuracy of the solution is governed by how the information is exchanged between these solvers at the interface and several methods have been devised for such coupling probl… ▽ More Many complex multiphysics systems in fluid dynamics involve using solvers with varied levels of approximations in different regions of the computational domain to resolve multiple spatiotemporal scales present in the flow. The accuracy of the solution is governed by how the information is exchanged between these solvers at the interface and several methods have been devised for such coupling problems. In this article, we construct a data-driven model by spatially coupling a microscale lattice Boltzmann method (LBM) solver and macroscale finite difference method (FDM) solver for reaction-diffusion systems. The coupling between the micro-macro solvers has one to many map** at the interface leading to the interface closure problem, and we propose a statistical inference method based on neural networks to learn this closure relation. The performance of the proposed framework in a bifidelity setting partitioned between the FDM and LBM domain shows its promise for complex systems where analytical relations between micro-macro solvers are not available. △ Less

Submitted 10 August, 2020; originally announced August 2020.

A nudged hybrid analysis and modeling approach for realtime wake-vortex transport and decay prediction

Authors: Shady Ahmed, Suraj Pawar, Omer San, Adil Rasheed, Mandar Tabib

Abstract: We put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements for air traffic improvements. Toward emerging applications of digital twins in aviation, the proposed approach allows for constructing a realtime predictive tool for wake-vortex transport and decay systems. We build on the fact that in realis… ▽ More We put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements for air traffic improvements. Toward emerging applications of digital twins in aviation, the proposed approach allows for constructing a realtime predictive tool for wake-vortex transport and decay systems. We build on the fact that in realistic application, there are uncertainties in initial and boundary conditions, model parameters, as well as measurements. Moreover, conventional nonlinear ROMs based on Galerkin projection (GROMs) suffer from imperfection and solution instabilities, especially for advection-dominated flows with slow decay in the Kolmogorov width. In the presented LSTM nudging (LSTM-N) approach, we fuse forecasts from a combination of imperfect GROM and uncertain state estimates, with sparse Eulerian sensor measurements to provide more reliable predictions in a dynamical data assimilation framework. We illustrate our concept by solving a two-dimensional vorticity transport equation. We investigate the effects of measurements noise and state estimate uncertainty on the performance of the LSTM-N behavior. We also demonstrate that it can sufficiently handle different levels of temporal and spatial measurement sparsity, and offer a huge potential in develo** next-generation digital twin technologies. △ Less

Submitted 5 March, 2021; v1 submitted 5 August, 2020; originally announced August 2020.

Comments: arXiv admin note: substantial text overlap with arXiv:2005.14246

Data assimilation empowered neural network parameterizations for subgrid processes in geophysical flows

Authors: Suraj Pawar, Omer San

Abstract: In the past couple of years, there is a proliferation in the use of machine learning approaches to represent subgrid scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical simulations of these flows. Despite its success for different types of flow, the online deployment of a data-driven closure model can cause instabilities and biases in… ▽ More In the past couple of years, there is a proliferation in the use of machine learning approaches to represent subgrid scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical simulations of these flows. Despite its success for different types of flow, the online deployment of a data-driven closure model can cause instabilities and biases in modeling the overall effect of subgrid scale processes, which in turn leads to inaccurate prediction. To tackle this issue, we exploit the data assimilation technique to correct the physics-based model coupled with the neural network as a surrogate for unresolved flow dynamics in multiscale systems. In particular, we use a set of neural network architectures to learn the correlation between resolved flow variables and the parameterizations of unresolved flow dynamics and formulate a data assimilation approach to correct the hybrid model during their online deployment. We illustrate our framework in a set of applications of the multiscale Lorenz 96 system for which the parameterization model for unresolved scales is exactly known, and the two-dimensional Kraichnan turbulence system for which the parameterization model for unresolved scales is not known a priori. Our analysis, therefore, comprises a predictive dynamical core empowered by (i) a data-driven closure model for subgrid scale processes, (ii) a data assimilation approach for forecast error correction, and (iii) both data-driven closure and data assimilation procedures. We show significant improvement in the long-term prediction of the underlying chaotic dynamics with our framework compared to using only neural network parameterizations for future prediction. △ Less

Submitted 9 April, 2021; v1 submitted 15 June, 2020; originally announced June 2020.

Reduced order modeling of fluid flows: Machine learning, Kolmogorov barrier, closure modeling, and partitioning

Authors: Shady Ahmed, Suraj Pawar, Omer San, Adil Rasheed

Abstract: In this paper, we put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements. We build on the fact that in a realistic application, there are uncertainties in initial conditions, boundary conditions, model parameters, and/or field measurements. Moreover, conventional nonlinear ROMs based on Galerkin pro… ▽ More In this paper, we put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements. We build on the fact that in a realistic application, there are uncertainties in initial conditions, boundary conditions, model parameters, and/or field measurements. Moreover, conventional nonlinear ROMs based on Galerkin projection (GROMs) suffer from imperfection and solution instabilities due to the modal truncation, especially for advection-dominated flows with slow decay in the Kolmogorov width. In the presented LSTM-Nudge approach, we fuse forecasts from a combination of imperfect GROM and uncertain state estimates, with sparse Eulerian sensor measurements to provide more reliable predictions in a dynamical data assimilation framework. We illustrate the idea with the viscous Burgers problem, as a benchmark test bed with quadratic nonlinearity and Laplacian dissipation. We investigate the effects of measurements noise and state estimate uncertainty on the performance of the LSTM-Nudge behavior. We also demonstrate that it can sufficiently handle different levels of temporal and spatial measurement sparsity. This first step in our assessment of the proposed model shows that the LSTM nudging could represent a viable realtime predictive tool in emerging digital twin systems. △ Less

Submitted 28 May, 2020; originally announced May 2020.

Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows

Authors: Suraj Pawar, Shady E. Ahmed, Omer San, Adil Rasheed, Ionel M. Navon

Abstract: Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging ga… ▽ More Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging gain matrix might be cumbersome. In this paper, we put forth a fully nonintrusive recurrent neural network approach based on a long short-term memory (LSTM) embedding architecture to estimate the nudging term, which plays a role not only to force the state trajectories to the observations but also acts as a stabilizer. Furthermore, our approach relies on the power of archival data and the trained model can be retrained effectively due to power of transfer learning in any neural network applications. In order to verify the feasibility of the proposed approach, we perform twin experiments using Lorenz 96 system. Our results demonstrate that the proposed LSTM nudging approach yields more accurate estimates than both extended Kalman filter (EKF) and ensemble Kalman filter (EnKF) when only sparse observations are available. With the availability of emerging AI-friendly and modular hardware technologies and heterogeneous computing platforms, we articulate that our simplistic nudging framework turns out to be computationally more efficient than either the EKF or EnKF approaches. △ Less

Submitted 22 May, 2020; originally announced May 2020.

Electrical Route to Realising Intensity Simulation of Heavy Rain Events in Tropics

Authors: Dipjyoti Mudiar, Anupam Hazra, S. D. Pawar, Rama Krishna Karumuri, Mahen Konwar, Subrata Mukherjee, M. K. Srivastava, B. N. Goswami

Abstract: In the backdrop of a revolution in weather prediction by Numerical Weather Prediction (NWP) models, quantitative prediction of intensity of heavy rainfall events and associated disasters has remained a challenge. Encouraged by compelling evidence of electrical influences on cloud/rain microphysical processes, here we propose a hypothesis that modification of raindrop size distribution (RDSD) towar… ▽ More In the backdrop of a revolution in weather prediction by Numerical Weather Prediction (NWP) models, quantitative prediction of intensity of heavy rainfall events and associated disasters has remained a challenge. Encouraged by compelling evidence of electrical influences on cloud/rain microphysical processes, here we propose a hypothesis that modification of raindrop size distribution (RDSD) towards larger drop sizes through enhanced collision-coalescence facilitated by cloud electric fields could be one of the factors responsible for intensity errors in weather/climate models. The robustness of the hypothesis is confirmed through a series of simulations of strongly electrified (SE) rain events and weakly electrified (WE) events with a convection-permitting weather prediction model incorporating the electrically modified RDSD parameters in the model physics. Our results indicate a possible roadmap for improving hazard prediction associated with extreme rainfall events in weather prediction models and climatological dry bias of precipitation simulation in many climate models. △ Less

Submitted 19 April, 2020; originally announced April 2020.

An evolve-then-correct reduced order model for hidden fluid dynamics

Authors: Suraj Pawar, Shady E. Ahmed, O. San, A. Rasheed

Abstract: In this paper, we put forth an evolve-then-correct reduced order modeling approach that combines intrusive and nonintrusive models to take hidden physical processes into account. Specifically, we split the underlying dynamics into known and unknown components. In the known part, we first utilize an intrusive Galerkin method projected on a set of basis functions obtained by proper orthogonal decomp… ▽ More In this paper, we put forth an evolve-then-correct reduced order modeling approach that combines intrusive and nonintrusive models to take hidden physical processes into account. Specifically, we split the underlying dynamics into known and unknown components. In the known part, we first utilize an intrusive Galerkin method projected on a set of basis functions obtained by proper orthogonal decomposition. We then formulate a recurrent neural network emulator based on the assumption that observed data is a manifestation of all relevant processes. We further enhance our approach by using an orthonormality conforming basis interpolation approach on a Grassmannian manifold to address off-design conditions. The proposed framework is illustrated here with the application of two-dimensional co-rotating vortex simulations under modeling uncertainty. The results demonstrate highly accurate predictions underlining the effectiveness of the evolve-then-correct approach toward realtime simulations, where the full process model is not known a priori. △ Less

Submitted 5 November, 2019; originally announced November 2019.

Data-driven recovery of hidden physics in reduced order modeling of fluid flows

Authors: Suraj Pawar, Shady E. Ahmed, Omer San, Adil Rasheed

Abstract: In this article, we introduce a modular hybrid analysis and modeling (HAM) approach to account for hidden physics in reduced order modeling (ROM) of parameterized systems relevant to fluid dynamics. The hybrid ROM framework is based on using the first principles to model the known physics in conjunction with utilizing the data-driven machine learning tools to model remaining residual that is hidde… ▽ More In this article, we introduce a modular hybrid analysis and modeling (HAM) approach to account for hidden physics in reduced order modeling (ROM) of parameterized systems relevant to fluid dynamics. The hybrid ROM framework is based on using the first principles to model the known physics in conjunction with utilizing the data-driven machine learning tools to model remaining residual that is hidden in data. This framework employs proper orthogonal decomposition as a compression tool to construct orthonormal bases and Galerkin projection (GP) as a model to built the dynamical core of the system. Our proposed methodology hence compensates structural or epistemic uncertainties in models and utilizes the observed data snapshots to compute true modal coefficients spanned by these bases. The GP model is then corrected at every time step with a data-driven rectification using a long short-term memory (LSTM) neural network architecture to incorporate hidden physics. A Grassmannian manifold approach is also adapted for interpolating basis functions to unseen parametric conditions. The control parameter governing the system's behavior is thus implicitly considered through true modal coefficients as input features to the LSTM network. The effectiveness of the HAM approach is discussed through illustrative examples that are generated synthetically to take hidden physics into account. Our approach thus provides insights addressing a fundamental limitation of the physics-based models when the governing equations are incomplete to represent underlying physical processes. △ Less

Submitted 30 October, 2019; originally announced October 2019.

A priori analysis on deep learning of subgrid-scale parameterizations for Kraichnan turbulence

Authors: Suraj Pawar, Omer San, Adil Rasheed, Prakash Vedula

Abstract: In the present study, we investigate different data-driven parameterizations for large eddy simulation of two-dimensional turbulence in the \emph{a priori} settings. These models utilize resolved flow field variables on the coarser grid to estimate the subgrid-scale stresses. We use data-driven closure models based on localized learning that employs multilayer feedforward artificial neural network… ▽ More In the present study, we investigate different data-driven parameterizations for large eddy simulation of two-dimensional turbulence in the \emph{a priori} settings. These models utilize resolved flow field variables on the coarser grid to estimate the subgrid-scale stresses. We use data-driven closure models based on localized learning that employs multilayer feedforward artificial neural network (ANN) with point-to-point map** and neighboring stencil data map**, and convolutional neural network (CNN) fed by data snapshots of the whole domain. The performance of these data-driven closure models is measured through a probability density function and is compared with the dynamic Smagorinksy model (DSM). The quantitative performance is evaluated using the cross-correlation coefficient between the true and predicted stresses. We analyze different frameworks in terms of the amount of training data, selection of input and output features, their characteristics in modeling with accuracy, and training and deployment computational time. We also demonstrate computational gain that can be achieved using the intelligent eddy viscosity model that learns eddy viscosity computed by the DSM instead of subgrid-scale stresses. We detail the hyperparameters optimization of these models using the grid search algorithm. △ Less

Submitted 15 October, 2019; originally announced October 2019.

A deep learning enabler for non-intrusive reduced order modeling of fluid flows

Authors: S. Pawar, S. M. Rahman, H. Vaddireddy, O. San, A. Rasheed, P. Vedula

Abstract: In this paper, we introduce a modular deep neural network (DNN) framework for data-driven reduced order modeling of dynamical systems relevant to fluid flows. We propose various deep neural network architectures which numerically predict evolution of dynamical systems by learning from either using discrete state or slope information of the system. Our approach has been demonstrated using both resi… ▽ More In this paper, we introduce a modular deep neural network (DNN) framework for data-driven reduced order modeling of dynamical systems relevant to fluid flows. We propose various deep neural network architectures which numerically predict evolution of dynamical systems by learning from either using discrete state or slope information of the system. Our approach has been demonstrated using both residual formula and backward difference scheme formulas. However, it can be easily generalized into many different numerical schemes as well. We give a demonstration of our framework for three examples: (i) Kraichnan-Orszag system, an illustrative coupled nonlinear ordinary differential equations, (ii) Lorenz system exhibiting chaotic behavior, and (iii) a non-intrusive model order reduction framework for the two-dimensional Boussinesq equations with a differentially heated cavity flow setup at various Rayleigh numbers. Using only snapshots of state variables at discrete time instances, our data-driven approach can be considered truly non-intrusive, since any prior information about the underlying governing equations is not required for generating the reduced order model. Our \textit{a posteriori} analysis shows that the proposed data-driven approach is remarkably accurate, and can be used as a robust predictive tool for non-intrusive model order reduction of complex fluid flows. △ Less

Submitted 10 July, 2019; originally announced July 2019.

Comments: 36 pages, 21 figures

A non-intrusive reduced order modeling framework for quasi-geostrophic turbulence

Authors: Sk. Mashfiqur Rahman, Suraj Pawar, Omer San, Adil Rasheed, Traian Iliescu

Abstract: In this study, we present a non-intrusive reduced order modeling (ROM) framework for large-scale quasi-stationary systems. The framework proposed herein exploits the time series prediction capability of long short-term memory (LSTM) recurrent neural network such that: (i) in the training phase, the LSTM model is trained on the modal coefficients extracted from the high-resolution data using proper… ▽ More In this study, we present a non-intrusive reduced order modeling (ROM) framework for large-scale quasi-stationary systems. The framework proposed herein exploits the time series prediction capability of long short-term memory (LSTM) recurrent neural network such that: (i) in the training phase, the LSTM model is trained on the modal coefficients extracted from the high-resolution data using proper orthogonal decomposition (POD) transform, and (ii) in the testing phase, the trained model predicts the modal coefficients for the total time recursively based on the initial time history. To illustrate the predictive performance of the proposed framework, the mean flow fields and time series response of the field values are reconstructed from the predicted modal coefficients by using an inverse POD transform. As a representative benchmark test case, we consider a two-dimensional quasi-geostrophic (QG) ocean circulation model which, in general, displays an enormous range of fluctuating spatial and temporal scales. We first illustrate that the conventional Galerkin projection based ROM of such systems requires a high number of POD modes to obtain a stable flow physics. In addition, ROM-GP does not seem to capture the intermittent bursts appearing in the dynamics of the first few most energetic modes. However, the proposed non-intrusive ROM framework based on LSTM (ROM-LSTM) yields a stable solution even for a small number of POD modes. We also observe that the ROM-LSTM model is able to capture quasi-periodic intermittent bursts accurately, and yields a stable and accurate mean flow dynamics using the time history of a few previous time states, denoted as the lookback time-window in this paper. Our findings suggest that the proposed ROM framework is capable of predicting noisy nonlinear fluid flows in an extremely efficient way compared to the conventional projection based ROM. △ Less

Submitted 23 June, 2019; originally announced June 2019.

Journal ref: Phys. Rev. E 100, 053306 (2019)

Unexpected enhancement in secondary cosmic ray flux during the total lunar eclipse of December 10, 2011

Authors: Anil Raghav, Ankush Bhaskar, Virendra Yadav, Nitinkumar Bijewar, Chintamani Pai, Ashish Koli, Nilam Navale, Gurinderpal Singh, Nitin Dubey, Sushant Pawar, Pradnya Parab, Gandhali Narvankar, Vaibhav Rawoot, Vikas Rawat, Satish Borse, Nagnath Garad, Carl Rozario, Nitin Kaushal, Shailendrakumar Tiwari, M. R. Press

Abstract: Temporal variation of secondary cosmic rays (SCR) flux was measured during the total lunar eclipse on December 10, 2011 and the subsequent full moon on January 8, 2012. The measurements were done at Department of Physics, University of Mumbai, Mumbai (Geomagnetic latitude: 10.6 N), India using NaI (Tl) scintillation detector by kee** energy threshold of 200 KeV. The SCR flux showed approximately… ▽ More Temporal variation of secondary cosmic rays (SCR) flux was measured during the total lunar eclipse on December 10, 2011 and the subsequent full moon on January 8, 2012. The measurements were done at Department of Physics, University of Mumbai, Mumbai (Geomagnetic latitude: 10.6 N), India using NaI (Tl) scintillation detector by kee** energy threshold of 200 KeV. The SCR flux showed approximately 8.1% enhancement during the lunar eclipse as compared to the average of pre- and post-eclipse periods. Weather parameters (temperature and relative humidity) were continuously monitored and their correlations with temporal variation in SCR flux were examined. The influences of geomagnetic field, interplanetary parameters and tidal effect on SCR flux were considered. Qualitative analysis of SCR flux variation indicates that the known factors affecting SCR flux fail to explain observed enhancement during the eclipse. This enhancement during lunar eclipse and widely reported decrease during solar eclipses may unravel hitherto unnoticed factors modulating SCR flux. △ Less

Submitted 18 December, 2012; originally announced December 2012.

Comments: 12 pages, 8 figures

Measurements of the ion concentrations and conductivity over the Arabian Sea during the ARMEX

Authors: Devendraa Siingh, S. D. Pawar, V. Gopalakrishnan, A. K. Kamra

Abstract: Measurements of the small-, intermediate-, and large-ion concentrations and the atmospheric electric conductivity of both polarities have been made over the Arabian Sea on four cruises of ORV Sagarkanya during the Arabian Sea Monsoon Experiment (ARMEX)during the monsoon and pre-monsoon seasons of 2002 and 2003. Seasonally averaged values of the total as well as polar conductivity are much higher… ▽ More Measurements of the small-, intermediate-, and large-ion concentrations and the atmospheric electric conductivity of both polarities have been made over the Arabian Sea on four cruises of ORV Sagarkanya during the Arabian Sea Monsoon Experiment (ARMEX)during the monsoon and pre-monsoon seasons of 2002 and 2003. Seasonally averaged values of the total as well as polar conductivity are much higher during the monsoon than pre-monsoon season. Surprisingly, however, the concentration of small ions are less and those of large and intermediate ions are more during the monsoon than pre-monsoon season. The diurnal variations observed during the pre-monsoon season show that the nighttime small ion concentrations are about an order of magnitude higher than their daytime values. On the contrary, the daytime concentrations of the intermediate and large ions are much higher than those of their nighttime values. No such diurnal variations in ion concentrations are observed in monsoon season. Also examined are the variations in ion concentrations of different categories with distance from the coastline in different seasons and the ion-concentration changes associated with the precipitation of various types that occurred over ORV Sagarkanya. It is sufficient to invoke the ion-aerosol attachment process to explain our pre-monsoon observations. However, the generation of highly charged large ions by the bubble-breaking process caused by the wave breaking due to strong southwesterly surface winds ten to twenty meter per second over the Arabian Sea is postulated to explain the monsoon season observations. △ Less

Submitted 21 October, 2009; originally announced October 2009.

Comments: 35 pages, 8 figures

Journal ref: Journal of Geophysical Research-Atmosphere, 110, D18207, 2005