Showing 1–50 of 90 results for author: San, O

Bridging Large Eddy Simulation and Reduced Order Modeling of Convection-Dominated Flows through Spatial Filtering: Review and Perspectives

Authors: Annalisa Quaini, Omer San, Alessandro Veneziani, Traian Iliescu

Abstract: Reduced order models (ROMs) have achieved a lot of success in reducing the computational cost of traditional numerical methods across many disciplines. For convection-dominated (e.g., turbulent) flows, however, standard ROMs generally yield inaccurate results, usually affected by spurious oscillations. Thus, ROMs are usually equipped with numerical stabilization or closure models to account for th… ▽ More Reduced order models (ROMs) have achieved a lot of success in reducing the computational cost of traditional numerical methods across many disciplines. For convection-dominated (e.g., turbulent) flows, however, standard ROMs generally yield inaccurate results, usually affected by spurious oscillations. Thus, ROMs are usually equipped with numerical stabilization or closure models to account for the effect of the discarded modes. The literature on ROM closures and stabilizations is large and growing fast. In this paper, we focus on one particular type of ROM closures and stabilizations that are inspired by Large Eddy Simulation (LES). These ROMs, which we call LES-ROMs, are extremely easy to implement, very efficient, and accurate. Carefully tuned LES-ROMs can accurately capture the average physical quantities of interest in challenging convection-dominated flows in many applications. LES-ROM are constructed by leveraging spatial filtering, i.e., the same principle used to build classical LES models. This ensures a modeling consistency between LES-ROMs and the approaches that generated the data used to train them. It also ``bridges'' two distinct research fields (LES and ROMs), disconnected until now. This paper is a review of LES-ROMs. It starts with a description of a versatile LES strategy called evolve-filter-relax (EFR) that has been successfully used as a full order method. We then show how the EFR strategy, and spatial filtering in general, can be leveraged to construct LES-ROMs. Several applications of LES-ROMs are presented. Finally, we draw conclusions and outline several research directions and open questions in the LES-ROM development. While we do not claim this review to be comprehensive, we certainly hope it serves as a brief and friendly introduction to this exciting research area, which has a lot of potential in practical numerical simulation of convection-dominated flows. △ Less

Submitted 28 June, 2024; originally announced July 2024.

Digital Twin for Wind Energy: Latest updates from the NorthWind project

Authors: Adil Rasheed, Florian Stadtmann, Eivind Fonn, Mandar Tabib, Vasileios Tsiolakis, Balram Panjwani, Kjetil Andre Johannessen, Trond Kvamsdal, Omer San, John Olav Tande, Idar Barstad, Tore Christiansen, Elling Rishoff, Lars Frøyd, Tore Rasmussen

Abstract: NorthWind, a collaborative research initiative supported by the Research Council of Norway, industry stakeholders, and research partners, aims to advance cutting-edge research and innovation in wind energy. The core mission is to reduce wind power costs and foster sustainable growth, with a key focus on the development of digital twins. A digital twin is a virtual representation of physical assets… ▽ More NorthWind, a collaborative research initiative supported by the Research Council of Norway, industry stakeholders, and research partners, aims to advance cutting-edge research and innovation in wind energy. The core mission is to reduce wind power costs and foster sustainable growth, with a key focus on the development of digital twins. A digital twin is a virtual representation of physical assets or processes that uses data and simulators to enable real-time forecasting, optimization, monitoring, control and informed decision-making. Recently, a hierarchical scale ranging from 0 to 5 (0 - Standalone, 1 - Descriptive, 2 - Diagnostic, 3 - Predictive, 4 - Prescriptive, 5 - Autonomous has been introduced within the NorthWind project to assess the capabilities of digital twins. This paper elaborates on our progress in constructing digital twins for wind farms and their components across various capability levels. △ Less

Submitted 26 March, 2024; v1 submitted 21 February, 2024; originally announced March 2024.

Enhancing Elasticity Models: A Novel Corrective Source Term Approach for Accurate Predictions

Authors: Sondre Sørbø, Sindre Stenen Blakseth, Adil Rasheed, Trond Kvamsdal, Omer San

Abstract: With the recent wave of digitalization, specifically in the context of safety-critical applications, there has been a growing need for computationally efficient, accurate, generalizable, and trustworthy models. Physics-based models have traditionally been used extensively for simulating and understanding complex phenomena. However, these models though trustworthy and generalizable to a wide array… ▽ More With the recent wave of digitalization, specifically in the context of safety-critical applications, there has been a growing need for computationally efficient, accurate, generalizable, and trustworthy models. Physics-based models have traditionally been used extensively for simulating and understanding complex phenomena. However, these models though trustworthy and generalizable to a wide array of problems, are not ideal for real-time. To address this issue, the physics-based models are simplified. Unfortunately, these simplifications, like reducing the dimension of the problem (3D to 2D) or linearizing the highly non-linear characteristics of the problem, can degrade model accuracy. Data-driven models, on the other hand, can exhibit better computational efficiency and accuracy. However, they fail to generalize and operate as blackbox, limiting their acceptability in safety-critical applications. In the current article, we demonstrate how we can use a data-driven approach to correct for the two kinds of simplifications in a physics-based model. To demonstrate the methodology's effectiveness, we apply the method to model several elasticity problems. The results show that the hybrid approach, which we call the corrective source term approach, can make erroneous physics-based models more accurate and certain. The hybrid model also exhibits superior performance in terms of accuracy, model uncertainty, and generalizability when compared to its end-to-end data-driven modeling counterpart. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Enhancing wind field resolution in complex terrain through a knowledge-driven machine learning approach

Authors: Jacob Wulff Wold, Florian Stadtmann, Adil Rasheed, Mandar Tabib, Omer San, Jan-Tore Horn

Abstract: Atmospheric flows are governed by a broad variety of spatio-temporal scales, thus making real-time numerical modeling of such turbulent flows in complex terrain at high resolution computationally intractable. In this study, we demonstrate a neural network approach motivated by Enhanced Super-Resolution Generative Adversarial Networks to upscale low-resolution wind fields to generate high-resolutio… ▽ More Atmospheric flows are governed by a broad variety of spatio-temporal scales, thus making real-time numerical modeling of such turbulent flows in complex terrain at high resolution computationally intractable. In this study, we demonstrate a neural network approach motivated by Enhanced Super-Resolution Generative Adversarial Networks to upscale low-resolution wind fields to generate high-resolution wind fields in an actual wind farm in Bessaker, Norway. The neural network-based model is shown to successfully reconstruct fully resolved 3D velocity fields from a coarser scale while respecting the local terrain and that it easily outperforms trilinear interpolation. We also demonstrate that by using appropriate cost function based on domain knowledge, we can alleviate the use of adversarial training. △ Less

Submitted 2 April, 2024; v1 submitted 18 September, 2023; originally announced September 2023.

SuperBench: A Super-Resolution Benchmark Dataset for Scientific Machine Learning

Authors: Pu Ren, N. Benjamin Erichson, Shashank Subramanian, Omer San, Zarija Lukic, Michael W. Mahoney

Abstract: Super-Resolution (SR) techniques aim to enhance data resolution, enabling the retrieval of finer details, and improving the overall quality and fidelity of the data representation. There is growing interest in applying SR methods to complex spatiotemporal systems within the Scientific Machine Learning (SciML) community, with the hope of accelerating numerical simulations and/or improving forecasts… ▽ More Super-Resolution (SR) techniques aim to enhance data resolution, enabling the retrieval of finer details, and improving the overall quality and fidelity of the data representation. There is growing interest in applying SR methods to complex spatiotemporal systems within the Scientific Machine Learning (SciML) community, with the hope of accelerating numerical simulations and/or improving forecasts in weather, climate, and related areas. However, the lack of standardized benchmark datasets for comparing and validating SR methods hinders progress and adoption in SciML. To address this, we introduce SuperBench, the first benchmark dataset featuring high-resolution datasets (up to $2048\times2048$ dimensions), including data from fluid flows, cosmology, and weather. Here, we focus on validating spatial SR performance from data-centric and physics-preserved perspectives, as well as assessing robustness to data degradation tasks. While deep learning-based SR methods (developed in the computer vision community) excel on certain tasks, despite relatively limited prior physics information, we identify limitations of these methods in accurately capturing intricate fine-scale features and preserving fundamental physical properties and constraints in scientific data. These shortcomings highlight the importance and subtlety of incorporating domain knowledge into ML models. We anticipate that SuperBench will significantly advance SR methods for scientific tasks. △ Less

Submitted 24 June, 2023; originally announced June 2023.

Accelerated evolution of Burgers turbulence with coarse projective integration and deep learning

Authors: Mrigank Dhingra, Omer San, Anne E. Staples

Abstract: Simulating turbulence to stationarity is a major bottleneck in many engineering problems of practical importance. The problem can be cast as a multiscale problem involving energy redistribution processes that take place on the long large eddy turnover time scale and chaotic processes that take the much shorter time scale of the turbulent fluctuations. But the absence of a way to perform super-reso… ▽ More Simulating turbulence to stationarity is a major bottleneck in many engineering problems of practical importance. The problem can be cast as a multiscale problem involving energy redistribution processes that take place on the long large eddy turnover time scale and chaotic processes that take the much shorter time scale of the turbulent fluctuations. But the absence of a way to perform super-resolution reconstructions of the instantaneous velocity field from its lower dimensional moments has prevented the implementation of multiscale computational approaches for accelerating turbulence simulations. Here, we use an encoder-decoder recurrent neural network to learn the relationship between the instantaneous velocity field and energy spectrum for the one-dimensional stochastic Burgers equation, a common toy model of turbulence. We use the model to reconstruct the velocity field from instantaneous energy spectra in an equation-free coarse projective integration multiscale simulation scheme using a velocity-energy, fine-coarse multiscale framework. The multiscale-machine learning approach put forth here recovers the final statistically stationary turbulent Burgers velocity field up to 442 times faster in wall clock time than using direct numerical simulation alone, with 3-digit accuracy. △ Less

Submitted 25 May, 2023; originally announced May 2023.

Comments: 23 pages, 17 figures

On the dual advantage of placing observations through forward sensitivity analysis

Authors: Shady E Ahmed, Omer San, Sivaramakrishnan Lakshmivarahan, John M Lewis

Abstract: The four-dimensional variational data assimilation methodology for assimilating noisy observations into a deterministic model has been the workhorse of forecasting centers for over three decades. While this method provides a computationally efficient framework for dynamic data assimilation, it is largely silent on the important question concerning the minimum number and placement of observations.… ▽ More The four-dimensional variational data assimilation methodology for assimilating noisy observations into a deterministic model has been the workhorse of forecasting centers for over three decades. While this method provides a computationally efficient framework for dynamic data assimilation, it is largely silent on the important question concerning the minimum number and placement of observations. To answer this question, we demonstrate the dual advantage of placing the observations where the square of the sensitivity of the model solution with respect to the unknown control variables, called forward sensitivities, attains its maximum. Therefore, we can force the observability Gramian to be of full rank, which in turn guarantees efficient recovery of the optimal values of the control variables, which is the first of the two advantages of this strategy. We further show that the proposed strategy of placing observations has another inherent optimality: the square of the sensitivity of the optimal estimates of the control with respect to the observations (used to obtain these estimates) attains its minimum value, a second advantage that is a direct consequence of the above strategy for placing observations. Our analytical framework and numerical experiments on linear and nonlinear systems confirm the effectiveness of our proposed strategy. △ Less

Submitted 29 April, 2023; originally announced May 2023.

Digital Twins in Wind Energy: Emerging Technologies and Industry-Informed Future Directions

Authors: Florian Stadtman, Adil Rasheed, Trond Kvamsdal, Kjetil André Johannessen, Omer San, Konstanze Kölle, John Olav Giæver Tande, Idar Barstad, Alexis Benhamou, Thomas Brathaug, Tore Christiansen, Anouk-Letizia Firle, Alexander Fjeldly, Lars Frøyd, Alexander Gleim, Alexander Høiberget, Catherine Meissner, Guttorm Nygård, Jørgen Olsen, Håvard Paulshus, Tore Rasmussen, Elling Rishoff, Francesco Scibilia, John Olav Skogås

Abstract: This article presents a comprehensive overview of the digital twin technology and its capability levels, with a specific focus on its applications in the wind energy industry. It consolidates the definitions of digital twin and its capability levels on a scale from 0-5; 0-standalone, 1-descriptive, 2-diagnostic, 3-predictive, 4-prescriptive, 5-autonomous. It then, from an industrial perspective, i… ▽ More This article presents a comprehensive overview of the digital twin technology and its capability levels, with a specific focus on its applications in the wind energy industry. It consolidates the definitions of digital twin and its capability levels on a scale from 0-5; 0-standalone, 1-descriptive, 2-diagnostic, 3-predictive, 4-prescriptive, 5-autonomous. It then, from an industrial perspective, identifies the current state of the art and research needs in the wind energy sector. The article proposes approaches to the identified challenges from the perspective of research institutes and offers a set of recommendations for diverse stakeholders to facilitate the acceptance of the technology. The contribution of this article lies in its synthesis of the current state of knowledge and its identification of future research needs and challenges from an industry perspective, ultimately providing a roadmap for future research and development in the field of digital twin and its applications in the wind energy industry. △ Less

Submitted 14 October, 2023; v1 submitted 16 April, 2023; originally announced April 2023.

Journal ref: in IEEE Access, vol. 11, pp. 110762-110795, 2023

Forward Sensitivity Analysis and Mode Dependent Control for Closure Modeling of Galerkin Systems

Authors: Shady E. Ahmed, Omer San

Abstract: Model reduction by projection-based approaches is often associated with losing some of the important features that contribute towards the dynamics of the retained scales. As a result, a mismatch occurs between the predicted trajectories of the original system and the truncated one. We put forth a framework to apply a continuous time control signal in the latent space of the reduced order model (RO… ▽ More Model reduction by projection-based approaches is often associated with losing some of the important features that contribute towards the dynamics of the retained scales. As a result, a mismatch occurs between the predicted trajectories of the original system and the truncated one. We put forth a framework to apply a continuous time control signal in the latent space of the reduced order model (ROM) to account for the effect of truncation. We set the control input using parameterized models by following energy transfer principles. Our methodology relies on observing the system behavior in the physical space and using the projection operator to restrict the feedback signal into the latent space. Then, we leverage the forward sensitivity method (FSM) to derive relationships between the feedback and the desired mode-dependent control. We test the performance of the proposed approach using two test cases, corresponding to viscous Burgers and vortex merger problems at high Reynolds number. Results show that the ROM trajectory with the applied FSM control closely matches its target values in both the data-dense and data-sparse regimes. △ Less

Submitted 10 April, 2023; originally announced April 2023.

Nonintrusive reduced order modeling of convective Boussinesq flows

Authors: Pedram H. Dabaghian, Shady E. Ahmed, Omer San

Abstract: In this paper, we formulate three nonintrusive methods and systematically explore their performance in terms of the ability to reconstruct the quantities of interest and their predictive capabilities. The methods include deterministic dynamic mode decomposition (DMD), randomized DMD and nonlinear proper orthogonal decomposition (NLPOD). We apply these methods to a convection dominated fluid flow p… ▽ More In this paper, we formulate three nonintrusive methods and systematically explore their performance in terms of the ability to reconstruct the quantities of interest and their predictive capabilities. The methods include deterministic dynamic mode decomposition (DMD), randomized DMD and nonlinear proper orthogonal decomposition (NLPOD). We apply these methods to a convection dominated fluid flow problem governed by the Boussinesq equations. We analyze the reconstruction results primarily at two different times for considering different noise levels synthetically added into the data snapshots. Overall, our results indicate that, with a proper selection of the number of retained modes and neural network architectures, all three approaches make predictions that are in a good agreement with the full order model solution. However, we find that the NLPOD approach seems more robust for higher noise levels compared to both DMD approaches. △ Less

Submitted 14 December, 2022; originally announced December 2022.

Artificial intelligence-driven digital twin of a modern house demonstrated in virtual reality

Authors: Elias Mohammed Elfarri, Adil Rasheed, Omer San

Abstract: A digital twin is a powerful tool that can help monitor and optimize physical assets in real-time. Simply put, it is a virtual representation of a physical asset, enabled through data and simulators, that can be used for a variety of purposes such as prediction, monitoring, and decision-making. However, the concept of digital twin can be vague and difficult to understand, which is why a new concep… ▽ More A digital twin is a powerful tool that can help monitor and optimize physical assets in real-time. Simply put, it is a virtual representation of a physical asset, enabled through data and simulators, that can be used for a variety of purposes such as prediction, monitoring, and decision-making. However, the concept of digital twin can be vague and difficult to understand, which is why a new concept called "capability level" has been introduced. This concept categorizes digital twins based on their capability and defines a scale from zero to five, with each level indicating an increasing level of functionality. These levels are standalone, descriptive, diagnostic, predictive, prescriptive, and autonomous. By understanding the capability level of a digital twin, we can better understand its potential and limitations. To demonstrate the concepts, we use a modern house as an example. The house is equipped with a range of sensors that collect data about its internal state, which can then be used to create digital twins of different capability levels. These digital twins can be visualized in virtual reality, allowing users to interact with and manipulate the virtual environment. The current work not only presents a blueprint for develo** digital twins but also suggests future research directions to enhance this technology. Digital twins have the potential to transform the way we monitor and optimize physical assets, and by understanding their capabilities, we can unlock their full potential. △ Less

Submitted 27 February, 2023; v1 submitted 14 December, 2022; originally announced December 2022.

Numerical assessments of a nonintrusive surrogate model based on recurrent neural networks and proper orthogonal decomposition: Rayleigh Benard convection

Authors: Saeed Akbari, Suraj Pawar, Omer San

Abstract: Recent developments in diagnostic and computing technologies offer to leverage numerous forms of nonintrusive modeling approaches from data where machine learning can be used to build computationally cheap and accurate surrogate models. To this end, we present a nonlinear proper orthogonal decomposition (POD) framework, denoted as NLPOD, to forge a nonintrusive reduced-order model for the Boussine… ▽ More Recent developments in diagnostic and computing technologies offer to leverage numerous forms of nonintrusive modeling approaches from data where machine learning can be used to build computationally cheap and accurate surrogate models. To this end, we present a nonlinear proper orthogonal decomposition (POD) framework, denoted as NLPOD, to forge a nonintrusive reduced-order model for the Boussinesq equations. In our NLPOD approach, we first employ the POD procedure to obtain a set of global modes to build a linear-fit latent space and utilize an autoencoder network to compress the projection of this latent space through a nonlinear unsupervised map** of POD coefficients. Then, long short-term memory (LSTM) neural network architecture is utilized to discover temporal patterns in this low-rank manifold. While performing a detailed sensitivity analysis for hyperparameters of the LSTM model, the trade-off between accuracy and efficiency is systematically analyzed for solving a canonical Rayleigh-Benard convection system. △ Less

Submitted 10 December, 2022; originally announced December 2022.

An Energy-Based Lengthscale for Reduced Order Models of Turbulent Flows

Authors: Changhong Mou, Elia Merzari, Omer San, Traian Iliescu

Abstract: In this paper, we propose a novel reduced order model (ROM) lengthscale that is constructed by using energy distribution arguments. The new energy-based ROM lengthscale is fundamentally different from the current ROM lengthscales, which are built by using dimensional arguments. To assess the novel, energy-based ROM lengthscale, we compare it with a standard, dimensionality-based ROM lengthscale in… ▽ More In this paper, we propose a novel reduced order model (ROM) lengthscale that is constructed by using energy distribution arguments. The new energy-based ROM lengthscale is fundamentally different from the current ROM lengthscales, which are built by using dimensional arguments. To assess the novel, energy-based ROM lengthscale, we compare it with a standard, dimensionality-based ROM lengthscale in two fundamentally different types of models: (i) the mixing-length ROM (ML-ROM), which is a ROM closure model; and (ii) the evolve-filter-relax ROM (EFR-ROM), which is a regularized ROM. We test the four combinations (i.e., ML-ROM and EFR-ROM equipped with the energy-based and dimensionality-based lengthscales) in the numerical simulation of the turbulent channel flow at $Re_τ = 395$. The numerical investigation yields the following conclusions: (i) The new energy-based ROM lengthscale is significantly (almost two orders of magnitude) larger than the standard dimensionality-based ROM lengthscale. As a result, the energy-based lengthscale yields more stable ML-ROMs and EFR-ROMs than the dimensionality-based lengthscale. (ii) The energy-based lengthscale displays the correct asymptotic behavior with respect to the ROM dimension, whereas the dimensionality-based lengthscale does not. (iii) The energy-based lengthscale yields ML-ROMs and (when significant filtering is effected) EFR-ROMs whose parameters are less sensitive (i.e., more robust) than the parameters of the ML-ROMs and EFR-ROMs based on the dimensionality-based lengthscale. The novel energy-based lengthscale could enable the development of better scale-aware ROM strategies for flow-specific applications and is expected to have long term applications in nuclear reactor thermal-hydraulics. △ Less

Submitted 8 November, 2022; originally announced November 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2108.02254

Prospects of federated machine learning in fluid dynamics

Authors: Omer San, Suraj Pawar, Adil Rasheed

Abstract: Physics-based models have been mainstream in fluid dynamics for develo** predictive models. In recent years, machine learning has offered a renaissance to the fluid community due to the rapid developments in data science, processing units, neural network based technologies, and sensor adaptations. So far in many applications in fluid dynamics, machine learning approaches have been mostly focused… ▽ More Physics-based models have been mainstream in fluid dynamics for develo** predictive models. In recent years, machine learning has offered a renaissance to the fluid community due to the rapid developments in data science, processing units, neural network based technologies, and sensor adaptations. So far in many applications in fluid dynamics, machine learning approaches have been mostly focused on a standard process that requires centralizing the training data on a designated machine or in a data center. In this letter, we present a federated machine learning approach that enables localized clients to collaboratively learn an aggregated and shared predictive model while kee** all the training data on each edge device. We demonstrate the feasibility and prospects of such decentralized learning approach with an effort to forge a deep learning surrogate model for reconstructing spatiotemporal fields. Our results indicate that federated machine learning might be a viable tool for designing highly accurate predictive decentralized digital twins relevant to fluid dynamics. △ Less

Submitted 15 August, 2022; originally announced August 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2207.12245

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Authors: Omer San, Suraj Pawar, Adil Rasheed

Abstract: A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many tran… ▽ More A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL (MMRL) to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Decentralized digital twins of complex dynamical systems

Authors: Omer San, Suraj Pawar, Adil Rasheed

Abstract: In this paper, we introduce a decentralized digital twin (DDT) framework for dynamical systems and discuss the prospects of the DDT modeling paradigm in computational science and engineering applications. The DDT approach is built on a federated learning concept, a branch of machine learning that encourages knowledge sharing without sharing the actual data. This approach enables clients to collabo… ▽ More In this paper, we introduce a decentralized digital twin (DDT) framework for dynamical systems and discuss the prospects of the DDT modeling paradigm in computational science and engineering applications. The DDT approach is built on a federated learning concept, a branch of machine learning that encourages knowledge sharing without sharing the actual data. This approach enables clients to collaboratively learn an aggregated model while kee** all the training data on each client. We demonstrate the feasibility of the DDT framework with various dynamical systems, which are often considered prototypes for modeling complex transport phenomena in spatiotemporally extended systems. Our results indicate that federated machine learning might be a key enabler for designing highly accurate decentralized digital twins in complex nonlinear spatiotemporal systems. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Digital Twin Data Modelling by Randomized Orthogonal Decomposition and Deep Learning

Authors: Diana Alina Bistrian, Omer San, Ionel Michael Navon

Abstract: A digital twin is a surrogate model that has the main feature to mirror the original process behavior. Associating the dynamical process with a digital twin model of reduced complexity has the significant advantage to map the dynamics with high accuracy and reduced costs in CPU time and hardware to timescales over which that suffers significantly changes and so it is difficult to explore. This pap… ▽ More A digital twin is a surrogate model that has the main feature to mirror the original process behavior. Associating the dynamical process with a digital twin model of reduced complexity has the significant advantage to map the dynamics with high accuracy and reduced costs in CPU time and hardware to timescales over which that suffers significantly changes and so it is difficult to explore. This paper introduces a new framework for creating efficient digital twin models of fluid flows. We introduce a novel algorithm that combines the advantages of Krylov based dynamic mode decomposition with proper orthogonal decomposition and outperforms the selection of the most influential modes. We prove that randomized orthogonal decomposition algorithm provides several advantages over SVD empirical orthogonal decomposition methods and mitigates the projection error formulating a multiobjective optimization problem.We involve the state-of-the-art artificial intelligence Deep Learning (DL) to perform a real-time adaptive calibration of the digital twin model, with increasing fidelity. The output is a high-fidelity DIGITAL TWIN DATA MODEL of the fluid flow dynamics, with the advantage of a reduced complexity. The new modelling tools are investigated in the numerical simulation of three wave phenomena with increasing complexity. We show that the outputs are consistent with the original source data.We perform a thorough assessment of the performance of the new digital twin data models, in terms of numerical accuracy and computational efficiency, including a time simulation response feature study. △ Less

Submitted 18 March, 2024; v1 submitted 17 June, 2022; originally announced June 2022.

Comments: The material will be revised

Combining physics-based and data-driven techniques for reliable hybrid analysis and modeling using the corrective source term approach

Authors: Sindre Stenen Blakseth, Adil Rasheed, Trond Kvamsdal, Omer San

Abstract: Upcoming technologies like digital twins, autonomous, and artificial intelligent systems involving safety-critical applications require models which are accurate, interpretable, computationally efficient, and generalizable. Unfortunately, the two most commonly used modeling approaches, physics-based modeling (PBM) and data-driven modeling (DDM) fail to satisfy all these requirements. In the curren… ▽ More Upcoming technologies like digital twins, autonomous, and artificial intelligent systems involving safety-critical applications require models which are accurate, interpretable, computationally efficient, and generalizable. Unfortunately, the two most commonly used modeling approaches, physics-based modeling (PBM) and data-driven modeling (DDM) fail to satisfy all these requirements. In the current work, we demonstrate how a hybrid approach combining the best of PBM and DDM can result in models which can outperform them both. We do so by combining partial differential equations based on first principles describing partially known physics with a black box DDM, in this case, a deep neural network model compensating for the unknown physics. First, we present a mathematical argument for why this approach should work and then apply the hybrid approach to model two dimensional heat diffusion problem with an unknown source term. The result demonstrates the method's superior performance in terms of accuracy, and generalizability. Additionally, it is shown how the DDM part can be interpreted within the hybrid framework to make the overall approach reliable. △ Less

Submitted 7 June, 2022; originally announced June 2022.

Equation-free surrogate modeling of geophysical flows at the intersection of machine learning and data assimilation

Authors: Suraj Pawar, Omer San

Abstract: There is a growing interest in develo** data-driven reduced-order models for atmospheric and oceanic flows that are trained on data obtained either from high-resolution simulations or satellite observations. The data-driven models are non-intrusive in nature and offer significant computational savings compared to large-scale numerical models. These low-dimensional models can be utilized to reduc… ▽ More There is a growing interest in develo** data-driven reduced-order models for atmospheric and oceanic flows that are trained on data obtained either from high-resolution simulations or satellite observations. The data-driven models are non-intrusive in nature and offer significant computational savings compared to large-scale numerical models. These low-dimensional models can be utilized to reduce the computational burden of generating forecasts and estimating model uncertainty without losing the key information needed for data assimilation to produce accurate state estimates. This paper aims at exploring an equation-free surrogate modeling approach at the intersection of machine learning and data assimilation in Earth system modeling. With this objective, we introduce an end-to-end non-intrusive reduced-order modeling (NIROM) framework equipped with contributions in modal decomposition, time series prediction, optimal sensor placement, and sequential data assimilation. Specifically, we use proper orthogonal decomposition (POD) to identify the dominant structures of the flow, and a long short-term memory network to model the dynamics of the POD modes. The NIROM is integrated within the deterministic ensemble Kalman filter (DEnKF) to incorporate sparse and noisy observations at optimal sensor locations obtained through QR pivoting. The feasibility and the benefit of the proposed framework are demonstrated for the NOAA Optimum Interpolation Sea Surface Temperature (SST) V2 dataset. Our results indicate that the NIROM is stable for long-term forecasting and can model dynamics of SST with a reasonable level of accuracy. Furthermore, the prediction accuracy of the NIROM gets improved by one order of magnitude by the DEnKF algorithm. This work provides a way forward toward transitioning these methods to fuse information from Earth system models and observations to achieve accurate forecasts. △ Less

Submitted 26 May, 2022; originally announced May 2022.

Physics Guided Machine Learning for Variational Multiscale Reduced Order Modeling

Authors: Shady E. Ahmed, Omer San, Adil Rasheed, Traian Iliescu, Alessandro Veneziani

Abstract: We propose a new physics guided machine learning (PGML) paradigm that leverages the variational multiscale (VMS) framework and available data to dramatically increase the accuracy of reduced order models (ROMs) at a modest computational cost. The hierarchical structure of the ROM basis and the VMS framework enable a natural separation of the resolved and unresolved ROM spatial scales. Modern PGML… ▽ More We propose a new physics guided machine learning (PGML) paradigm that leverages the variational multiscale (VMS) framework and available data to dramatically increase the accuracy of reduced order models (ROMs) at a modest computational cost. The hierarchical structure of the ROM basis and the VMS framework enable a natural separation of the resolved and unresolved ROM spatial scales. Modern PGML algorithms are used to construct novel models for the interaction among the resolved and unresolved ROM scales. Specifically, the new framework builds ROM operators that are closest to the true interaction terms in the VMS framework. Finally, machine learning is used to reduce the projection error and further increase the ROM accuracy. Our numerical experiments for a two-dimensional vorticity transport problem show that the novel PGML-VMS-ROM paradigm maintains the low computational cost of current ROMs, while significantly increasing the ROM accuracy. △ Less

Submitted 24 May, 2022; originally announced May 2022.

Physics guided neural networks for modelling of non-linear dynamics

Authors: Haakon Robinson, Suraj Pawar, Adil Rasheed, Omer San

Abstract: The success of the current wave of artificial intelligence can be partly attributed to deep neural networks, which have proven to be very effective in learning complex patterns from large datasets with minimal human intervention. However, it is difficult to train these models on complex dynamical systems from data alone due to their low data efficiency and sensitivity to hyperparameters and initia… ▽ More The success of the current wave of artificial intelligence can be partly attributed to deep neural networks, which have proven to be very effective in learning complex patterns from large datasets with minimal human intervention. However, it is difficult to train these models on complex dynamical systems from data alone due to their low data efficiency and sensitivity to hyperparameters and initialisation. This work demonstrates that injection of partially known information at an intermediate layer in a DNN can improve model accuracy, reduce model uncertainty, and yield improved convergence during the training. The value of these physics-guided neural networks has been demonstrated by learning the dynamics of a wide variety of nonlinear dynamical systems represented by five well-known equations in nonlinear systems theory: the Lotka-Volterra, Duffing, Van der Pol, Lorenz, and Henon-Heiles systems. △ Less

Submitted 13 May, 2022; originally announced May 2022.

Reduced Order Model Closures: A Brief Tutorial

Authors: William Snyder, Changhong Mou, Honghu Liu, Omer San, Raffaella De Vita, Traian Iliescu

Abstract: In this paper, we present a brief tutorial on reduced order model (ROM) closures. First, we carefully motivate the need for ROM closure modeling in under-resolved simulations. Then, we construct step by step the ROM closure model by extending the classical Galerkin framework to the spaces of resolved and unresolved scales. Finally, we develop the data-driven variational multiscale ROM closure and… ▽ More In this paper, we present a brief tutorial on reduced order model (ROM) closures. First, we carefully motivate the need for ROM closure modeling in under-resolved simulations. Then, we construct step by step the ROM closure model by extending the classical Galerkin framework to the spaces of resolved and unresolved scales. Finally, we develop the data-driven variational multiscale ROM closure and then we test it in fluid flow simulations. Our tutorial on ROM closures is structured as a sequence of questions and answers, and is aimed at first year graduate students and advanced undergraduate students. Our goal is not to explain the "how," but the "why." That is, we carefully explain the principles used to develop ROM closures, without focusing on particular approaches. Furthermore, we try to keep the technical details to a minimum and describe the general ideas in broad terms while citing appropriate references for details. △ Less

Submitted 28 February, 2022; originally announced February 2022.

Sketching Methods for Dynamic Mode Decomposition in Spherical Shallow Water Equations

Authors: Shady E. Ahmed, Omer San, Diana A. Bistrian, Ionel M. Navon

Abstract: Dynamic mode decomposition (DMD) is an emerging methodology that has recently attracted computational scientists working on nonintrusive reduced order modeling. One of the major strengths that DMD possesses is having ground theoretical roots from the Koopman approximation theory. Indeed, DMD may be viewed as the data-driven realization of the famous Koopman operator. Nonetheless, the stable implem… ▽ More Dynamic mode decomposition (DMD) is an emerging methodology that has recently attracted computational scientists working on nonintrusive reduced order modeling. One of the major strengths that DMD possesses is having ground theoretical roots from the Koopman approximation theory. Indeed, DMD may be viewed as the data-driven realization of the famous Koopman operator. Nonetheless, the stable implementation of DMD incurs computing the singular value decomposition of the input data matrix. This, in turn, makes the process computationally demanding for high dimensional systems. In order to alleviate this burden, we develop a framework based on sketching methods, wherein a sketch of a matrix is simply another matrix which is significantly smaller, but still sufficiently approximates the original system. Such sketching or embedding is performed by applying random transformations, with certain properties, on the input matrix to yield a compressed version of the initial system. Hence, many of the expensive computations can be carried out on the smaller matrix, thereby accelerating the solution of the original problem. We conduct numerical experiments conducted using the spherical shallow water equations as a prototypical model in the context of geophysical flows. The performance of several sketching approaches is evaluated for capturing the range and co-range of the data matrix. The proposed sketching-based framework can accelerate various portions of the DMD algorithm, compared to classical methods that operate directly on the raw input data. This eventually leads to substantial computational gains that are vital for digital twinning of high dimensional systems. △ Less

Submitted 11 January, 2022; originally announced January 2022.

Journal ref: AIAA SciTech 2022 Forum

Frame invariant neural network closures for Kraichnan turbulence

Authors: Suraj Pawar, Omer San, Adil Rasheed, Prakash Vedula

Abstract: Numerical simulations of geophysical and atmospheric flows have to rely on parameterizations of subgrid scale processes due to their limited spatial resolution. Despite substantial progress in develo** parameterization (or closure) models for subgrid scale (SGS) processes using physical insights and mathematical approximations, they remain imperfect and can lead to inaccurate predictions. In rec… ▽ More Numerical simulations of geophysical and atmospheric flows have to rely on parameterizations of subgrid scale processes due to their limited spatial resolution. Despite substantial progress in develo** parameterization (or closure) models for subgrid scale (SGS) processes using physical insights and mathematical approximations, they remain imperfect and can lead to inaccurate predictions. In recent years, machine learning has been successful in extracting complex patterns from high-resolution spatio-temporal data, leading to improved parameterization models, and ultimately better coarse grid prediction. However, the inability to satisfy known physics and poor generalization hinders the application of these models for real-world problems. In this work, we propose a frame invariant closure approach to improve the accuracy and generalizability of deep learning-based subgrid scale closure models by embedding physical symmetries directly into the structure of the neural network. Specifically, we utilized specialized layers within the convolutional neural network in such a way that desired constraints are theoretically guaranteed without the need for any regularization terms. We demonstrate our framework for a two-dimensional decaying turbulence test case mostly characterized by the forward enstrophy cascade. We show that our frame invariant SGS model (i) accurately predicts the subgrid scale source term, (ii) respects the physical symmetries such as translation, Galilean, and rotation invariance, and (iii) is numerically stable when implemented in coarse-grid simulation with generalization to different initial conditions and Reynolds number. This work builds a bridge between extensive physics-based theories and data-driven modeling paradigms, and thus represents a promising step towards the development of physically consistent data-driven turbulence closure models. △ Less

Submitted 9 January, 2022; originally announced January 2022.

Hyperparameter Search using Genetic Algorithm for Surrogate Modeling of Geophysical Flows

Authors: Suraj Pawar, Omer San, Gary G. Yen

Abstract: The computational models for geophysical flows are computationally very expensive to employ in multi-query tasks such as data assimilation, uncertainty quantification, and hence surrogate models sought to alleviate the computational burden associated with these full order models. Researchers have started applying machine learning algorithms, particularly neural networks, to build data-driven surro… ▽ More The computational models for geophysical flows are computationally very expensive to employ in multi-query tasks such as data assimilation, uncertainty quantification, and hence surrogate models sought to alleviate the computational burden associated with these full order models. Researchers have started applying machine learning algorithms, particularly neural networks, to build data-driven surrogate models for geophysical flows. The performance of the neural network highly relies upon its architecture design and selection of other hyperparameters. These neural networks are usually manually designed through trial and error to maximize their performance. This often requires domain knowledge of the neural network as well as the problems of interest. This limitation can be addressed by using an evolutionary algorithm to automatically design architecture and select optimal hyperparameters of the neural network. In this paper, we apply the genetic algorithm to effectively design the long short-term memory (LSTM) neural network to build the non-intrusive reduced order model of the sea-surface temperature field. △ Less

Submitted 7 January, 2022; originally announced January 2022.

Risk-based implementation of COLREGs for autonomous surface vehicles using deep reinforcement learning

Authors: Thomas Nakken Larsen, Amalie Heiberg, Eivind Meyer, Adil Rasheeda, Omer San, Damiano Varagnolo

Abstract: Autonomous systems are becoming ubiquitous and gaining momentum within the marine sector. Since the electrification of transport is happening simultaneously, autonomous marine vessels can reduce environmental impact, lower costs, and increase efficiency. Although close monitoring is still required to ensure safety, the ultimate goal is full autonomy. One major milestone is to develop a control sys… ▽ More Autonomous systems are becoming ubiquitous and gaining momentum within the marine sector. Since the electrification of transport is happening simultaneously, autonomous marine vessels can reduce environmental impact, lower costs, and increase efficiency. Although close monitoring is still required to ensure safety, the ultimate goal is full autonomy. One major milestone is to develop a control system that is versatile enough to handle any weather and encounter that is also robust and reliable. Additionally, the control system must adhere to the International Regulations for Preventing Collisions at Sea (COLREGs) for successful interaction with human sailors. Since the COLREGs were written for the human mind to interpret, they are written in ambiguous prose and therefore not machine-readable or verifiable. Due to these challenges and the wide variety of situations to be tackled, classical model-based approaches prove complicated to implement and computationally heavy. Within machine learning (ML), deep reinforcement learning (DRL) has shown great potential for a wide range of applications. The model-free and self-learning properties of DRL make it a promising candidate for autonomous vessels. In this work, a subset of the COLREGs is incorporated into a DRL-based path following and obstacle avoidance system using collision risk theory. The resulting autonomous agent dynamically interpolates between path following and COLREG-compliant collision avoidance in the training scenario, isolated encounter situations, and AIS-based simulations of real-world scenarios. △ Less

Submitted 30 November, 2021; originally announced December 2021.

Nonlinear proper orthogonal decomposition for convection-dominated flows

Authors: Shady E. Ahmed, Omer San, Adil Rasheed, Traian Iliescu

Abstract: Autoencoder techniques find increasingly common use in reduced order modeling as a means to create a latent space. This reduced order representation offers a modular data-driven modeling approach for nonlinear dynamical systems when integrated with a time series predictive model. In this letter, we put forth a nonlinear proper orthogonal decomposition (POD) framework, which is an end-to-end Galerk… ▽ More Autoencoder techniques find increasingly common use in reduced order modeling as a means to create a latent space. This reduced order representation offers a modular data-driven modeling approach for nonlinear dynamical systems when integrated with a time series predictive model. In this letter, we put forth a nonlinear proper orthogonal decomposition (POD) framework, which is an end-to-end Galerkin-free model combining autoencoders with long short-term memory networks for dynamics. By eliminating the projection error due to the truncation of Galerkin models, a key enabler of the proposed nonintrusive approach is the kinematic construction of a nonlinear map** between the full-rank expansion of the POD coefficients and the latent space where the dynamics evolve. We test our framework for model reduction of a convection-dominated system, which is generally challenging for reduced order models. Our approach not only improves the accuracy, but also significantly reduces the computational cost of training and testing. △ Less

Submitted 5 November, 2021; v1 submitted 15 October, 2021; originally announced October 2021.

Multi-fidelity information fusion with concatenated neural networks

Authors: Suraj Pawar, Omer San, Prakash Vedula, Adil Rasheed, Trond Kvamsdal

Abstract: Recently, computational modeling has shifted towards the use of deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by lowering the computational burden, training deep learning models needs a huge amount of data. This big data is not always available for scientific problems and l… ▽ More Recently, computational modeling has shifted towards the use of deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by lowering the computational burden, training deep learning models needs a huge amount of data. This big data is not always available for scientific problems and leads to poorly generalizable data-driven models. This gap can be furnished by leveraging information from physics-based models. Exploiting prior knowledge about the problem at hand, this study puts forth a concatenated neural network approach to build more tailored, effective, and efficient machine learning models. For our analysis, without losing its generalizability and modularity, we focus on the development of predictive models for laminar and turbulent boundary layer flows. In particular, we combine the self-similarity solution and power-law velocity profile (low-fidelity models) with the noisy data obtained either from experiments or computational fluid dynamics simulations (high-fidelity models) through a concatenated neural network. We illustrate how the knowledge from these simplified models results in reducing uncertainties associated with deep learning models. The proposed framework produces physically consistent models that attempt to achieve better generalization than data-driven models obtained purely based on data. While we demonstrate our framework for a problem relevant to fluid mechanics, its workflow and principles can be adopted for many scientific problems where empirical models are prevalent. In line with grand demands in novel physics-guided machine learning principles, this work builds a bridge between extensive physics-based theories and data-driven modeling paradigms and paves the way for using hybrid modeling approaches for next-generation digital twin technologies. △ Less

Submitted 8 October, 2021; originally announced October 2021.

A Numerical Investigation of the Lengthscale in the Mixing-Length Reduced Order Model of the Turbulent Channel Flow

Authors: Changhong Mou, Elia Merzari, Omer San, Traian Iliescu

Abstract: In this paper, we propose a novel reduced order model (ROM) lengthscale definition that is based on energy distribution arguments. This novel ROM lengthscale is fundamentally different from the current ROM lengthscales, which are generally based on dimensional arguments. As a first step in the assessment of the new, energy based ROM lengthscale, we compare it with a standard, dimensional based ROM… ▽ More In this paper, we propose a novel reduced order model (ROM) lengthscale definition that is based on energy distribution arguments. This novel ROM lengthscale is fundamentally different from the current ROM lengthscales, which are generally based on dimensional arguments. As a first step in the assessment of the new, energy based ROM lengthscale, we compare it with a standard, dimensional based ROM lengthscale in the mixing-length ROM (ML-ROM) simulation of the turbulent channel flow at $Re_τ = 395$. The numerical investigation shows that the energy based ROM lengthscale yields a significantly more stable ML-ROM than the dimensional based ROM lengthscale. The new energy based lengthscale definition could allow the development of scale-aware reduced order modeling strategies that are better suited for flow-specific applications. △ Less

Submitted 4 August, 2021; originally announced August 2021.

On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues

Authors: Shady E. Ahmed, Suraj Pawar, Omer San, Adil Rasheed, Traian Iliescu, Bernd R. Noack

Abstract: For over a century, reduced order models (ROMs) have been a fundamental discipline of theoretical fluid mechanics. Early examples include Galerkin models inspired by the Orr-Sommerfeld stability equation and numerous vortex models, of which the von Kármán vortex street is one of the most prominent. Subsequent ROMs typically relied on first principles, like mathematical Galerkin models, weakly nonl… ▽ More For over a century, reduced order models (ROMs) have been a fundamental discipline of theoretical fluid mechanics. Early examples include Galerkin models inspired by the Orr-Sommerfeld stability equation and numerous vortex models, of which the von Kármán vortex street is one of the most prominent. Subsequent ROMs typically relied on first principles, like mathematical Galerkin models, weakly nonlinear stability theory, and two- and three-dimensional vortex models. Aubry et al. [N. Aubry, P. Holmes, J. Lumley, and E. Stone, Journal of Fluid Mechanics, 192, 115-173 (1988)] pioneered data-driven proper orthogonal decomposition (POD) modeling. In early POD modeling, available data was used to build an optimal basis, which was then utilized in a classical Galerkin procedure to construct the ROM. But data has made a profound impact on ROMs beyond the Galerkin expansion. In this paper, we take a modest step and illustrate the impact of data-driven modeling on one significant ROM area. Specifically, we focus on ROM closures, which are correction terms that are added to classical ROMs in order to model the effect of the discarded ROM modes in under-resolved simulations. Through simple examples, we illustrate the main modeling principles used to construct classical ROMs, motivate and introduce modern ROM closures, and show how data-driven modeling, artificial intelligence, and machine learning have changed the standard ROM methodology over the last two decades. Finally, we outline our vision on how state-of-the-art data-driven modeling can continue to reshape the field of reduced order modeling. △ Less

Submitted 23 August, 2021; v1 submitted 28 June, 2021; originally announced June 2021.

Deep neural network enabled corrective source term approach to hybrid analysis and modeling

Authors: Sindre Stenen Blakseth, Adil Rasheed, Trond Kvamsdal, Omer San

Abstract: In this work, we introduce, justify and demonstrate the Corrective Source Term Approach (CoSTA) -- a novel approach to Hybrid Analysis and Modeling (HAM). The objective of HAM is to combine physics-based modeling (PBM) and data-driven modeling (DDM) to create generalizable, trustworthy, accurate, computationally efficient and self-evolving models. CoSTA achieves this objective by augmenting the go… ▽ More In this work, we introduce, justify and demonstrate the Corrective Source Term Approach (CoSTA) -- a novel approach to Hybrid Analysis and Modeling (HAM). The objective of HAM is to combine physics-based modeling (PBM) and data-driven modeling (DDM) to create generalizable, trustworthy, accurate, computationally efficient and self-evolving models. CoSTA achieves this objective by augmenting the governing equation of a PBM model with a corrective source term generated using a deep neural network. In a series of numerical experiments on one-dimensional heat diffusion, CoSTA is found to outperform comparable DDM and PBM models in terms of accuracy -- often reducing predictive errors by several orders of magnitude -- while also generalizing better than pure DDM. Due to its flexible but solid theoretical foundation, CoSTA provides a modular framework for leveraging novel developments within both PBM and DDM. Its theoretical foundation also ensures that CoSTA can be used to model any system governed by (deterministic) partial differential equations. Moreover, CoSTA facilitates interpretation of the DNN-generated source term within the context of PBM, which results in improved explainability of the DNN. These factors make CoSTA a potential door-opener for data-driven techniques to enter high-stakes applications previously reserved for pure PBM. △ Less

Submitted 30 November, 2021; v1 submitted 24 May, 2021; originally announced May 2021.

Model fusion with physics-guided machine learning

Authors: Suraj Pawar, Omer San, Aditya Nair, Adil Rasheed, Trond Kvamsdal

Abstract: The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatio-temporal scales have enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their genera… ▽ More The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatio-temporal scales have enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their generalizability. This is particularly essential when data-driven models are employed within outer-loop applications like optimization. In this work, we put forth a physics-guided machine learning (PGML) framework that leverages the interpretable physics-based model with a deep learning model. The PGML framework is capable of enhancing the generalizability of data-driven models and effectively protect against or inform about the inaccurate predictions resulting from extrapolation. We apply the PGML framework as a novel model fusion approach combining the physics-based Galerkin projection model and long-short term memory (LSTM) network for parametric model order reduction of fluid flows. We demonstrate the improved generalizability of the PGML framework against a purely data-driven approach through the injection of physics features into intermediate LSTM layers. Our quantitative analysis shows that the overall model uncertainty can be reduced through the PGML approach especially for test data coming from a distribution different than the training data. Moreover, we demonstrate that our approach can be used as an inverse diagnostic tool providing a confidence score associated with models and observations. The proposed framework also allows for multi-fidelity computing by making use of low-fidelity models in the online deployment of quantified data-driven models. △ Less

Submitted 9 April, 2021; originally announced April 2021.

A nonintrusive hybrid neural-physics modeling of incomplete dynamical systems: Lorenz equations

Authors: Suraj Pawar, Omer San, Adil Rasheed, Ionel M. Navon

Abstract: This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of dynamics of some variables is unknown, but reasonably accurate observational data can be obtained for the evolution of the state of the system. In this work, we prop… ▽ More This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of dynamics of some variables is unknown, but reasonably accurate observational data can be obtained for the evolution of the state of the system. In this work, we propose machine learning to account for missing physics and then data assimilation to correct the prediction. In particular, we devise an effective methodology based on a recurrent neural network to model the unknown dynamics. A long short-term memory (LSTM) based correction term is added to the predictive model in order to take into account hidden physics. Since LSTM introduces a black-box approach for the unknown part of the model, we investigate whether the proposed hybrid neural-physical model can be further corrected through a sequential data assimilation step. We apply this framework to the weakly nonlinear Lorenz model that displays quasiperiodic oscillations, the highly nonlinear Lorenz model, and two-scale Lorenz model. The hybrid neural-physics model yields accurate results for the weakly nonlinear Lorenz model with the predicted state close to the true Lorenz model trajectory. For the highly nonlinear Lorenz model and the two-scale Lorenz model, the hybrid neural-physics model deviates from the true state due to the accumulation of prediction error from one time step to the next time step. The ensemble Kalman filter approach takes into account the prediction error and updates the diverged prediction using available observations in order to provide a more accurate state estimate. The successful synergistic integration of neural network and data assimilation for low-dimensional system shows the potential benefits of the proposed hybrid-neural physics model for complex systems. △ Less

Submitted 13 August, 2021; v1 submitted 31 March, 2021; originally announced April 2021.

Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution

Authors: Omer San, Adil Rasheed, Trond Kvamsdal

Abstract: Most modeling approaches lie in either of the two categories: physics-based or data-driven. Recently, a third approach which is a combination of these deterministic and statistical models is emerging for scientific applications. To leverage these developments, our aim in this perspective paper is centered around exploring numerous principle concepts to address the challenges of (i) trustworthiness… ▽ More Most modeling approaches lie in either of the two categories: physics-based or data-driven. Recently, a third approach which is a combination of these deterministic and statistical models is emerging for scientific applications. To leverage these developments, our aim in this perspective paper is centered around exploring numerous principle concepts to address the challenges of (i) trustworthiness and generalizability in develo** data-driven models to shed light on understanding the fundamental trade-offs in their accuracy and efficiency, and (ii) seamless integration of interface learning and multifidelity coupling approaches that transfer and represent information between different entities, particularly when different scales are governed by different physics, each operating on a different level of abstraction. Addressing these challenges could enable the revolution of digital twin technologies for scientific and engineering applications. △ Less

Submitted 26 March, 2021; originally announced March 2021.

Geometric Change Detection in Digital Twins using 3D Machine Learning

Authors: Tiril Sundby, Julia Maria Graham, Adil Rasheed, Mandar Tabib, Omer San

Abstract: Digital twins are meant to bridge the gap between real-world physical systems and virtual representations. Both stand-alone and descriptive digital twins incorporate 3D geometric models, which are the physical representations of objects in the digital replica. Digital twin applications are required to rapidly update internal parameters with the evolution of their physical counterpart. Due to an es… ▽ More Digital twins are meant to bridge the gap between real-world physical systems and virtual representations. Both stand-alone and descriptive digital twins incorporate 3D geometric models, which are the physical representations of objects in the digital replica. Digital twin applications are required to rapidly update internal parameters with the evolution of their physical counterpart. Due to an essential need for having high-quality geometric models for accurate physical representations, the storage and bandwidth requirements for storing 3D model information can quickly exceed the available storage and bandwidth capacity. In this work, we demonstrate a novel approach to geometric change detection in the context of a digital twin. We address the issue through a combined solution of Dynamic Mode Decomposition (DMD) for motion detection, YOLOv5 for object detection, and 3D machine learning for pose estimation. DMD is applied for background subtraction, enabling detection of moving foreground objects in real-time. The video frames containing detected motion are extracted and used as input to the change detection network. The object detection algorithm YOLOv5 is applied to extract the bounding boxes of detected objects in the video frames. Furthermore, the rotational pose of each object is estimated in a 3D pose estimation network. A series of convolutional neural networks conducts feature extraction from images and 3D model shapes. Then, the network outputs the estimated Euler angles of the camera orientation with respect to the object in the input image. By only storing data associated with a detected change in pose, we minimize necessary storage and bandwidth requirements while still being able to recreate the 3D scene on demand. △ Less

Submitted 15 March, 2021; originally announced March 2021.

Forward sensitivity analysis of the FitzHugh-Nagumo system: Parameter estimation

Authors: Shady E. Ahmed, Omer San, Sivaramakrishnan Lakshmivarahan

Abstract: The FitzHugh-Nagumo (FHN) model, from computational neuroscience, has attracted attention in nonlinear dynamics studies as it describes the behavior of excitable systems and exhibits interesting bifurcation properties. The accurate estimation of the model parameters is vital to understand how the solution trajectory evolves in time. To this end, we provide a forward sensitivity method (FSM) approa… ▽ More The FitzHugh-Nagumo (FHN) model, from computational neuroscience, has attracted attention in nonlinear dynamics studies as it describes the behavior of excitable systems and exhibits interesting bifurcation properties. The accurate estimation of the model parameters is vital to understand how the solution trajectory evolves in time. To this end, we provide a forward sensitivity method (FSM) approach to quantify the main model parameters using sparse measurement data. FSM constitutes a variational data assimilation technique which integrates model sensitivities into the process of fitting the model to the observations. We analyse the applicability of FSM to update the FHN model parameters and predict its dynamical characteristics. Furthermore, we highlight a few guidelines for observations placement to control the shape of the cost functional and improve the parameter inference iterations. △ Less

Submitted 5 February, 2021; originally announced February 2021.

Hybrid analysis and modeling for next generation of digital twins

Authors: Suraj Pawar, Shady E. Ahmed, Omer San, Adil Rasheed

Abstract: The physics-based modeling has been the workhorse for many decades in many scientific and engineering applications ranging from wind power, weather forecasting, and aircraft design. Recently, data-driven models are increasingly becoming popular in many branches of science and engineering due to their non-intrusive nature and online learning capability. Despite the robust performance of data-driven… ▽ More The physics-based modeling has been the workhorse for many decades in many scientific and engineering applications ranging from wind power, weather forecasting, and aircraft design. Recently, data-driven models are increasingly becoming popular in many branches of science and engineering due to their non-intrusive nature and online learning capability. Despite the robust performance of data-driven models, they are faced with challenges of poor generalizability and difficulty in interpretation. These challenges have encouraged the integration of physics-based models with data-driven models, herein denoted hybrid analysis and modeling (HAM). We propose two different frameworks under the HAM paradigm for applications relevant to wind energy in order to bring the physical realism within emerging digital twin technologies. The physics-guided machine learning (PGML) framework reduces the uncertainty of neural network predictions by embedding physics-based features from a simplified model at intermediate layers and its performance is demonstrated for the aerodynamic force prediction task. Our results show that the proposed PGML framework achieves approximately 75\% reduction in uncertainty for smaller angle of attacks. The interface learning (IL) framework illustrates how different solvers can be coupled to produce a multi-fidelity model and is successfully applied for the Boussinesq equations that govern a broad class of transport processes. The IL approach paves the way for seamless integration of multi-scale, multi-physics and multi-fidelity models (M^3 models). △ Less

Submitted 14 January, 2021; originally announced January 2021.

Comments: arXiv admin note: text overlap with arXiv:2012.13343

Physics guided machine learning using simplified theories

Authors: Suraj Pawar, Omer San, Burak Aksoylu, Adil Rasheed, Trond Kvamsdal

Abstract: Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences. In this letter, we introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines. The chief idea in our approach is to augment the knowledge of the simplif… ▽ More Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences. In this letter, we introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines. The chief idea in our approach is to augment the knowledge of the simplified theories with the underlying learning process. To emphasise on their physical importance, our architecture consists of adding certain features at intermediate layers rather than in the input layer. To demonstrate our approach, we select a canonical airfoil aerodynamic problem with the enhancement of the potential flow theory. We include features obtained by a panel method that can be computed efficiently for an unseen configuration in our training procedure. By addressing the generalizability concerns, our results suggest that the proposed feature enhancement approach can be effectively used in many scientific machine learning applications, especially for the systems where we can use a theoretical, empirical, or simplified model to guide the learning module. △ Less

Submitted 18 December, 2020; originally announced December 2020.

On the effectiveness of signal decomposition, feature extraction and selection on lung sound classification

Authors: Andrine Elsetrønning, Adil Rasheed, Jon Bekker, Omer San

Abstract: Lung sounds refer to the sound generated by air moving through the respiratory system. These sounds, as most biomedical signals, are non-linear and non-stationary. A vital part of using the lung sound for disease detection is discrimination between normal lung sound and abnormal lung sound. In this paper, several approaches for classifying between no-crackle and crackle lung sounds are explored. D… ▽ More Lung sounds refer to the sound generated by air moving through the respiratory system. These sounds, as most biomedical signals, are non-linear and non-stationary. A vital part of using the lung sound for disease detection is discrimination between normal lung sound and abnormal lung sound. In this paper, several approaches for classifying between no-crackle and crackle lung sounds are explored. Decomposition methods such as Empirical Mode Decomposition, Ensemble Empirical Mode Decomposition, and Discrete Wavelet Transform are used along with several feature extraction techniques like Principal Component Analysis and Autoencoder, to explore how various classifiers perform for the given task. An open-source dataset downloaded from Kaggle, containing chest auscultation of varying quality is used to determine the results of using the different decomposition and feature extraction combinations. It is found that when higher-order statistical and spectral features along with the Mel-frequency cepstral coefficients are fed to the classier we get the best performance with the kNN classifier giving the best accuracy. Furthermore, it is also demonstrated that using a combination of feature selection methods one can significantly reduce the number of input features without adversely affecting the accuracy of the classifiers. △ Less

Submitted 21 December, 2020; originally announced December 2020.

Interface learning in fluid dynamics: statistical inference of closures within micro-macro coupling models

Authors: Suraj Pawar, Shady E. Ahmed, Omer San

Abstract: Many complex multiphysics systems in fluid dynamics involve using solvers with varied levels of approximations in different regions of the computational domain to resolve multiple spatiotemporal scales present in the flow. The accuracy of the solution is governed by how the information is exchanged between these solvers at the interface and several methods have been devised for such coupling probl… ▽ More Many complex multiphysics systems in fluid dynamics involve using solvers with varied levels of approximations in different regions of the computational domain to resolve multiple spatiotemporal scales present in the flow. The accuracy of the solution is governed by how the information is exchanged between these solvers at the interface and several methods have been devised for such coupling problems. In this article, we construct a data-driven model by spatially coupling a microscale lattice Boltzmann method (LBM) solver and macroscale finite difference method (FDM) solver for reaction-diffusion systems. The coupling between the micro-macro solvers has one to many map** at the interface leading to the interface closure problem, and we propose a statistical inference method based on neural networks to learn this closure relation. The performance of the proposed framework in a bifidelity setting partitioned between the FDM and LBM domain shows its promise for complex systems where analytical relations between micro-macro solvers are not available. △ Less

Submitted 10 August, 2020; originally announced August 2020.

A nudged hybrid analysis and modeling approach for realtime wake-vortex transport and decay prediction

Authors: Shady Ahmed, Suraj Pawar, Omer San, Adil Rasheed, Mandar Tabib

Abstract: We put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements for air traffic improvements. Toward emerging applications of digital twins in aviation, the proposed approach allows for constructing a realtime predictive tool for wake-vortex transport and decay systems. We build on the fact that in realis… ▽ More We put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements for air traffic improvements. Toward emerging applications of digital twins in aviation, the proposed approach allows for constructing a realtime predictive tool for wake-vortex transport and decay systems. We build on the fact that in realistic application, there are uncertainties in initial and boundary conditions, model parameters, as well as measurements. Moreover, conventional nonlinear ROMs based on Galerkin projection (GROMs) suffer from imperfection and solution instabilities, especially for advection-dominated flows with slow decay in the Kolmogorov width. In the presented LSTM nudging (LSTM-N) approach, we fuse forecasts from a combination of imperfect GROM and uncertain state estimates, with sparse Eulerian sensor measurements to provide more reliable predictions in a dynamical data assimilation framework. We illustrate our concept by solving a two-dimensional vorticity transport equation. We investigate the effects of measurements noise and state estimate uncertainty on the performance of the LSTM-N behavior. We also demonstrate that it can sufficiently handle different levels of temporal and spatial measurement sparsity, and offer a huge potential in develo** next-generation digital twin technologies. △ Less

Submitted 5 March, 2021; v1 submitted 5 August, 2020; originally announced August 2020.

Comments: arXiv admin note: substantial text overlap with arXiv:2005.14246

Multifidelity Computing for Coupling Full and Reduced Order Models

Authors: Shady E. Ahmed, Omer San, Kursat Kara, Rami Younis, Adil Rasheed

Abstract: Hybrid physics-machine learning models are increasingly being used in simulations of transport processes. Many complex multiphysics systems relevant to scientific and engineering applications include multiple spatiotemporal scales and comprise a multifidelity problem sharing an interface between various formulations or heterogeneous computational entities. To this end, we present a robust hybrid a… ▽ More Hybrid physics-machine learning models are increasingly being used in simulations of transport processes. Many complex multiphysics systems relevant to scientific and engineering applications include multiple spatiotemporal scales and comprise a multifidelity problem sharing an interface between various formulations or heterogeneous computational entities. To this end, we present a robust hybrid analysis and modeling approach combining a physics-based full order model (FOM) and a data-driven reduced order model (ROM) to form the building blocks of an integrated approach among mixed fidelity descriptions toward predictive digital twin technologies. At the interface, we introduce a long short-term memory network to bridge these high and low-fidelity models in various forms of interfacial error correction or prolongation. The proposed interface learning approaches are tested as a new way to address ROM-FOM coupling problems solving nonlinear advection-diffusion flow situations with a bifidelity setup that captures the essence of a broad class of transport processes. △ Less

Submitted 12 February, 2021; v1 submitted 13 July, 2020; originally announced July 2020.

Interface learning of multiphysics and multiscale systems

Authors: Shady E. Ahmed, Omer San, Kursat Kara, Rami Younis, Adil Rasheed

Abstract: Complex natural or engineered systems comprise multiple characteristic scales, multiple spatiotemporal domains, and even multiple physical closure laws. To address such challenges, we introduce an interface learning paradigm and put forth a data-driven closure approach based on memory embedding to provide physically correct boundary conditions at the interface. To enable the interface learning for… ▽ More Complex natural or engineered systems comprise multiple characteristic scales, multiple spatiotemporal domains, and even multiple physical closure laws. To address such challenges, we introduce an interface learning paradigm and put forth a data-driven closure approach based on memory embedding to provide physically correct boundary conditions at the interface. To enable the interface learning for hyperbolic systems by considering the domain of influence and wave structures into account, we put forth the concept of upwind learning towards a physics-informed domain decomposition. The promise of the proposed approach is shown for a set of canonical illustrative problems. We highlight that high-performance computing environments can benefit from this methodology to reduce communication costs among processing units in emerging machine learning ready heterogeneous platforms toward exascale era. △ Less

Submitted 31 October, 2020; v1 submitted 17 June, 2020; originally announced June 2020.

Journal ref: Phys. Rev. E 102, 053304 (2020)

Deep Reinforcement Learning Controller for 3D Path-following and Collision Avoidance by Autonomous Underwater Vehicles

Authors: Simen Theie Havenstrøm, Adil Rasheed, Omer San

Abstract: Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the physical system. However, in complex systems, such as autonomous underwater vehicles performing the dual objective of path-following and collision avoidance, d… ▽ More Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the physical system. However, in complex systems, such as autonomous underwater vehicles performing the dual objective of path-following and collision avoidance, decision making becomes non-trivial. We propose a solution using state-of-the-art Deep Reinforcement Learning (DRL) techniques, to develop autonomous agents capable of achieving this hybrid objective without having à priori knowledge about the goal or the environment. Our results demonstrate the viability of DRL in path-following and avoiding collisions toward achieving human-level decision making in autonomous vehicle systems within extreme obstacle configurations. △ Less

Submitted 17 June, 2020; originally announced June 2020.

COLREG-Compliant Collision Avoidance for Unmanned Surface Vehicle using Deep Reinforcement Learning

Authors: Eivind Meyer, Amalie Heiberg, Adil Rasheed, Omer San

Abstract: Path Following and Collision Avoidance, be it for unmanned surface vessels or other autonomous vehicles, are two fundamental guidance problems in robotics. For many decades, they have been subject to academic study, leading to a vast number of proposed approaches. However, they have mostly been treated as separate problems, and have typically relied on non-linear first-principles models with param… ▽ More Path Following and Collision Avoidance, be it for unmanned surface vessels or other autonomous vehicles, are two fundamental guidance problems in robotics. For many decades, they have been subject to academic study, leading to a vast number of proposed approaches. However, they have mostly been treated as separate problems, and have typically relied on non-linear first-principles models with parameters that can only be determined experimentally. The rise of Deep Reinforcement Learning (DRL) in recent years suggests an alternative approach: end-to-end learning of the optimal guidance policy from scratch by means of a trial-and-error based approach. In this article, we explore the potential of Proximal Policy Optimization (PPO), a DRL algorithm with demonstrated state-of-the-art performance on Continuous Control tasks, when applied to the dual-objective problem of controlling an underactuated Autonomous Surface Vehicle in a COLREGs compliant manner such that it follows an a priori known desired path while avoiding collisions with other vessels along the way. Based on high-fidelity elevation and AIS tracking data from the Trondheim Fjord, an inlet of the Norwegian sea, we evaluate the trained agent's performance in challenging, dynamic real-world scenarios where the ultimate success of the agent rests upon its ability to navigate non-uniform marine terrain while handling challenging, but realistic vessel encounters. △ Less

Submitted 16 June, 2020; originally announced June 2020.

Data assimilation empowered neural network parameterizations for subgrid processes in geophysical flows

Authors: Suraj Pawar, Omer San

Abstract: In the past couple of years, there is a proliferation in the use of machine learning approaches to represent subgrid scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical simulations of these flows. Despite its success for different types of flow, the online deployment of a data-driven closure model can cause instabilities and biases in… ▽ More In the past couple of years, there is a proliferation in the use of machine learning approaches to represent subgrid scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical simulations of these flows. Despite its success for different types of flow, the online deployment of a data-driven closure model can cause instabilities and biases in modeling the overall effect of subgrid scale processes, which in turn leads to inaccurate prediction. To tackle this issue, we exploit the data assimilation technique to correct the physics-based model coupled with the neural network as a surrogate for unresolved flow dynamics in multiscale systems. In particular, we use a set of neural network architectures to learn the correlation between resolved flow variables and the parameterizations of unresolved flow dynamics and formulate a data assimilation approach to correct the hybrid model during their online deployment. We illustrate our framework in a set of applications of the multiscale Lorenz 96 system for which the parameterization model for unresolved scales is exactly known, and the two-dimensional Kraichnan turbulence system for which the parameterization model for unresolved scales is not known a priori. Our analysis, therefore, comprises a predictive dynamical core empowered by (i) a data-driven closure model for subgrid scale processes, (ii) a data assimilation approach for forecast error correction, and (iii) both data-driven closure and data assimilation procedures. We show significant improvement in the long-term prediction of the underlying chaotic dynamics with our framework compared to using only neural network parameterizations for future prediction. △ Less

Submitted 9 April, 2021; v1 submitted 15 June, 2020; originally announced June 2020.

Reduced order modeling of fluid flows: Machine learning, Kolmogorov barrier, closure modeling, and partitioning

Authors: Shady Ahmed, Suraj Pawar, Omer San, Adil Rasheed

Abstract: In this paper, we put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements. We build on the fact that in a realistic application, there are uncertainties in initial conditions, boundary conditions, model parameters, and/or field measurements. Moreover, conventional nonlinear ROMs based on Galerkin pro… ▽ More In this paper, we put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements. We build on the fact that in a realistic application, there are uncertainties in initial conditions, boundary conditions, model parameters, and/or field measurements. Moreover, conventional nonlinear ROMs based on Galerkin projection (GROMs) suffer from imperfection and solution instabilities due to the modal truncation, especially for advection-dominated flows with slow decay in the Kolmogorov width. In the presented LSTM-Nudge approach, we fuse forecasts from a combination of imperfect GROM and uncertain state estimates, with sparse Eulerian sensor measurements to provide more reliable predictions in a dynamical data assimilation framework. We illustrate the idea with the viscous Burgers problem, as a benchmark test bed with quadratic nonlinearity and Laplacian dissipation. We investigate the effects of measurements noise and state estimate uncertainty on the performance of the LSTM-Nudge behavior. We also demonstrate that it can sufficiently handle different levels of temporal and spatial measurement sparsity. This first step in our assessment of the proposed model shows that the LSTM nudging could represent a viable realtime predictive tool in emerging digital twin systems. △ Less

Submitted 28 May, 2020; originally announced May 2020.

Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows

Authors: Suraj Pawar, Shady E. Ahmed, Omer San, Adil Rasheed, Ionel M. Navon

Abstract: Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging ga… ▽ More Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging gain matrix might be cumbersome. In this paper, we put forth a fully nonintrusive recurrent neural network approach based on a long short-term memory (LSTM) embedding architecture to estimate the nudging term, which plays a role not only to force the state trajectories to the observations but also acts as a stabilizer. Furthermore, our approach relies on the power of archival data and the trained model can be retrained effectively due to power of transfer learning in any neural network applications. In order to verify the feasibility of the proposed approach, we perform twin experiments using Lorenz 96 system. Our results demonstrate that the proposed LSTM nudging approach yields more accurate estimates than both extended Kalman filter (EKF) and ensemble Kalman filter (EnKF) when only sparse observations are available. With the availability of emerging AI-friendly and modular hardware technologies and heterogeneous computing platforms, we articulate that our simplistic nudging framework turns out to be computationally more efficient than either the EKF or EnKF approaches. △ Less

Submitted 22 May, 2020; originally announced May 2020.

Forward sensitivity approach for estimating eddy viscosity closures in nonlinear model reduction

Authors: Shady E. Ahmed, Kinjal Bhar, Omer San, Adil Rasheed

Abstract: In this paper, we propose a variational approach to estimate eddy viscosity using forward sensitivity method (FSM) for closure modeling in nonlinear reduced order models. FSM is a data assimilation technique that blends model's predictions with noisy observations to correct initial state and/or model parameters. We apply this approach on a projection based reduced order model (ROM) of the one-dime… ▽ More In this paper, we propose a variational approach to estimate eddy viscosity using forward sensitivity method (FSM) for closure modeling in nonlinear reduced order models. FSM is a data assimilation technique that blends model's predictions with noisy observations to correct initial state and/or model parameters. We apply this approach on a projection based reduced order model (ROM) of the one-dimensional viscous Burgers equation with a square wave defining a moving shock, and the two-dimensional vorticity transport equation formulating a decay of Kraichnan turbulence. We investigate the capability of the approach to approximate an optimal value for eddy viscosity with different measurement configurations. Specifically, we show that our approach can sufficiently assimilate information either through full field or sparse noisy measurements to estimate eddy viscosity closure to cure standard Galerkin reduced order model (GROM) predictions. Therefore, our approach provides a modular framework to correct forecasting error from a sparse observational network on a latent space. We highlight that the proposed GROM-FSM framework is promising for emerging digital twin applications, where real-time sensor measurements can be used to update and optimize surrogate model's parameters. △ Less

Submitted 4 November, 2020; v1 submitted 21 May, 2020; originally announced May 2020.

Journal ref: Phys. Rev. E 102, 043302 (2020)

Marine life through You Only Look Once's perspective

Authors: Herman Stavelin, Adil Rasheed, Omer San, Arne Johan Hestnes

Abstract: With the rise of focus on man made changes to our planet and wildlife therein, more and more emphasis is put on sustainable and responsible gathering of resources. In an effort to preserve maritime wildlife the Norwegian government has decided that it is necessary to create an overview over the presence and abundance of various species of wildlife in the Norwegian fjords and oceans. In this paper… ▽ More With the rise of focus on man made changes to our planet and wildlife therein, more and more emphasis is put on sustainable and responsible gathering of resources. In an effort to preserve maritime wildlife the Norwegian government has decided that it is necessary to create an overview over the presence and abundance of various species of wildlife in the Norwegian fjords and oceans. In this paper we apply and analyze an object detection scheme that detects fish in camera images. The data is sampled from a submerged data station at Fulehuk in Norway. We implement You Only Look Once (YOLO) version 3 and create a dataset consisting of 99,961 images with a mAP of $\sim 0.88$. We also investigate intermediate results within YOLO, gaining insight into how it performs object detection. △ Less

Submitted 11 February, 2020; originally announced March 2020.