Showing 1–20 of 20 results for author: Navon, I M

Advancing operational PM2.5 forecasting with dual deep neural networks (D-DNet)

Authors: Shengjuan Cai, Fangxin Fang, Vincent-Henri Peuch, Mihai Alexe, Ionel Michael Navon, Yanghua Wang

Abstract: PM2.5 forecasting is crucial for public health, air quality management, and policy development. Traditional physics-based models are computationally demanding and slow to adapt to real-time conditions. Deep learning models show potential in efficiency but still suffer from accuracy loss over time due to error accumulation. To address these challenges, we propose a dual deep neural network (D-DNet)… ▽ More PM2.5 forecasting is crucial for public health, air quality management, and policy development. Traditional physics-based models are computationally demanding and slow to adapt to real-time conditions. Deep learning models show potential in efficiency but still suffer from accuracy loss over time due to error accumulation. To address these challenges, we propose a dual deep neural network (D-DNet) prediction and data assimilation system that efficiently integrates real-time observations, ensuring reliable operational forecasting. D-DNet excels in global operational forecasting for PM2.5 and AOD550, maintaining consistent accuracy throughout the entire year of 2019. It demonstrates notably higher efficiency than the Copernicus Atmosphere Monitoring Service (CAMS) 4D-Var operational forecasting system while maintaining comparable accuracy. This efficiency benefits ensemble forecasting, uncertainty analysis, and large-scale tasks. △ Less

Submitted 27 June, 2024; originally announced June 2024.

Digital Twin Data Modelling by Randomized Orthogonal Decomposition and Deep Learning

Authors: Diana Alina Bistrian, Omer San, Ionel Michael Navon

Abstract: A digital twin is a surrogate model that has the main feature to mirror the original process behavior. Associating the dynamical process with a digital twin model of reduced complexity has the significant advantage to map the dynamics with high accuracy and reduced costs in CPU time and hardware to timescales over which that suffers significantly changes and so it is difficult to explore. This pap… ▽ More A digital twin is a surrogate model that has the main feature to mirror the original process behavior. Associating the dynamical process with a digital twin model of reduced complexity has the significant advantage to map the dynamics with high accuracy and reduced costs in CPU time and hardware to timescales over which that suffers significantly changes and so it is difficult to explore. This paper introduces a new framework for creating efficient digital twin models of fluid flows. We introduce a novel algorithm that combines the advantages of Krylov based dynamic mode decomposition with proper orthogonal decomposition and outperforms the selection of the most influential modes. We prove that randomized orthogonal decomposition algorithm provides several advantages over SVD empirical orthogonal decomposition methods and mitigates the projection error formulating a multiobjective optimization problem.We involve the state-of-the-art artificial intelligence Deep Learning (DL) to perform a real-time adaptive calibration of the digital twin model, with increasing fidelity. The output is a high-fidelity DIGITAL TWIN DATA MODEL of the fluid flow dynamics, with the advantage of a reduced complexity. The new modelling tools are investigated in the numerical simulation of three wave phenomena with increasing complexity. We show that the outputs are consistent with the original source data.We perform a thorough assessment of the performance of the new digital twin data models, in terms of numerical accuracy and computational efficiency, including a time simulation response feature study. △ Less

Submitted 18 March, 2024; v1 submitted 17 June, 2022; originally announced June 2022.

Comments: The material will be revised

CAMERA: A Method for Cost-aware, Adaptive, Multifidelity, Efficient Reliability Analysis

Authors: S. Ashwin Renganathan, Vishwas Rao, Ionel M. Navon

Abstract: Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distribution, and Monte Carlo sampling methods are intractable when expensive high-fidelity simulations have to be queried. We propose a method to use models of multiple fidelities that trade accuracy for… ▽ More Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distribution, and Monte Carlo sampling methods are intractable when expensive high-fidelity simulations have to be queried. We propose a method to use models of multiple fidelities that trade accuracy for computational efficiency. Specifically, we propose the use of multifidelity Gaussian process models to efficiently fuse models at multiple fidelity, thereby offering a cheap surrogate model that emulates the original model at all fidelities. Furthermore, we propose a novel sequential \emph{acquisition function}-based experiment design framework that can automatically select samples from appropriate fidelity models to make predictions about quantities of interest in the highest fidelity. We use our proposed approach in an importance sampling setting and demonstrate our method on the failure level set estimation and probability estimation on synthetic test functions as well as two real-world applications, namely, the reliability analysis of a gas turbine engine blade using a finite element method and a transonic aerodynamic wing test case using Reynolds-averaged Navier--Stokes equations. We demonstrate that our method predicts the failure boundary and probability more accurately and computationally efficiently while using varying fidelity models compared with using just a single expensive high-fidelity model. △ Less

Submitted 20 September, 2022; v1 submitted 2 March, 2022; originally announced March 2022.

Comments: 35 page, 16 figures

An AI-based Domain-Decomposition Non-Intrusive Reduced-Order Model for Extended Domains applied to Multiphase Flow in Pipes

Authors: Claire E. Heaney, Zef Wolffs, Jón Atli Tómasson, Lyes Kahouadji, Pablo Salinas, André Nicolle, Omar K. Matar, Ionel M. Navon, Narakorn Srinil, Christopher C. Pain

Abstract: The modelling of multiphase flow in a pipe presents a significant challenge for high-resolution computational fluid dynamics (CFD) models due to the high aspect ratio (length over diameter) of the domain. In subsea applications, the pipe length can be several hundreds of kilometres versus a pipe diameter of just a few inches. In this paper, we present a new AI-based non-intrusive reduced-order mod… ▽ More The modelling of multiphase flow in a pipe presents a significant challenge for high-resolution computational fluid dynamics (CFD) models due to the high aspect ratio (length over diameter) of the domain. In subsea applications, the pipe length can be several hundreds of kilometres versus a pipe diameter of just a few inches. In this paper, we present a new AI-based non-intrusive reduced-order model within a domain decomposition framework (AI-DDNIROM) which is capable of making predictions for domains significantly larger than the domain used in training. This is achieved by using domain decomposition; dimensionality reduction; training a neural network to make predictions for a single subdomain; and by using an iteration-by-subdomain technique to converge the solution over the whole domain. To find the low-dimensional space, we explore several types of autoencoder networks, known for their ability to compress information accurately and compactly. The performance of the autoencoders is assessed on two advection-dominated problems: flow past a cylinder and slug flow in a pipe. To make predictions in time, we exploit an adversarial network which aims to learn the distribution of the training data, in addition to learning the map** between particular inputs and outputs. This type of network has shown the potential to produce realistic outputs. The whole framework is applied to multiphase slug flow in a horizontal pipe for which an AI-DDNIROM is trained on high-fidelity CFD simulations of a pipe of length 10 m with an aspect ratio of 13:1, and tested by simulating the flow for a pipe of length 98 m with an aspect ratio of almost 130:1. Statistics of the flows obtained from the CFD simulations are compared to those of the AI-DDNIROM predictions to demonstrate the success of our approach. △ Less

Submitted 12 February, 2022; originally announced February 2022.

Comments: 38 pages, 11 figures

Sketching Methods for Dynamic Mode Decomposition in Spherical Shallow Water Equations

Authors: Shady E. Ahmed, Omer San, Diana A. Bistrian, Ionel M. Navon

Abstract: Dynamic mode decomposition (DMD) is an emerging methodology that has recently attracted computational scientists working on nonintrusive reduced order modeling. One of the major strengths that DMD possesses is having ground theoretical roots from the Koopman approximation theory. Indeed, DMD may be viewed as the data-driven realization of the famous Koopman operator. Nonetheless, the stable implem… ▽ More Dynamic mode decomposition (DMD) is an emerging methodology that has recently attracted computational scientists working on nonintrusive reduced order modeling. One of the major strengths that DMD possesses is having ground theoretical roots from the Koopman approximation theory. Indeed, DMD may be viewed as the data-driven realization of the famous Koopman operator. Nonetheless, the stable implementation of DMD incurs computing the singular value decomposition of the input data matrix. This, in turn, makes the process computationally demanding for high dimensional systems. In order to alleviate this burden, we develop a framework based on sketching methods, wherein a sketch of a matrix is simply another matrix which is significantly smaller, but still sufficiently approximates the original system. Such sketching or embedding is performed by applying random transformations, with certain properties, on the input matrix to yield a compressed version of the initial system. Hence, many of the expensive computations can be carried out on the smaller matrix, thereby accelerating the solution of the original problem. We conduct numerical experiments conducted using the spherical shallow water equations as a prototypical model in the context of geophysical flows. The performance of several sketching approaches is evaluated for capturing the range and co-range of the data matrix. The proposed sketching-based framework can accelerate various portions of the DMD algorithm, compared to classical methods that operate directly on the raw input data. This eventually leads to substantial computational gains that are vital for digital twinning of high dimensional systems. △ Less

Submitted 11 January, 2022; originally announced January 2022.

Journal ref: AIAA SciTech 2022 Forum

A data driven reduced order model of fluid flow by Auto-Encoder and self-attention deep learning methods

Authors: R. Fu, D. Xiao, I. M. Navon, C. Wang

Abstract: This paper presents a new data-driven non-intrusive reduced-order model(NIROM) that outperforms the traditional Proper orthogonal decomposition (POD) based reducedorder model. This is achieved by using Auto-Encoder(AE) and attention-based deep learning methods. The novelty of the present work lies in that it uses Stacked AutoEncoder(SAE) network to project original high-dimensional dynamical syste… ▽ More This paper presents a new data-driven non-intrusive reduced-order model(NIROM) that outperforms the traditional Proper orthogonal decomposition (POD) based reducedorder model. This is achieved by using Auto-Encoder(AE) and attention-based deep learning methods. The novelty of the present work lies in that it uses Stacked AutoEncoder(SAE) network to project original high-dimensional dynamical systems onto a low dimensional nonlinear subspace and predict the fluid dynamics using an attentionbased deep learning method. A new model reduction neural network architecture for fluid flow problem is presented. The SAE network compresses high-dimensional physical information into several much smaller sized representations in a latent space. These representations are expressed by a number of codes in the middle layer of SAE neural network. Then, those codes at different time levels are trained to construct a set of hyper-surfaces with multi variable response functions using attention-based deep learning methods. The inputs of the attention-based network are previous time levels' codes and the outputs of the network are current time levels' codes. The codes at current time level are then projected back to the original full space by the decoder layers in the SAE network. The capability of this data-driven reduced order model (DDROM) is illustrated numerically by two test cases: flow past a cylinder, and a lock exchange, respectively. The results obtained show that the DDROM performs better in terms of accuracy than the popular model reduction method namely proper orthogonal decomposition. The improvement is assessed by comparison with a high fidelity POD model. △ Less

Submitted 5 September, 2021; originally announced September 2021.

A nonintrusive hybrid neural-physics modeling of incomplete dynamical systems: Lorenz equations

Authors: Suraj Pawar, Omer San, Adil Rasheed, Ionel M. Navon

Abstract: This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of dynamics of some variables is unknown, but reasonably accurate observational data can be obtained for the evolution of the state of the system. In this work, we prop… ▽ More This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of dynamics of some variables is unknown, but reasonably accurate observational data can be obtained for the evolution of the state of the system. In this work, we propose machine learning to account for missing physics and then data assimilation to correct the prediction. In particular, we devise an effective methodology based on a recurrent neural network to model the unknown dynamics. A long short-term memory (LSTM) based correction term is added to the predictive model in order to take into account hidden physics. Since LSTM introduces a black-box approach for the unknown part of the model, we investigate whether the proposed hybrid neural-physical model can be further corrected through a sequential data assimilation step. We apply this framework to the weakly nonlinear Lorenz model that displays quasiperiodic oscillations, the highly nonlinear Lorenz model, and two-scale Lorenz model. The hybrid neural-physics model yields accurate results for the weakly nonlinear Lorenz model with the predicted state close to the true Lorenz model trajectory. For the highly nonlinear Lorenz model and the two-scale Lorenz model, the hybrid neural-physics model deviates from the true state due to the accumulation of prediction error from one time step to the next time step. The ensemble Kalman filter approach takes into account the prediction error and updates the diverged prediction using available observations in order to provide a more accurate state estimate. The successful synergistic integration of neural network and data assimilation for low-dimensional system shows the potential benefits of the proposed hybrid-neural physics model for complex systems. △ Less

Submitted 13 August, 2021; v1 submitted 31 March, 2021; originally announced April 2021.

Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows

Authors: Suraj Pawar, Shady E. Ahmed, Omer San, Adil Rasheed, Ionel M. Navon

Abstract: Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging ga… ▽ More Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging gain matrix might be cumbersome. In this paper, we put forth a fully nonintrusive recurrent neural network approach based on a long short-term memory (LSTM) embedding architecture to estimate the nudging term, which plays a role not only to force the state trajectories to the observations but also acts as a stabilizer. Furthermore, our approach relies on the power of archival data and the trained model can be retrained effectively due to power of transfer learning in any neural network applications. In order to verify the feasibility of the proposed approach, we perform twin experiments using Lorenz 96 system. Our results demonstrate that the proposed LSTM nudging approach yields more accurate estimates than both extended Kalman filter (EKF) and ensemble Kalman filter (EnKF) when only sparse observations are available. With the availability of emerging AI-friendly and modular hardware technologies and heterogeneous computing platforms, we articulate that our simplistic nudging framework turns out to be computationally more efficient than either the EKF or EnKF approaches. △ Less

Submitted 22 May, 2020; originally announced May 2020.

Data-driven modelling of nonlinear spatio-temporal fluid flows using a deep convolutional generative adversarial network

Authors: M. Cheng, F. Fang, C. C. Pain, I. M. Navon

Abstract: Deep learning techniques for improving fluid flow modelling have gained significant attention in recent years. Advanced deep learning techniques achieve great progress in rapidly predicting fluid flows without prior knowledge of the underlying physical relationships. Advanced deep learning techniques achieve great progress in rapidly predicting fluid flows without prior knowledge of the underlying… ▽ More Deep learning techniques for improving fluid flow modelling have gained significant attention in recent years. Advanced deep learning techniques achieve great progress in rapidly predicting fluid flows without prior knowledge of the underlying physical relationships. Advanced deep learning techniques achieve great progress in rapidly predicting fluid flows without prior knowledge of the underlying physical relationships. However, most of existing researches focused mainly on either sequence learning or spatial learning, rarely on both spatial and temporal dynamics of fluid flows (Reichstein et al., 2019). In this work, an Artificial Intelligence (AI) fluid model based on a general deep convolutional generative adversarial network (DCGAN) has been developed for predicting spatio-temporal flow distributions. In deep convolutional networks, the high-dimensional flows can be converted into the low-dimensional "latent" representations. The complex features of flow dynamics can be captured by the adversarial networks. The above DCGAN fluid model enables us to provide reasonable predictive accuracy of flow fields while maintaining a high computational efficiency. The performance of the DCGAN is illustrated for two test cases of Hokkaido tsunami with different incoming waves along the coastal line. It is demonstrated that the results from the DCGAN are comparable with those from the original high fidelity model (Fluidity). The spatio-temporal flow features have been represented as the flow evolves, especially, the wave phases and flow peaks can be captured accurately. In addition, the results illustrate that the online CPU cost is reduced by five orders of magnitude compared to the original high fidelity model simulations. The promising results show that the DCGAN can provide rapid and reliable spatio-temporal prediction for nonlinear fluid flows. △ Less

Submitted 12 March, 2020; originally announced April 2020.

An advanced hybrid deep adversarial autoencoder for parameterized nonlinear fluid flow modelling

Authors: M. Cheng, F. Fang, C. C. Pain, I. M. Navon

Abstract: Considering the high computation cost produced in conventional computation fluid dynamic simulations, machine learning methods have been introduced to flow dynamic simulations in recent years. However, most of studies focus mainly on existing fluid fields learning, the prediction of spatio-temporal nonlinear fluid flows in varying parameterized space has been neglected. In this work, we propose a… ▽ More Considering the high computation cost produced in conventional computation fluid dynamic simulations, machine learning methods have been introduced to flow dynamic simulations in recent years. However, most of studies focus mainly on existing fluid fields learning, the prediction of spatio-temporal nonlinear fluid flows in varying parameterized space has been neglected. In this work, we propose a hybrid deep adversarial autoencoder (DAA) to integrate generative adversarial network (GAN) and variational autoencoder (VAE) for predicting parameterized nonlinear fluid flows in spatial and temporal space. High-dimensional inputs are compressed into the low-representation representations by nonlinear functions in a convolutional encoder. In this way, the predictive fluid flows reconstructed in a convolutional decoder contain the dynamic flow physics of high nonlinearity and chaotic nature. In addition, the low-representation representations are applied into the adversarial network for model training and parameter optimization, which enables a fast computation process. The capability of the hybrid DAA is demonstrated by varying inputs on a water collapse example. Numerical results show that this hybrid DAA has successfully captured the spatio-temporal flow features with CPU speed-up of three orders of magnitude. Promising results suggests that the hybrid DAA can play a critical role in efficiently and accurately predicting complex flows in future. △ Less

Submitted 14 March, 2020; originally announced March 2020.

Sampling and resolution characteristics in reduced order models of shallow water equations: intrusive vs non-intrusive

Authors: Shady E. Ahmed, Omer San, Diana A. Bistrian, Ionel M. Navon

Abstract: We investigate the sensitivity of reduced order models (ROMs) to training data resolution as well as sampling rate. In particular, we consider proper orthogonal decomposition (POD), coupled with Galerkin projection (POD-GP), as an intrusive reduced order modeling technique. For non-intrusive ROMs, we consider two frameworks. The first is using dynamic mode decomposition (DMD), and the second is ba… ▽ More We investigate the sensitivity of reduced order models (ROMs) to training data resolution as well as sampling rate. In particular, we consider proper orthogonal decomposition (POD), coupled with Galerkin projection (POD-GP), as an intrusive reduced order modeling technique. For non-intrusive ROMs, we consider two frameworks. The first is using dynamic mode decomposition (DMD), and the second is based on artificial neural networks (ANNs). For ANN, we utilized a residual deep neural network, and for DMD we have studied two versions of DMD approaches; one with hard thresholding and the other with sorted bases selection. Also, we highlight the differences between mean-subtracting the data (i.e., centering) and using the data without mean-subtraction. We tested these ROMs using a system of 2D shallow water equations for four different numerical experiments, adopting combinations of sampling rates and resolutions. For these cases, we found that the DMD basis obtained with hard threshodling is sensitive to sampling rate, performing worse at very high rates. The sorted DMD algorithm helps to mitigate this problem and yields more stabilized and converging solution. Furthermore, we demonstrate that both DMD approaches with mean subtraction provide significantly more accurate results than DMD with mean-subtracting the data. On the other hand, POD is relatively insensitive to sampling rate and yields better representation of the flow field. Meanwhile, resolution has little effect on both POD and DMD performances. Therefore, we preferred to train the neural network in POD space, since it is more stable and better represents our dataset. Numerical results reveal that an artificial neural network on POD subspace (POD-ANN) performs remarkably better than POD-GP and DMD in capturing system dynamics, even with a small number of modes. △ Less

Submitted 16 October, 2019; originally announced October 2019.

Memory embedded non-intrusive reduced order modeling of non-ergodic flows

Authors: Shady E. Ahmed, Sk. Mashfiqur Rahman, Omer San, Adil Rasheed, Ionel M. Navon

Abstract: Generating a digital twin of any complex system requires modeling and computational approaches that are efficient, accurate, and modular. Traditional reduced order modeling techniques are targeted at only the first two but the novel non-intrusive approach presented in this study is an attempt at taking all three into account effectively compared to their traditional counterparts. Based on dimensio… ▽ More Generating a digital twin of any complex system requires modeling and computational approaches that are efficient, accurate, and modular. Traditional reduced order modeling techniques are targeted at only the first two but the novel non-intrusive approach presented in this study is an attempt at taking all three into account effectively compared to their traditional counterparts. Based on dimensionality reduction using proper orthogonal decomposition (POD), we introduce a long short-term memory (LSTM) neural network architecture together with a principal interval decomposition (PID) framework as an enabler to account for localized modal deformation, which is a key element in accurate reduced order modeling of convective flows. Our applications for convection dominated systems governed by Burgers, Navier-Stokes, and Boussinesq equations demonstrate that the proposed approach yields significantly more accurate predictions than the POD-Galerkin method, and could be a key enabler towards near real-time predictions of unsteady flows. △ Less

Submitted 16 October, 2019; originally announced October 2019.

Goal-based sensitivity maps using time windows and ensemble perturbations

Authors: C. E. Heaney, P. Salinas, F. Fang, C. C. Pain, I. M. Navon

Abstract: We present an approach for forming sensitivity maps (or sensitivites) using ensembles. The method is an alternative to using an adjoint, which can be very challenging to formulate and also computationally expensive to solve. The main novelties of the presented approach are: 1) the use of goals, weighting the perturbation to help resolve the most important sensitivities, 2) the use of time windows,… ▽ More We present an approach for forming sensitivity maps (or sensitivites) using ensembles. The method is an alternative to using an adjoint, which can be very challenging to formulate and also computationally expensive to solve. The main novelties of the presented approach are: 1) the use of goals, weighting the perturbation to help resolve the most important sensitivities, 2) the use of time windows, which enable the perturbations to be optimised independently for each window and 3) re-orthogonalisation of the solution through time, which helps optimise each perturbation when calculating sensitivity maps. These novel methods greatly reduce the number of ensembles required to form the sensitivity maps as demonstrated in this paper. As the presented method relies solely on ensembles obtained from the forward model, it can therefore be applied directly to forward models of arbitrary complexity arising from, for example, multi-physics coupling, legacy codes or model chains. It can also be applied to compute sensitivities for optimisation of sensor placement, optimisation for design or control, goal-based mesh adaptivity, assessment of goals (e.g. hazard assessment and mitigation in the natural environment), determining the worth of current data and data assimilation. We analyse and demonstrate the efficiency of the approach by applying the method to advection problems and also a non-linear heterogeneous multi-phase porous media problem, showing, in all cases, that the number of ensembles required to obtain accurate sensitivity maps is relatively low, in the order of 10s. △ Less

Submitted 20 September, 2018; v1 submitted 12 April, 2018; originally announced April 2018.

Comments: 35 pages, 13 figures. Submitted to JCP in September 2018 Changes: additional context given in the introduction, additional explanation given in section 2.2, some changes to equations. Results unchanged

On Triangle Inequality Based Approximation Error Estimation

Authors: A. K. Alekseev, A. E. Bondarev, I. M. Navon

Abstract: The distance between the true and numerical solutions in some metric is considered as the discretization error magnitude. If error magnitude ranging is known, the triangle inequality enables the estimation of the vicinity of the approximate solution that contains the exact one (exact solution enclosure). The analysis of distances between the numerical solutions enables discretization error ranging… ▽ More The distance between the true and numerical solutions in some metric is considered as the discretization error magnitude. If error magnitude ranging is known, the triangle inequality enables the estimation of the vicinity of the approximate solution that contains the exact one (exact solution enclosure). The analysis of distances between the numerical solutions enables discretization error ranging, if solutions errors are significantly different. Numerical tests conducted using the steady supersonic flows, governed by the two dimensional Euler equations, demonstrate the properties of the exact solution enclosure. The set of solutions generated by solvers of different orders of approximation is used. The success of this approach depends on the choice of metric. △ Less

Submitted 10 May, 2018; v1 submitted 15 August, 2017; originally announced August 2017.

On Estimation of Discretization Error Norm via Ensemble of Approximate Solutions

Authors: A. K. Alekseev, A. E. Bondarev, I. M. Navon

Abstract: The issue of single-grid discretization error estimator, operating in the postprocessor mode, is addressed in the paper. An ensemble of numerical solutions, obtained using solvers of different accuracy, is shown to provide an upper estimate for the norm of the discretization error. Numerical tests for the supersonic flows, governed by two dimensional Euler equations, confirm the feasibility for th… ▽ More The issue of single-grid discretization error estimator, operating in the postprocessor mode, is addressed in the paper. An ensemble of numerical solutions, obtained using solvers of different accuracy, is shown to provide an upper estimate for the norm of the discretization error. Numerical tests for the supersonic flows, governed by two dimensional Euler equations, confirm the feasibility for the norm estimation, if the ensemble of numerical solutions is separated into clusters of accurate and inaccurate solutions. △ Less

Submitted 10 May, 2018; v1 submitted 17 April, 2017; originally announced April 2017.

Randomized Dynamic Mode Decomposition for Non-Intrusive Reduced Order Modelling

Authors: D. A. Bistrian, I. M. Navon

Abstract: This paper focuses on a new framework for reduced order modelling of non-intrusive data with application to 2D flows. To overcome the shortcomings of intrusive model order reduction usually derived by combining the POD and the Galerkin projection methods, we developed a novel technique based on Randomized Dynamic Mode Decomposition as a fast and accurate option in model order reduction of non-intr… ▽ More This paper focuses on a new framework for reduced order modelling of non-intrusive data with application to 2D flows. To overcome the shortcomings of intrusive model order reduction usually derived by combining the POD and the Galerkin projection methods, we developed a novel technique based on Randomized Dynamic Mode Decomposition as a fast and accurate option in model order reduction of non-intrusive data originating from Saint-Venant systems. Combining efficiently the Randomized Dynamic Mode Decomposition algorithm with Radial Basis Function interpolation, we produced an efficient tool in develo** the linear model of a complex flow field described by non-intrusive (or experimental) data. The rank of the reduced DMD model is given as the unique solution of a constrained optimization problem. We emphasize the excellent behavior of the non-intrusive reduced order models by performing a qualitative analysis. In addition, we gain a significantly reduction of CPU time in computation of the reduced order models (ROMs) for non-intrusive numerical data. △ Less

Submitted 15 November, 2016; originally announced November 2016.

Comments: 22 pages, 14 figures

MSC Class: 65P99; 76B75

POD/DEIM Reduced-Order Strategies for Efficient Four Dimensional Variational Data Assimilation

Authors: Răzvan Ştefănescu, Adrian Sandu, Ionel Michael Navon

Abstract: This work studies reduced order modeling (ROM) approaches to speed up the solution of variational data assimilation problems with large scale nonlinear dynamical models. It is shown that a key requirement for a successful reduced order solution is that reduced order Karush-Kuhn-Tucker conditions accurately represent their full order counterparts. In particular, accurate reduced order approximation… ▽ More This work studies reduced order modeling (ROM) approaches to speed up the solution of variational data assimilation problems with large scale nonlinear dynamical models. It is shown that a key requirement for a successful reduced order solution is that reduced order Karush-Kuhn-Tucker conditions accurately represent their full order counterparts. In particular, accurate reduced order approximations are needed for the forward and adjoint dynamical models, as well as for the reduced gradient. New strategies to construct reduced order based are developed for Proper Orthogonal Decomposition (POD) ROM data assimilation using both Galerkin and Petrov-Galerkin projections. For the first time POD, tensorial POD, and discrete empirical interpolation method (DEIM) are employed to develop reduced data assimilation systems for a geophysical flow model, namely, the two dimensional shallow water equations. Numerical experiments confirm the theoretical framework for Galerkin projection. In the case of Petrov-Galerkin projection, stabilization strategies must be considered for the reduced order models. The new reduced order shallow water data assimilation system provides analyses similar to those produced by the full resolution data assimilation system in one tenth of the computational time. △ Less

Submitted 23 April, 2015; v1 submitted 24 February, 2014; originally announced February 2014.

Comments: 49 pages, 7 figures

Report number: CSTR-17/2015

Comparison of POD reduced order strategies for the nonlinear 2D Shallow Water Equations

Authors: Răzvan Ştefănescu, Adrian Sandu, Ionel M. Navon

Abstract: This paper introduces tensorial calculus techniques in the framework of Proper Orthogonal Decomposition (POD) to reduce the computational complexity of the reduced nonlinear terms. The resulting method, named tensorial POD, can be applied to polynomial nonlinearities of any degree $p$. Such nonlinear terms have an on-line complexity of $\mathcal{O}(k^{p+1})$, where $k$ is the dimension of POD basi… ▽ More This paper introduces tensorial calculus techniques in the framework of Proper Orthogonal Decomposition (POD) to reduce the computational complexity of the reduced nonlinear terms. The resulting method, named tensorial POD, can be applied to polynomial nonlinearities of any degree $p$. Such nonlinear terms have an on-line complexity of $\mathcal{O}(k^{p+1})$, where $k$ is the dimension of POD basis, and therefore is independent of full space dimension. However it is efficient only for quadratic nonlinear terms since for higher nonlinearities standard POD proves to be less time consuming once the POD basis dimension $k$ is increased. Numerical experiments are carried out with a two dimensional shallow water equation (SWE) test problem to compare the performance of tensorial POD, standard POD, and POD/Discrete Empirical Interpolation Method (DEIM). Numerical results show that tensorial POD decreases by $76\times$ times the computational cost of the on-line stage of standard POD for configurations using more than $300,000$ model variables. The tensorial POD SWE model was only $2-8\times$ slower than the POD/DEIM SWE model but the implementation effort is considerably increased. Tensorial calculus was again employed to construct a new algorithm allowing POD/DEIM shallow water equation model to compute its off-line stage faster than the standard and tensorial POD approaches. △ Less

Submitted 9 February, 2014; originally announced February 2014.

Comments: 23 pages, 8 figures, 5 tables

Report number: TR 2/2014

1D+4D-VAR data assimilation of lightning with WRFDA system using nonlinear observation operators

Authors: Razvan Stefanescu, I. Michael Navon, Henry Fuelberg, Max Marchand

Abstract: This paper addresses the impact of assimilating data from the Earth Networks Total Lightning Network (ENTLN) during two cases of severe weather. Data from the ENTLN serve as a substitute for those from the upcoming launch of the GOES Lightning Mapper (GLM). We use the Weather Research and Forecast (WRF) model and variational data assimilation techniques at 9 km spatial resolution. The main goal is… ▽ More This paper addresses the impact of assimilating data from the Earth Networks Total Lightning Network (ENTLN) during two cases of severe weather. Data from the ENTLN serve as a substitute for those from the upcoming launch of the GOES Lightning Mapper (GLM). We use the Weather Research and Forecast (WRF) model and variational data assimilation techniques at 9 km spatial resolution. The main goal is to examine the potential impact of lightning observations from the future GLM. Previous efforts to assimilate lightning observations mainly utilized nudging approaches. We develop three more sophisticated approaches, 3D-VAR WRFDA and 1D+nD-VAR (n=3,4) WRFDA schemes that currently are being considered for operational implementation by the National Centers for Environmental Prediction (NCEP) and the Naval Research Laboratory (NRL). This research uses Convective Available Potential Energy (CAPE) as a proxy between lightning data and model variables. To test the performance of the aforementioned schemes, we assess the quality of resulting analysis and forecasts of precipitation compared to those from a control experiment and verify them against NCEP stage IV precipitation. Results demonstrate that assimilating lightning observations improves precipitation statistics during the assimilation window and for 3-7 h thereafter. The 1D+4D-VAR approach performs best, significantly improving precipitation root mean square errors by 25% and 27.5% compared to the control during the assimilation window on the two cases. This finding confirms that the variational nD-VAR (n=3,4) assimilation of lightning observations improves the accuracy of moisture analyses and forecasts. Finally, we briefly discuss limitations inherent in the current lightning assimilation schemes, their implications, and possible ways to improve them. △ Less

Submitted 8 June, 2013; originally announced June 2013.

MSC Class: 35Q93

POD/DEIM Nonlinear model order reduction of an ADI implicit shallow water equations model

Authors: Razvan Stefanescu, Ionel Michael Navon

Abstract: In the present paper we consider a 2-D shallow-water equations (SWE) model on a $β$-plane solved using an alternating direction fully implicit (ADI) finite-difference scheme on a rectangular domain. The scheme was shown to be unconditionally stable for the linearized equations. The discretization yields a number of nonlinear systems of algebraic equations. We then use a proper orthogonal decompo… ▽ More In the present paper we consider a 2-D shallow-water equations (SWE) model on a $β$-plane solved using an alternating direction fully implicit (ADI) finite-difference scheme on a rectangular domain. The scheme was shown to be unconditionally stable for the linearized equations. The discretization yields a number of nonlinear systems of algebraic equations. We then use a proper orthogonal decomposition (POD) to reduce the dimension of the SWE model. Due to the model nonlinearities, the computational complexity of the reduced model still depends on the number of variables of the full shallow - water equations model. By employing the discrete empirical interpolation method (DEIM) we reduce the computational complexity of the reduced order model due to its depending on the nonlinear full dimension model and regain the full model reduction expected from the POD model. To emphasize the CPU gain in performance due to use of POD/DEIM, we also propose testing an explicit Euler finite difference scheme (EE) as an alternative to the ADI implicit scheme for solving the swallow water equations model. We then proceed to assess the efficiency of POD/DEIM as a function of number of spatial discretization points, time steps, and POD basis functions. As was expected, our numerical experiments showed that the CPU time performances of POD/DEIM schemes are proportional to the number of mesh points. Once the number of spatial discretization points exceeded 10000 and for 90 DEIM interpolation points, the CPU time was decreased by a factor of 10 in case of POD/DEIM implicit SWE scheme and by a factor of 15 for the POD/DEIM explicit SWE scheme in comparison with the corresponding POD SWE schemes. Our numerical tests revealed that if the number of points selected by DEIM algorithm reached 50, the approximation errors due to POD/DEIM and POD reduced systems have the same orders of magnitude. △ Less

Submitted 12 November, 2012; originally announced November 2012.

Comments: 41 pages, 16 figures, 12 tables, one appendix