Showing 1–50 of 60 results for author: Koumoutsakos, P

Path planning of magnetic microswimmers in high-fidelity simulations of capillaries with deep reinforcement learning

Authors: Lucas Amoudruz, Sergey Litvinov, Petros Koumoutsakos

Abstract: Biomedical applications such as targeted drug delivery, microsurgery or sensing rely on reaching precise areas within the body in a minimally invasive way. Artificial bacterial flagella (ABFs) have emerged as potential tools for this task by navigating through the circulatory system. While the control and swimming characteristics of ABFs is understood in simple scenarios, their behavior within the… ▽ More Biomedical applications such as targeted drug delivery, microsurgery or sensing rely on reaching precise areas within the body in a minimally invasive way. Artificial bacterial flagella (ABFs) have emerged as potential tools for this task by navigating through the circulatory system. While the control and swimming characteristics of ABFs is understood in simple scenarios, their behavior within the bloodstream remains unclear. We conduct simulations of ABFs evolving in the complex capillary networks found in the human retina. The ABF is robustly guided to a prescribed target by a reinforcement learning agent previously trained on a reduced order model. △ Less

Submitted 29 March, 2024; originally announced April 2024.

Generative Learning for Forecasting the Dynamics of Complex Systems

Authors: Han Gao, Sebastian Kaltenbach, Petros Koumoutsakos

Abstract: We introduce generative models for accelerating simulations of complex systems through learning and evolving their effective dynamics. In the proposed Generative Learning of Effective Dynamics (G-LED), instances of high dimensional data are down sampled to a lower dimensional manifold that is evolved through an auto-regressive attention mechanism. In turn, Bayesian diffusion models, that map this… ▽ More We introduce generative models for accelerating simulations of complex systems through learning and evolving their effective dynamics. In the proposed Generative Learning of Effective Dynamics (G-LED), instances of high dimensional data are down sampled to a lower dimensional manifold that is evolved through an auto-regressive attention mechanism. In turn, Bayesian diffusion models, that map this low-dimensional manifold onto its corresponding high-dimensional space, capture the statistics of the system dynamics. We demonstrate the capabilities and drawbacks of G-LED in simulations of several benchmark systems, including the Kuramoto-Sivashinsky (KS) equation, two-dimensional high Reynolds number flow over a backward-facing step, and simulations of three-dimensional turbulent channel flow. The results demonstrate that generative learning offers new frontiers for the accurate forecasting of the statistical properties of complex systems at a reduced computational cost. △ Less

Submitted 26 February, 2024; originally announced February 2024.

Closure Discovery for Coarse-Grained Partial Differential Equations Using Grid-based Reinforcement Learning

Authors: Jan-Philipp von Bassewitz, Sebastian Kaltenbach, Petros Koumoutsakos

Abstract: Reliable predictions of critical phenomena, such as weather, wildfires and epidemics often rely on models described by Partial Differential Equations (PDEs). However, simulations that capture the full range of spatio-temporal scales described by such PDEs are often prohibitively expensive. Consequently, coarse-grained simulations are usually deployed that adopt various heuristics and empirical clo… ▽ More Reliable predictions of critical phenomena, such as weather, wildfires and epidemics often rely on models described by Partial Differential Equations (PDEs). However, simulations that capture the full range of spatio-temporal scales described by such PDEs are often prohibitively expensive. Consequently, coarse-grained simulations are usually deployed that adopt various heuristics and empirical closure terms to account for the missing information. We propose a novel and systematic approach for identifying closures in under-resolved PDEs using grid-based Reinforcement Learning. This formulation incorporates inductive bias and exploits locality by deploying a central policy represented efficiently by a Fully Convolutional Network (FCN). We demonstrate the capabilities and limitations of our framework through numerical solutions of the advection equation and the Burgers' equation. Our results show accurate predictions for in- and out-of-distribution test cases as well as a significant speedup compared to resolving all scales. △ Less

Submitted 23 May, 2024; v1 submitted 1 February, 2024; originally announced February 2024.

Comments: 23 pages, 12 figures

Individualizing Glioma Radiotherapy Planning by Optimization of Data and Physics-Informed Discrete Loss

Authors: Michal Balcerak, Jonas Weidner, Petr Karnakov, Ivan Ezhov, Sergey Litvinov, Petros Koumoutsakos, Ray Zirui Zhang, John S. Lowengrub, Bene Wiestler, Bjoern Menze

Abstract: Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to… ▽ More Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to target this invisible tumor growth. This "one size fits all" approach is derived from population studies and often fails to account for the nuances of individual patient conditions. We present the GliODIL framework, which infers the full spatial distribution of tumor cell concentration from available multi-modal imaging, leveraging a Fisher-Kolmogorov type physics model to describe tumor growth. This is achieved through the newly introduced method of Optimizing the Discrete Loss (ODIL), where both data and physics-based constraints are softly assimilated into the solution. Our test dataset comprises 152 glioblastoma patients with pre-treatment imaging and post-treatment follow-ups for tumor recurrence monitoring. By blending data-driven techniques with physics-based constraints, GliODIL enhances recurrence prediction in radiotherapy planning, challenging traditional uniform margins and strict adherence to the Fisher-Kolmogorov partial differential equation (PDE) model, which is adapted for complex cases. △ Less

Submitted 14 April, 2024; v1 submitted 8 December, 2023; originally announced December 2023.

Comments: 22 pages, 7 figures, 1 table. Associated GitHub: https://github.com/m1balcerak/GliODIL

Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulence

Authors: Rambod Mojgani, Daniel Waelchli, Yifei Guan, Petros Koumoutsakos, Pedram Hassanzadeh

Abstract: Global climate models (GCMs) are the main tools for understanding and predicting climate change. However, due to limited numerical resolutions, these models suffer from major structural uncertainties; e.g., they cannot resolve critical processes such as small-scale eddies in atmospheric and oceanic turbulence. Thus, such small-scale processes have to be represented as a function of the resolved sc… ▽ More Global climate models (GCMs) are the main tools for understanding and predicting climate change. However, due to limited numerical resolutions, these models suffer from major structural uncertainties; e.g., they cannot resolve critical processes such as small-scale eddies in atmospheric and oceanic turbulence. Thus, such small-scale processes have to be represented as a function of the resolved scales via closures (parametrization). The accuracy of these closures is particularly important for capturing climate extremes. Traditionally, such closures are based on heuristics and simplifying assumptions about the unresolved physics. Recently, supervised-learned closures, trained offline on high-fidelity data, have been shown to outperform the classical physics-based closures. However, this approach requires a significant amount of high-fidelity training data and can also lead to instabilities. Reinforcement learning is emerging as a potent alternative for develo** such closures as it requires only low-order statistics and leads to stable closures. In Scientific Multi-Agent Reinforcement Learning (SMARL) computational elements serve a dual role of discretization points and learning agents. We leverage SMARL and fundamentals of turbulence physics to learn closures for prototypes of atmospheric and oceanic turbulence. The policy is trained using only the enstrophy spectrum, which is nearly invariant and can be estimated from a few high-fidelity samples (these few samples are far from enough for supervised/offline learning). We show that these closures lead to stable low-resolution simulations that, at a fraction of the cost, can reproduce the high-fidelity simulations' statistics, including the tails of the probability density functions. The results demonstrate the high potential of SMARL for closure modeling for GCMs, especially in the regime of scarce data and indirect observations. △ Less

Submitted 1 December, 2023; originally announced December 2023.

Interpretable learning of effective dynamics for multiscale systems

Authors: Emmanuel Menier, Sebastian Kaltenbach, Mouadh Yagoubi, Marc Schoenauer, Petros Koumoutsakos

Abstract: The modeling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today's computer advances resolving all spatiotemporal scales described by the governing equations remains a remote target. This realization has prompted intense efforts to develop model order reduction techniques. In recent y… ▽ More The modeling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today's computer advances resolving all spatiotemporal scales described by the governing equations remains a remote target. This realization has prompted intense efforts to develop model order reduction techniques. In recent years, techniques based on deep recurrent neural networks have produced promising results for the modeling and simulation of complex spatiotemporal systems and offer large flexibility in model development as they can incorporate experimental and computational data. However, neural networks lack interpretability, which limits their utility and generalizability across complex systems. Here we propose a novel framework of Interpretable Learning Effective Dynamics (iLED) that offers comparable accuracy to state-of-the-art recurrent neural network-based approaches while providing the added benefit of interpretability. The iLED framework is motivated by Mori-Zwanzig and Koopman operator theory, which justifies the choice of the specific architecture. We demonstrate the effectiveness of the proposed framework in simulations of three benchmark multiscale systems. Our results show that the iLED framework can generate accurate predictions and obtain interpretable dynamics, making it a promising approach for solving high-dimensional multiscale systems. △ Less

Submitted 11 September, 2023; originally announced September 2023.

Drag Reduction in Flows Past 2D and 3D Circular Cylinders Through Deep Reinforcement Learning

Authors: Michail Chatzimanolakis, Pascal Weber, Petros Koumoutsakos

Abstract: We investigate drag reduction mechanisms in flows past two- and three-dimensional cylinders controlled by surface actuators using deep reinforcement learning. We investigate 2D and 3D flows at Reynolds numbers up to 8,000 and 4,000, respectively. The learning agents are trained in planar flows at various Reynolds numbers, with constraints on the available actuation energy. The discovered actuation… ▽ More We investigate drag reduction mechanisms in flows past two- and three-dimensional cylinders controlled by surface actuators using deep reinforcement learning. We investigate 2D and 3D flows at Reynolds numbers up to 8,000 and 4,000, respectively. The learning agents are trained in planar flows at various Reynolds numbers, with constraints on the available actuation energy. The discovered actuation policies exhibit intriguing generalization capabilities, enabling open-loop control even for Reynolds numbers beyond their training range. Remarkably, the discovered two-dimensional controls, inducing delayed separation, are transferable to three-dimensional cylinder flows. We examine the trade-offs between drag reduction and energy input while discussing the associated mechanisms. The present work paves the way for control of unsteady separated flows via interpretable control strategies discovered through deep reinforcement learning. △ Less

Submitted 5 September, 2023; originally announced September 2023.

An interpretable wildfire spreading model for real-time predictions

Authors: Konstantinos Vogiatzoglou, Costas Papadimitriou, Konstantinos Ampountolas, Michail Chatzimanolakis, Petros Koumoutsakos, Vasilis Bontozoglou

Abstract: Forest fires pose a natural threat with devastating social, environmental, and economic implications. The rapid and highly uncertain rate of spread of wildfires necessitates a trustworthy digital tool capable of providing real-time estimates of fire evolution and human interventions, while receiving continuous input from remote sensing. The current work aims at develo** an interpretable, physics… ▽ More Forest fires pose a natural threat with devastating social, environmental, and economic implications. The rapid and highly uncertain rate of spread of wildfires necessitates a trustworthy digital tool capable of providing real-time estimates of fire evolution and human interventions, while receiving continuous input from remote sensing. The current work aims at develo** an interpretable, physics-based model that will serve as the core of such a tool. This model is constructed using easily understandable equations, incorporating a limited set of parameters that capture essential quantities and heat transport mechanisms. The simplicity of the model allows for effective utilization of data from sensory input, enabling optimal estimation of these parameters. In particular, simplified versions of combustion kinetics and mass/energy balances lead to a computationally inexpensive system of differential equations that provide the spatio-temporal evolution of temperature and flammables over a two-dimensional region. The model is validated by comparing its predictions and the effect of parameters such as flammable bulk density, moisture content, and wind speed, with benchmark results. Additionally, the model successfully captures the evolution of the firefront shape and its rate of spread in multiple directions. △ Less

Submitted 27 May, 2023; originally announced June 2023.

Discovering Individual Rewards in Collective Behavior through Inverse Multi-Agent Reinforcement Learning

Authors: Daniel Waelchli, Pascal Weber, Petros Koumoutsakos

Abstract: The discovery of individual objectives in collective behavior of complex dynamical systems such as fish schools and bacteria colonies is a long-standing challenge. Inverse reinforcement learning is a potent approach for addressing this challenge but its applicability to dynamical systems, involving continuous state-action spaces and multiple interacting agents, has been limited. In this study, we… ▽ More The discovery of individual objectives in collective behavior of complex dynamical systems such as fish schools and bacteria colonies is a long-standing challenge. Inverse reinforcement learning is a potent approach for addressing this challenge but its applicability to dynamical systems, involving continuous state-action spaces and multiple interacting agents, has been limited. In this study, we tackle this challenge by introducing an off-policy inverse multi-agent reinforcement learning algorithm (IMARL). Our approach combines the ReF-ER techniques with guided cost learning. By leveraging demonstrations, our algorithm automatically uncovers the reward function and learns an effective policy for the agents. Through extensive experimentation, we demonstrate that the proposed policy captures the behavior observed in the provided data, and achieves promising results across problem domains including single agent models in the OpenAI gym and multi-agent models of schooling behavior. The present study shows that the proposed IMARL algorithm is a significant step towards understanding collective dynamics from the perspective of its constituents, and showcases its value as a tool for studying complex physical systems exhibiting collective behaviour. △ Less

Submitted 17 May, 2023; originally announced May 2023.

The Volume of Healthy Red Blood Cells is Optimal for Advective Oxygen Transport in Arterioles

Authors: Lucas Amoudruz, Athena Economides, Petros Koumoutsakos

Abstract: Red blood cells (RBCs) are vital for transporting oxygen from the lungs to the body's tissues through the intricate circulatory system. They achieve this by binding and releasing oxygen molecules to the abundant hemoglobin within their cytosol. The volume of RBCs affects the amount of oxygen they can carry, yet whether this volume is optimal for transporting oxygen through the circulatory system r… ▽ More Red blood cells (RBCs) are vital for transporting oxygen from the lungs to the body's tissues through the intricate circulatory system. They achieve this by binding and releasing oxygen molecules to the abundant hemoglobin within their cytosol. The volume of RBCs affects the amount of oxygen they can carry, yet whether this volume is optimal for transporting oxygen through the circulatory system remains an open question. This study explores, through high-fidelity numerical simulations, the impact of RBC volume on advectve oxygen transport efficiency through arterioles which form the area of greatest flow resistance in the circulatory system. The results show that, strikingly, RBCs with volumes similar to those found in vivo are most efficient to transport oxygen through arterioles. The flow resistance is related to the cell-free layer thickness, which is influenced by the shape and the motion of the RBCs: at low volumes RBCs deform and fold while at high volumes RBCs collide and follow more diffuse trajectories. In contrast, RBCs with a healthy volume maximize the cell-free layer thickness, resulting in a more efficient advectve transport of oxygen. △ Less

Submitted 15 April, 2024; v1 submitted 28 April, 2023; originally announced May 2023.

Adaptive learning of effective dynamics: Adaptive real-time, online modeling for complex systems

Authors: Ivica Kičić, Pantelis R. Vlachas, Georgios Arampatzis, Michail Chatzimanolakis, Leonidas Guibas, Petros Koumoutsakos

Abstract: Predictive simulations are essential for applications ranging from weather forecasting to material design. The veracity of these simulations hinges on their capacity to capture the effective system dynamics. Massively parallel simulations predict the systems dynamics by resolving all spatiotemporal scales, often at a cost that prevents experimentation. On the other hand, reduced order models are f… ▽ More Predictive simulations are essential for applications ranging from weather forecasting to material design. The veracity of these simulations hinges on their capacity to capture the effective system dynamics. Massively parallel simulations predict the systems dynamics by resolving all spatiotemporal scales, often at a cost that prevents experimentation. On the other hand, reduced order models are fast but often limited by the linearization of the system dynamics and the adopted heuristic closures. We propose a novel systematic framework that bridges large scale simulations and reduced order models to extract and forecast adaptively the effective dynamics (AdaLED) of multiscale systems. AdaLED employs an autoencoder to identify reduced-order representations of the system dynamics and an ensemble of probabilistic recurrent neural networks (RNNs) as the latent time-stepper. The framework alternates between the computational solver and the surrogate, accelerating learned dynamics while leaving yet-to-be-learned dynamics regimes to the original solver. AdaLED continuously adapts the surrogate to the new dynamics through online training. The transitions between the surrogate and the computational solver are determined by monitoring the prediction accuracy and uncertainty of the surrogate. The effectiveness of AdaLED is demonstrated on three different systems - a Van der Pol oscillator, a 2D reaction-diffusion equation, and a 2D Navier-Stokes flow past a cylinder for varying Reynolds numbers (400 up to 1200), showcasing its ability to learn effective dynamics online, detect unseen dynamics regimes, and provide net speed-ups. To the best of our knowledge, AdaLED is the first framework that couples a surrogate model with a computational solver to achieve online adaptive learning of effective dynamics. It constitutes a potent tool for applications requiring many expensive simulations. △ Less

Submitted 4 April, 2023; originally announced April 2023.

Comments: 34 pages

Flow reconstruction by multiresolution optimization of a discrete loss with automatic differentiation

Authors: Petr Karnakov, Sergey Litvinov, Petros Koumoutsakos

Abstract: We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We inco… ▽ More We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We incorporate this multigrid technique to the ODIL (Optimizing a DIscrete Loss) framework. The multiresolution ODIL (mODIL) accelerates by an order of magnitude the original formalism and improves the avoidance of local minima. Moreover, mODIL accommodates the use of automatic differentiation for calculating the gradients of the loss function, thus facilitating the implementation of the framework. We demonstrate the capabilities of mODIL on a variety of inverse and flow reconstruction problems: solution reconstruction for the Burgers equation, inferring conductivity from temperature measurements, and inferring the body shape from wake velocity measurements in three dimensions. We also provide a comparative study with the related, popular Physics-Informed Neural Networks (PINNs) method. We demonstrate that mODIL has three to five orders of magnitude lower computational cost than PINNs in benchmark problems including simple PDEs and lid-driven cavity problems. Our results suggest that mODIL is a very potent, fast and consistent method for solving inverse problems in fluid mechanics. △ Less

Submitted 24 July, 2023; v1 submitted 8 March, 2023; originally announced March 2023.

Comments: 16 pages, 9 figures

Journal ref: Eur. Phys. J. E 46, 59 (2023)

The stress-free state of human erythrocytes: data driven inference of a transferable RBC model

Authors: Lucas Amoudruz, Athena Economides, Georgios Arampatzis, Petros Koumoutsakos

Abstract: The stress-free state (SFS) of red blood cells (RBCs) is a fundamental reference configuration for the calibration of computational models, yet it remains unknown. Current experimental methods cannot measure the SFS of cells without affecting their mechanical properties while computational postulates are the subject of controversial discussions. Here, we introduce data driven estimates of the SFS… ▽ More The stress-free state (SFS) of red blood cells (RBCs) is a fundamental reference configuration for the calibration of computational models, yet it remains unknown. Current experimental methods cannot measure the SFS of cells without affecting their mechanical properties while computational postulates are the subject of controversial discussions. Here, we introduce data driven estimates of the SFS shape and the visco-elastic properties of RBCs. We employ data from single-cell experiments that include measurements of the equilibrium shape, of stretched cells, and relaxation times of initially stretched RBCs. A hierarchical Bayesian model accounts for these experimental and data heterogeneities. We quantify, for the first time, the SFS of RBCs and use it to introduce a transferable RBC (t-RBC) model. The effectiveness of the proposed model is shown on predictions of unseen experimental conditions during the inference, including the critical stress of transitions between tumbling and tank-treading cells in shear flow. Our findings demonstrate that the proposed t-RBC model provides predictions of blood flows with unprecedented accuracy and quantified uncertainties. △ Less

Submitted 6 March, 2023; originally announced March 2023.

Interpretable reduced-order modeling with time-scale separation

Authors: Sebastian Kaltenbach, Phaedon-Stelios Koutsourelakis, Petros Koumoutsakos

Abstract: Partial Differential Equations (PDEs) with high dimensionality are commonly encountered in computational physics and engineering. However, finding solutions for these PDEs can be computationally expensive, making model-order reduction crucial. We propose such a data-driven scheme that automates the identification of the time-scales involved and can produce stable predictions forward in time as wel… ▽ More Partial Differential Equations (PDEs) with high dimensionality are commonly encountered in computational physics and engineering. However, finding solutions for these PDEs can be computationally expensive, making model-order reduction crucial. We propose such a data-driven scheme that automates the identification of the time-scales involved and can produce stable predictions forward in time as well as under different initial conditions not included in the training data. To this end, we combine a non-linear autoencoder architecture with a time-continuous model for the latent dynamics in the complex space. It readily allows for the inclusion of sparse and irregularly sampled training data. The learned, latent dynamics are interpretable and reveal the different temporal scales involved. We show that this data-driven scheme can automatically learn the independent processes that decompose a system of linear ODEs along the eigenvectors of the system's matrix. Apart from this, we demonstrate the applicability of the proposed framework in a hidden Markov Model and the (discretized) Kuramoto-Shivashinsky (KS) equation. Additionally, we propose a probabilistic version, which captures predictive uncertainties and further improves upon the results of the deterministic framework. △ Less

Submitted 3 March, 2023; originally announced March 2023.

Learning from Predictions: Fusing Training and Autoregressive Inference for Long-Term Spatiotemporal Forecasts

Authors: Pantelis R. Vlachas, Petros Koumoutsakos

Abstract: Recurrent Neural Networks (RNNs) have become an integral part of modeling and forecasting frameworks in areas like natural language processing and high-dimensional dynamical systems such as turbulent fluid flows. To improve the accuracy of predictions, RNNs are trained using the Backpropagation Through Time (BPTT) method to minimize prediction loss. During testing, RNNs are often used in autoregre… ▽ More Recurrent Neural Networks (RNNs) have become an integral part of modeling and forecasting frameworks in areas like natural language processing and high-dimensional dynamical systems such as turbulent fluid flows. To improve the accuracy of predictions, RNNs are trained using the Backpropagation Through Time (BPTT) method to minimize prediction loss. During testing, RNNs are often used in autoregressive scenarios where the output of the network is fed back into the input. However, this can lead to the exposure bias effect, as the network was trained to receive ground-truth data instead of its own predictions. This mismatch between training and testing is compounded when the state distributions are different, and the train and test losses are measured. To address this, previous studies have proposed solutions for language processing networks with probabilistic predictions. Building on these advances, we propose the Scheduled Autoregressive BPTT (BPTT-SA) algorithm for predicting complex systems. Our results show that BPTT-SA effectively reduces iterative error propagation in Convolutional RNNs and Convolutional Autoencoder RNNs, and demonstrate its capabilities in long-term prediction of high-dimensional fluid flows. △ Less

Submitted 21 February, 2023; originally announced February 2023.

Comments: 18 pages

CubismAMR -- A C++ library for Distributed Block-Structured Adaptive Mesh Refinement

Authors: Michail Chatzimanolakis, Pascal Weber, Fabian Wermelinger, Petros Koumoutsakos

Abstract: We present CubismAMR, a C++ library for distributed simulations with block-structured grids and Adaptive Mesh Refinement. A numerical method to solve the incompressible Navier-Stokes equations is proposed, that comes with a novel approach of solving the pressure Poisson equation on an adaptively refined grid. Validation and verification results for the method are presented, for the flow past an im… ▽ More We present CubismAMR, a C++ library for distributed simulations with block-structured grids and Adaptive Mesh Refinement. A numerical method to solve the incompressible Navier-Stokes equations is proposed, that comes with a novel approach of solving the pressure Poisson equation on an adaptively refined grid. Validation and verification results for the method are presented, for the flow past an impulsively started cylinder. △ Less

Submitted 20 June, 2022; v1 submitted 15 June, 2022; originally announced June 2022.

Optimizing a DIscrete Loss (ODIL) to solve forward and inverse problems for partial differential equations using machine learning tools

Authors: Petr Karnakov, Sergey Litvinov, Petros Koumoutsakos

Abstract: We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals that are solved using gradient descent and Newton's methods. We demonstrate the value of this approach on equations that may have missing parameters or where n… ▽ More We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals that are solved using gradient descent and Newton's methods. We demonstrate the value of this approach on equations that may have missing parameters or where no sufficient data is available to form a well-posed initial-value problem. The framework is presented for mesh based discretizations of PDEs and inherits their accuracy, convergence, and conservation properties. It preserves the sparsity of the solutions and is readily applicable to inverse and ill-posed problems. It is applied to PDE-constrained optimization, optical flow, system identification, and data assimilation using gradient descent algorithms including those often deployed in machine learning. We compare ODIL with related approach that represents the solution with neural networks. We compare the two methodologies and demonstrate advantages of ODIL that include significantly higher convergence rates and several orders of magnitude lower computational cost. We evaluate the method on various linear and nonlinear partial differential equations including the Navier-Stokes equations for flow reconstruction problems. △ Less

Submitted 9 May, 2022; originally announced May 2022.

Comments: 7 pages, 5 figures

Journal ref: PNAS Nexus, Volume 3, Issue 1, January 2024, pgae005

Remember and Forget Experience Replay for Multi-Agent Reinforcement Learning

Authors: Pascal Weber, Daniel Wälchli, Mustafa Zeqiri, Petros Koumoutsakos

Abstract: We present the extension of the Remember and Forget for Experience Replay (ReF-ER) algorithm to Multi-Agent Reinforcement Learning (MARL). ReF-ER was shown to outperform state of the art algorithms for continuous control in problems ranging from the OpenAI Gym to complex fluid flows. In MARL, the dependencies between the agents are included in the state-value estimator and the environment dynamics… ▽ More We present the extension of the Remember and Forget for Experience Replay (ReF-ER) algorithm to Multi-Agent Reinforcement Learning (MARL). ReF-ER was shown to outperform state of the art algorithms for continuous control in problems ranging from the OpenAI Gym to complex fluid flows. In MARL, the dependencies between the agents are included in the state-value estimator and the environment dynamics are modeled via the importance weights used by ReF-ER. In collaborative environments, we find the best performance when the value is estimated using individual rewards and we ignore the effects of other actions on the transition map. We benchmark the performance of ReF-ER MARL on the Stanford Intelligent Systems Laboratory (SISL) environments. We find that employing a single feed-forward neural network for the policy and the value function in ReF-ER MARL, outperforms state of the art algorithms that rely on complex neural network architectures. △ Less

Submitted 2 September, 2022; v1 submitted 24 March, 2022; originally announced March 2022.

Scientific multi-agent reinforcement learning for wall-models of turbulent flows

Authors: H. Jane Bae, Petros Koumoutsakos

Abstract: The predictive capabilities of turbulent flow simulations, critical for aerodynamic design and weather prediction, hinge on the choice of turbulence models. The abundance of data from experiments and simulations and the advent of machine learning have provided a boost to turbulence modeling efforts. However, simulations of turbulent flows remain hindered by the inability of heuristics and supervis… ▽ More The predictive capabilities of turbulent flow simulations, critical for aerodynamic design and weather prediction, hinge on the choice of turbulence models. The abundance of data from experiments and simulations and the advent of machine learning have provided a boost to turbulence modeling efforts. However, simulations of turbulent flows remain hindered by the inability of heuristics and supervised learning to model the near-wall dynamics. We address this challenge by introducing scientific multi-agent reinforcement learning (SciMARL) for the discovery of wall models for large-eddy simulations (LES). In SciMARL, discretization points act also as cooperating agents that learn to supply the LES closure model. The agents self-learn using limited data and generalize to extreme Reynolds numbers and previously unseen geometries. The present simulations reduce by several orders of magnitude the computational cost over fully-resolved simulations while reproducing key flow quantities. We believe that SciMARL creates unprecedented capabilities for the simulation of turbulent flows. △ Less

Submitted 1 February, 2022; v1 submitted 21 June, 2021; originally announced June 2021.

Learning swimming escape patterns for larval fish under energy constraints

Authors: Ioannis Mandralis, Pascal Weber, Guido Novati, Petros Koumoutsakos

Abstract: Swimming organisms can escape their predators by creating and harnessing unsteady flow fields through their body motions. Stochastic optimization and flow simulations have identified escape patterns that are consistent with those observed in natural larval swimmers. However, these patterns have been limited by the specification of a particular cost function and depend on a prescribed functional fo… ▽ More Swimming organisms can escape their predators by creating and harnessing unsteady flow fields through their body motions. Stochastic optimization and flow simulations have identified escape patterns that are consistent with those observed in natural larval swimmers. However, these patterns have been limited by the specification of a particular cost function and depend on a prescribed functional form of the body motion. Here, we deploy reinforcement learning to discover swimmer escape patterns for larval fish under energy constraints. The identified patterns include the C-start mechanism, in addition to more energetically efficient escapes. We find that maximizing distance with limited energy requires swimming via short bursts of accelerating motion interlinked with phases of gliding. The present, data efficient, reinforcement learning algorithm results in an array of patterns that reveal practical flow optimization principles for efficient swimming and the methodology can be transferred to the control of aquatic robotic devices operating under energy constraints. △ Less

Submitted 28 June, 2021; v1 submitted 3 May, 2021; originally announced May 2021.

Journal ref: Phys. Rev. Fluids 6, 093101 (2021)

A computational study of expiratory particle transport and vortex dynamics during breathing with and without face masks

Authors: Ali Khosronejad, Seokkoo Kang, Fabian Wermelinger, Petros Koumoutsakos, Fotis Sotiropoulos

Abstract: We present high-fidelity numerical simulations of expiratory biosol transport during normal breathing under indoor, stagnant air conditions with and without a facial mask. We investigate mask efficacy to suppress the spread of saliva particles that is underpinnings existing social distancing recommendations. The present simulations incorporate the effect of human anatomy and consider a spectrum of… ▽ More We present high-fidelity numerical simulations of expiratory biosol transport during normal breathing under indoor, stagnant air conditions with and without a facial mask. We investigate mask efficacy to suppress the spread of saliva particles that is underpinnings existing social distancing recommendations. The present simulations incorporate the effect of human anatomy and consider a spectrum of saliva particulate sizes that ranges from 0.1 micrometers to 10 micrometers while accounting also for their evaporation. The simulations elucidate the vorticity dynamics of human breathing and show that without a facial mask, saliva particulates could travel over 2.2 m away from the person. However, a non-medical grade face mask can drastically reduce saliva particulate propagation to 0.72 m away from the person. This study provides new quantitative evidence that facial masks can successfully suppress the spreading of saliva particulates due to normal breathing in indoor environments. △ Less

Submitted 15 April, 2021; originally announced April 2021.

Computing foaming flows across scales: from breaking waves to microfluidics

Authors: Petr Karnakov, Sergey Litvinov, Petros Koumoutsakos

Abstract: Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage… ▽ More Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage and rupture of the microscopic liquid films at their interface. We present a novel multilayer simulation framework (Multi-VOF) that advances the state of the art in simulation capabilities of foamy flows. The framework introduces a novel scheme for the distinct handling of multiple neighboring bubbles and a new regularization method that produces sharp interfaces and removes spurious fragments. Multi-VOF is verified and validated with experimental results and complemented with open source, efficient scalable software. We demonstrate capturing of bubble crystalline structures in realistic microfluidics devices and foamy flows involving tens of thousands of bubbles in a waterfall. The present multilayer framework extends the classical volume-of-fluid methodology and allows for unprecedented large scale, predictive simulations of flows with multiple interfaces. △ Less

Submitted 2 March, 2021; originally announced March 2021.

Comments: 11 pages, 7 figures, supplementary information, software https://github.com/cselab/aphros

Learning Efficient Navigation in Vortical Flow Fields

Authors: Peter Gunnarson, Ioannis Mandralis, Guido Novati, Petros Koumoutsakos, John O. Dabiri

Abstract: Efficient point-to-point navigation in the presence of a background flow field is important for robotic applications such as ocean surveying. In such applications, robots may only have knowledge of their immediate surroundings or be faced with time-varying currents, which limits the use of optimal control techniques for planning trajectories. Here, we apply a novel Reinforcement Learning algorithm… ▽ More Efficient point-to-point navigation in the presence of a background flow field is important for robotic applications such as ocean surveying. In such applications, robots may only have knowledge of their immediate surroundings or be faced with time-varying currents, which limits the use of optimal control techniques for planning trajectories. Here, we apply a novel Reinforcement Learning algorithm to discover time-efficient navigation policies to steer a fixed-speed swimmer through an unsteady two-dimensional flow field. The algorithm entails inputting environmental cues into a deep neural network that determines the swimmer's actions, and deploying Remember and Forget Experience replay. We find that the resulting swimmers successfully exploit the background flow to reach the target, but that this success depends on the type of sensed environmental cue. Surprisingly, a velocity sensing approach outperformed a bio-mimetic vorticity sensing approach by nearly two-fold in success rate. Equipped with local velocity measurements, the reinforcement learning algorithm achieved near 100% success in reaching the target locations while approaching the time-efficiency of paths found by a global optimal control planner. △ Less

Submitted 21 February, 2021; originally announced February 2021.

Comments: 6 pages, 6 figures

Accelerated Simulations of Molecular Systems through Learning of their Effective Dynamics

Authors: Pantelis R. Vlachas, Julija Zavadlav, Matej Praprotnik, Petros Koumoutsakos

Abstract: Simulations are vital for understanding and predicting the evolution of complex molecular systems. However, despite advances in algorithms and special purpose hardware, accessing the timescales necessary to capture the structural evolution of bio-molecules remains a daunting task. In this work we present a novel framework to advance simulation timescales by up to three orders of magnitude, by lear… ▽ More Simulations are vital for understanding and predicting the evolution of complex molecular systems. However, despite advances in algorithms and special purpose hardware, accessing the timescales necessary to capture the structural evolution of bio-molecules remains a daunting task. In this work we present a novel framework to advance simulation timescales by up to three orders of magnitude, by learning the effective dynamics (LED) of molecular systems. LED augments the equation-free methodology by employing a probabilistic map** between coarse and fine scales using mixture density network (MDN) autoencoders and evolves the non-Markovian latent dynamics using long short-term memory MDNs. We demonstrate the effectiveness of LED in the Müeller-Brown potential, the Trp Cage protein, and the alanine dipeptide. LED identifies explainable reduced-order representations and can generate, at any instant, the respective all-atom molecular trajectories. We believe that the proposed framework provides a dramatic increase to simulation capabilities and opens new horizons for the effective modeling of complex molecular systems. △ Less

Submitted 17 February, 2021; originally announced February 2021.

Independent Control and Path Planning of Microswimmers with a Uniform Magnetic Field

Authors: Lucas Amoudruz, Petros Koumoutsakos

Abstract: Artificial bacteria flagella (ABFs) are magnetic helical micro-swimmers that can be remotely controlled via a uniform, rotating magnetic field. Previous studies have used the heterogeneous response of microswimmers to external magnetic fields for achieving independent control. Here we introduce analytical and reinforcement learning control strategies for path planning to a target by multiple swimm… ▽ More Artificial bacteria flagella (ABFs) are magnetic helical micro-swimmers that can be remotely controlled via a uniform, rotating magnetic field. Previous studies have used the heterogeneous response of microswimmers to external magnetic fields for achieving independent control. Here we introduce analytical and reinforcement learning control strategies for path planning to a target by multiple swimmers using a uniform magnetic field. The comparison of the two algorithms shows the superiority of reinforcement learning in achieving minimal travel time to a target. The results demonstrate, for the first time, the effective independent navigation of realistic micro-swimmers with a uniform magnetic field in a viscous flow field. △ Less

Submitted 4 January, 2022; v1 submitted 26 January, 2021; originally announced January 2021.

Improved Memories Learning

Authors: Francesco Varoli, Guido Novati, Pantelis R. Vlachas, Petros Koumoutsakos

Abstract: We propose Improved Memories Learning (IMeL), a novel algorithm that turns reinforcement learning (RL) into a supervised learning (SL) problem and delimits the role of neural networks (NN) to interpolation. IMeL consists of two components. The first is a reservoir of experiences. Each experience is updated based on a non-parametric procedural improvement of the policy, computed as a bounded one-sa… ▽ More We propose Improved Memories Learning (IMeL), a novel algorithm that turns reinforcement learning (RL) into a supervised learning (SL) problem and delimits the role of neural networks (NN) to interpolation. IMeL consists of two components. The first is a reservoir of experiences. Each experience is updated based on a non-parametric procedural improvement of the policy, computed as a bounded one-sample Monte Carlo estimate. The second is a NN regressor, which receives as input improved experiences from the reservoir (context points) and computes the policy by interpolation. The NN learns to measure the similarity between states in order to compute long-term forecasts by averaging experiences, rather than by encoding the problem structure in the NN parameters. We present preliminary results and propose IMeL as a baseline method for assessing the merits of more complex models and inductive biases. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Multiscale Simulations of Complex Systems by Learning their Effective Dynamics

Authors: Pantelis R. Vlachas, Georgios Arampatzis, Caroline Uhler, Petros Koumoutsakos

Abstract: Predictive simulations of complex systems are essential for applications ranging from weather forecasting to drug design. The veracity of these predictions hinges on their capacity to capture the effective system dynamics. Massively parallel simulations predict the system dynamics by resolving all spatiotemporal scales, often at a cost that prevents experimentation while their findings may not all… ▽ More Predictive simulations of complex systems are essential for applications ranging from weather forecasting to drug design. The veracity of these predictions hinges on their capacity to capture the effective system dynamics. Massively parallel simulations predict the system dynamics by resolving all spatiotemporal scales, often at a cost that prevents experimentation while their findings may not allow for generalisation. On the other hand reduced order models are fast but limited by the frequently adopted linearization of the system dynamics and/or the utilization of heuristic closures. Here we present a novel systematic framework that bridges large scale simulations and reduced order models to Learn the Effective Dynamics (LED) of diverse complex systems. The framework forms algorithmic alloys between non-linear machine learning algorithms and the Equation-Free approach for modeling complex systems. LED deploys autoencoders to formulate a map** between fine and coarse-grained representations and evolves the latent space dynamics using recurrent neural networks. The algorithm is validated on benchmark problems and we find that it outperforms state of the art reduced order models in terms of predictability and large scale simulations in terms of cost. LED is applicable to systems ranging from chemistry to fluid mechanics and reduces the computational effort by up to two orders of magnitude while maintaining the prediction accuracy of the full system dynamics. We argue that LED provides a novel potent modality for the accurate prediction of complex systems. △ Less

Submitted 19 October, 2021; v1 submitted 23 June, 2020; originally announced June 2020.

Comments: 39 pages (Appendix included)

Korali: Efficient and Scalable Software Framework for Bayesian Uncertainty Quantification and Stochastic Optimization

Authors: Sergio M. Martin, Daniel Wälchli, Georgios Arampatzis, Athena E. Economides, Petr Karnakov, Petros Koumoutsakos

Abstract: We present Korali, an open-source framework for large-scale Bayesian uncertainty quantification and stochastic optimization. The framework relies on non-intrusive sampling of complex multiphysics models and enables their exploitation for optimization and decision-making. In addition, its distributed sampling engine makes efficient use of massively-parallel architectures while introducing novel fau… ▽ More We present Korali, an open-source framework for large-scale Bayesian uncertainty quantification and stochastic optimization. The framework relies on non-intrusive sampling of complex multiphysics models and enables their exploitation for optimization and decision-making. In addition, its distributed sampling engine makes efficient use of massively-parallel architectures while introducing novel fault tolerance and load balancing mechanisms. We demonstrate these features by interfacing Korali with existing high-performance software such as Aphros, Lammps (CPU-based), and Mirheo (GPU-based) and show efficient scaling for up to 512 nodes of the CSCS Piz Daint supercomputer. Finally, we present benchmarks demonstrating that Korali outperforms related state-of-the-art software frameworks. △ Less

Submitted 11 March, 2021; v1 submitted 27 May, 2020; originally announced May 2020.

Comments: 12 pages, 12 figures

MSC Class: 60-08 ACM Class: G.3

Automating Turbulence Modeling by Multi-Agent Reinforcement Learning

Authors: Guido Novati, Hugues Lascombes de Laroussilhe, Petros Koumoutsakos

Abstract: The modeling of turbulent flows is critical to scientific and engineering problems ranging from aircraft design to weather forecasting and climate prediction. Over the last sixty years numerous turbulence models have been proposed, largely based on physical insight and engineering intuition. Recent advances in machine learning and data science have incited new efforts to complement these approache… ▽ More The modeling of turbulent flows is critical to scientific and engineering problems ranging from aircraft design to weather forecasting and climate prediction. Over the last sixty years numerous turbulence models have been proposed, largely based on physical insight and engineering intuition. Recent advances in machine learning and data science have incited new efforts to complement these approaches. To date, all such efforts have focused on supervised learning which, despite demonstrated promise, encounters difficulties in generalizing beyond the distributions of the training data. In this work we introduce multi-agent reinforcement learning (MARL) as an automated discovery tool of turbulence models. We demonstrate the potential of this approach on Large Eddy Simulations of homogeneous and isotropic turbulence using as reward the recovery of the statistical properties of Direct Numerical Simulations. Here, the closure model is formulated as a control policy enacted by cooperating agents, which detect critical spatio-temporal patterns in the flow field to estimate the unresolved sub-grid scale (SGS) physics. The present results are obtained with state-of-the-art algorithms based on experience replay and compare favorably with established dynamic SGS modeling approaches. Moreover, we show that the present turbulence models generalize across grid sizes and flow conditions as expressed by the Reynolds numbers. △ Less

Submitted 23 October, 2020; v1 submitted 18 May, 2020; originally announced May 2020.

Comments: To be published in Nature Machine Intelligence

Mirheo: High-Performance Mesoscale Simulations for Microfluidics

Authors: Dmitry Alexeev, Lucas Amoudruz, Sergey Litvinov, Petros Koumoutsakos

Abstract: The transport and manipulation of particles and cells in microfluidic devices has become a core methodology in domains ranging from molecular biology to manufacturing and drug design. The rational design and operation of such devices can benefit from simulations that resolve flow-structure interactions at sub-micron resolution. We present a computational tool for large scale, efficient and high th… ▽ More The transport and manipulation of particles and cells in microfluidic devices has become a core methodology in domains ranging from molecular biology to manufacturing and drug design. The rational design and operation of such devices can benefit from simulations that resolve flow-structure interactions at sub-micron resolution. We present a computational tool for large scale, efficient and high throughput mesoscale simulations of fluids and deformable objects at complex microscale geometries. The code employs Dissipative Particle Dynamics for the description of the flow coupled with visco-elastic membrane model for red blood cells and can also handle rigid bodies and complex geometries. The software (MiRheo) is deployed on hybrid GPU/CPU architectures exhibiting unprecedented time-to-solution performance and excellent weak and strong scaling for a number of benchmark problems. MiRheo exploits the capabilities of GPU clusters, leading to speedup of up to 10 in terms of time to solution as compared to state-of-the-art software packages and reaches 90 - 99 percent weak scaling efficiency on 512 nodes of the Piz Daint supercomputer. The software MiRheo, relies on a Python interface to facilitate the solution of complex problems and it is open source. We believe that MiRheo constitutes a potent computational tool that can greatly assist studies of microfluidics. △ Less

Submitted 12 November, 2019; originally announced November 2019.

Comments: 12 pages and 11 figures

Optimal sensing for fish school identification

Authors: Pascal Weber, Georgios Arampatzis, Guido Novati, Siddhartha Verma, Costas Papadimitriou, Petros Koumoutsakos

Abstract: Fish schooling implies an awareness of the swimmers for their companions. In flow mediated environments, in addition to visual cues, pressure and shear sensors on the fish body are critical for providing quantitative information that assists the quantification of proximity to other swimmers. Here we examine the distribution of sensors on the surface of an artificial swimmer so that it can optimall… ▽ More Fish schooling implies an awareness of the swimmers for their companions. In flow mediated environments, in addition to visual cues, pressure and shear sensors on the fish body are critical for providing quantitative information that assists the quantification of proximity to other swimmers. Here we examine the distribution of sensors on the surface of an artificial swimmer so that it can optimally identify a leading group of swimmers. We employ Bayesian experimental design coupled with two-dimensional Navier Stokes equations for multiple self-propelled swimmers. The follower tracks the school using information from its own surface pressure and shear stress. We demonstrate that the optimal sensor distribution of the follower is qualitatively similar to the distribution of neuromasts on fish. Our results show that it is possible to identify accurately the center of mass and even the number of the leading swimmers using surface only information. △ Less

Submitted 22 October, 2019; originally announced October 2019.

Journal ref: Biomimetics 2020, 5(1), 10

Backpropagation Algorithms and Reservoir Computing in Recurrent Neural Networks for the Forecasting of Complex Spatiotemporal Dynamics

Authors: Pantelis R. Vlachas, Jaideep Pathak, Brian R. Hunt, Themistoklis P. Sapsis, Michelle Girvan, Edward Ott, Petros Koumoutsakos

Abstract: We examine the efficiency of Recurrent Neural Networks in forecasting the spatiotemporal dynamics of high dimensional and reduced order complex systems using Reservoir Computing (RC) and Backpropagation through time (BPTT) for gated network architectures. We highlight advantages and limitations of each method and discuss their implementation for parallel computing architectures. We quantify the re… ▽ More We examine the efficiency of Recurrent Neural Networks in forecasting the spatiotemporal dynamics of high dimensional and reduced order complex systems using Reservoir Computing (RC) and Backpropagation through time (BPTT) for gated network architectures. We highlight advantages and limitations of each method and discuss their implementation for parallel computing architectures. We quantify the relative prediction accuracy of these algorithms for the longterm forecasting of chaotic systems using as benchmarks the Lorenz-96 and the Kuramoto-Sivashinsky (KS) equations. We find that, when the full state dynamics are available for training, RC outperforms BPTT approaches in terms of predictive performance and in capturing of the long-term statistics, while at the same time requiring much less training time. However, in the case of reduced order data, large scale RC models can be unstable and more likely than the BPTT algorithms to diverge. In contrast, RNNs trained via BPTT show superior forecasting abilities and capture well the dynamics of reduced order systems. Furthermore, the present study quantifies for the first time the Lyapunov Spectrum of the KS equation with BPTT, achieving similar accuracy as RC. This study establishes that RNNs are a potent computational framework for the learning and forecasting of complex spatiotemporal systems. △ Less

Submitted 17 February, 2020; v1 submitted 9 October, 2019; originally announced October 2019.

Comments: 41 pages, submitted to Elsevier Journal of Neural Networks (accepted)

Bubbles in Turbulent Flows: Data-driven, kinematic models with memory terms

Authors: Zhong Yi Wan, Petr Karnakov, Petros Koumoutsakos, Themistoklis P. Sapsis

Abstract: We present data driven kinematic models for the motion of bubbles in high-Re turbulent fluid flows based on recurrent neural networks with long-short term memory enhancements. The models extend empirical relations, such as Maxey-Riley (MR) and its variants, whose applicability is limited when either the bubble size is large or the flow is very complex. The recurrent neural networks are trained on… ▽ More We present data driven kinematic models for the motion of bubbles in high-Re turbulent fluid flows based on recurrent neural networks with long-short term memory enhancements. The models extend empirical relations, such as Maxey-Riley (MR) and its variants, whose applicability is limited when either the bubble size is large or the flow is very complex. The recurrent neural networks are trained on the trajectories of bubbles obtained by Direct Numerical Simulations (DNS) of the Navier Stokes equations for a two-component incompressible flow model. Long short term memory components exploit the time history of the flow field that the bubbles have encountered along their trajectories and the networks are further augmented by imposing rotational invariance to their structure. We first train and validate the formulated model using DNS data for a turbulent Taylor-Green vortex. Then we examine the model predictive capabilities and its generalization to Reynolds numbers that are different from those of the training data on benchmark problems, including a steady (Hill's spherical vortex) and an unsteady (Gaussian vortex ring) flow field. We find that the predictions of the developed model are significantly improved compared with those obtained by the MR equation. Our results indicate that data-driven models with history terms are well suited in capturing the trajectories of bubbles in turbulent flows. △ Less

Submitted 4 October, 2019; originally announced October 2019.

Comments: Submitted to International Journal of Multiphase Flow

Optimal sensor placement for artificial swimmers

Authors: Siddhartha Verma, Costas Papadimitriou, Nora Luethen, Georgios Arampatzis, Petros Koumoutsakos

Abstract: Natural swimmers rely for their survival on sensors that gather information from the environment and guide their actions. The spatial organization of these sensors, such as the visual fish system and lateral line, suggests evolutionary selection, but their optimality remains an open question. Here, we identify sensor configurations that enable swimmers to maximize the information gathered from the… ▽ More Natural swimmers rely for their survival on sensors that gather information from the environment and guide their actions. The spatial organization of these sensors, such as the visual fish system and lateral line, suggests evolutionary selection, but their optimality remains an open question. Here, we identify sensor configurations that enable swimmers to maximize the information gathered from their surrounding flow field. We examine two-dimensional, self-propelled and stationary swimmers that are exposed to disturbances generated by oscillating, rotating and D-shaped cylinders. We combine simulations of the Navier-Stokes equations with Bayesian experimental design to determine the optimal arrangements of shear and pressure sensors that best identify the locations of the disturbance-generating sources. We find a marked tendency for shear stress sensors to be located in the head and the tail of the swimmer, while they are absent from the midsection. In turn, we find a high density of pressure sensors in the head along with a uniform distribution along the entire body. The resulting optimal sensor arrangements resemble neuromast distributions observed in fish and provide evidence for optimality in sensor distribution for natural swimmers. △ Less

Submitted 17 September, 2019; v1 submitted 18 June, 2019; originally announced June 2019.

A hybrid particle volume-of-fluid method for curvature estimation in multiphase flows

Authors: Petr Karnakov, Sergey Litvinov, Petros Koumoutsakos

Abstract: We present a particle method for estimating the curvature of interfaces in volume-of-fluid simulations of multiphase flows. The method is well suited for under-resolved interfaces, and it is shown to be more accurate than the parabolic fitting that is employed in such cases. The curvature is computed from the equilibrium positions of particles constrained to circular arcs and attracted to the inte… ▽ More We present a particle method for estimating the curvature of interfaces in volume-of-fluid simulations of multiphase flows. The method is well suited for under-resolved interfaces, and it is shown to be more accurate than the parabolic fitting that is employed in such cases. The curvature is computed from the equilibrium positions of particles constrained to circular arcs and attracted to the interface. The proposed particle method is combined with the method of height functions at higher resolutions, and it is shown to outperform the current combinations of height functions and parabolic fitting. The algorithm is conceptually simple and straightforward to implement on new and existing software frameworks for multiphase flow simulations thus enhancing their capabilities in challenging flow problems. We evaluate the proposed hybrid method on a number of two- and three-dimensional benchmark flow problems and illustrate its capabilities on simulations of flows involving bubble coalescence and turbulent multiphase flows. △ Less

Submitted 22 January, 2020; v1 submitted 1 June, 2019; originally announced June 2019.

Comments: 25 pages, 33 figures

Machine Learning for Fluid Mechanics

Authors: Steven Brunton, Bernd Noack, Petros Koumoutsakos

Abstract: The field of fluid mechanics is rapidly advancing, driven by unprecedented volumes of data from field measurements, experiments and large-scale simulations at multiple spatiotemporal scales. Machine learning offers a wealth of techniques to extract information from data that could be translated into knowledge about the underlying fluid mechanics. Moreover, machine learning algorithms can augment d… ▽ More The field of fluid mechanics is rapidly advancing, driven by unprecedented volumes of data from field measurements, experiments and large-scale simulations at multiple spatiotemporal scales. Machine learning offers a wealth of techniques to extract information from data that could be translated into knowledge about the underlying fluid mechanics. Moreover, machine learning algorithms can augment domain knowledge and automate tasks related to flow control and optimization. This article presents an overview of past history, current developments, and emerging opportunities of machine learning for fluid mechanics. It outlines fundamental machine learning methodologies and discusses their uses for understanding, modeling, optimizing, and controlling fluid flows. The strengths and limitations of these methods are addressed from the perspective of scientific inquiry that considers data as an inherent part of modeling, experimentation, and simulation. Machine learning provides a powerful information processing framework that can enrich, and possibly even transform, current lines of fluid mechanics research and industrial applications. △ Less

Submitted 4 January, 2020; v1 submitted 27 May, 2019; originally announced May 2019.

Comments: To appear in the Annual Reviews of Fluid Mechanics, 2020

Bending models of lipid bilayer membranes: spontaneous curvature and area-difference elasticity

Authors: Xin Bian, Sergey Litvinov, Petros Koumoutsakos

Abstract: We preset a computational study of bending models for the curvature elasticity of lipid bilayer membranes that are relevant for simulations of vesicles and red blood cells. We compute bending energy and forces on triangulated meshes and evaluate and extend four well established schemes for their approximation: Kantor and Nelson 1987, Phys. Rev. A 36, 4020, Jülicher 1996, J. Phys. II France 6, 1797… ▽ More We preset a computational study of bending models for the curvature elasticity of lipid bilayer membranes that are relevant for simulations of vesicles and red blood cells. We compute bending energy and forces on triangulated meshes and evaluate and extend four well established schemes for their approximation: Kantor and Nelson 1987, Phys. Rev. A 36, 4020, Jülicher 1996, J. Phys. II France 6, 1797, Gompper and Kroll 1996, J. Phys. I France 6, 1305, and Meyer et. al. 2003 in Visualization and Mathematics III, Springer, p35, termed A, B, C, D. We present a comparative study of these four schemes on the minimal bending model and propose extensions for schemes B, C and D. These extensions incorporate the reference state and non-local energy to account for the spontaneous curvature, bilayer coupling, and area-difference elasticity models. Our results indicate that the proposed extensions enhance the models to account for shape transformation including budding/vesiculation as well as for non-axisymmetric shapes. We find that the extended scheme B is superior to the rest in terms of accuracy, and robustness as well as simplicity of implementation. We demonstrate the capabilities of this scheme on several benchmark problems including the budding-vesiculating process and the reproduction of the phase diagram of vesicles. △ Less

Submitted 1 May, 2019; originally announced May 2019.

MSC Class: 74S30; 53Z05

Bayesian selection for coarse-grained models of liquid water

Authors: Julija Zavadlav, Georgios Arampatzis, Petros Koumoutsakos

Abstract: The necessity for accurate and computationally efficient representations of water in atomistic simulations that can span biologically relevant timescales has born the necessity of coarse-grained (CG) modeling. Despite numerous advances, CG water models rely mostly on a-priori specified assumptions. How these assumptions affect the model accuracy, efficiency, and in particular transferability, has… ▽ More The necessity for accurate and computationally efficient representations of water in atomistic simulations that can span biologically relevant timescales has born the necessity of coarse-grained (CG) modeling. Despite numerous advances, CG water models rely mostly on a-priori specified assumptions. How these assumptions affect the model accuracy, efficiency, and in particular transferability, has not been systematically investigated. Here we propose a data driven, comparison and selection for CG water models through a Hierarchical Bayesian framework. We examine CG water models that differ in their level of coarse-graining, structure, and number of interaction sites. We find that the importance of electrostatic interactions for the physical system under consideration is a dominant criterion for the model selection. Multi-site models are favored, unless the effects of water in electrostatic screening are not relevant, in which case the single site model is preferred due to its computational savings. The charge distribution is found to play an important role in the multi-site model's accuracy while the flexibility of the bonds/angles may only slightly improve the models. Furthermore, we find significant variations in the computational cost of these models. We present a data informed rationale for the selection of CG water models and provide guidance for future water model designs. △ Less

Submitted 10 October, 2018; originally announced October 2018.

Remember and Forget for Experience Replay

Authors: Guido Novati, Petros Koumoutsakos

Abstract: Experience replay (ER) is a fundamental component of off-policy deep reinforcement learning (RL). ER recalls experiences from past iterations to compute gradient estimates for the current policy, increasing data-efficiency. However, the accuracy of such updates may deteriorate when the policy diverges from past behaviors and can undermine the performance of ER. Many algorithms mitigate this issue… ▽ More Experience replay (ER) is a fundamental component of off-policy deep reinforcement learning (RL). ER recalls experiences from past iterations to compute gradient estimates for the current policy, increasing data-efficiency. However, the accuracy of such updates may deteriorate when the policy diverges from past behaviors and can undermine the performance of ER. Many algorithms mitigate this issue by tuning hyper-parameters to slow down policy changes. An alternative is to actively enforce the similarity between policy and the experiences in the replay memory. We introduce Remember and Forget Experience Replay (ReF-ER), a novel method that can enhance RL algorithms with parameterized policies. ReF-ER (1) skips gradients computed from experiences that are too unlikely with the current policy and (2) regulates policy changes within a trust region of the replayed behaviors. We couple ReF-ER with Q-learning, deterministic policy gradient and off-policy gradient methods. We find that ReF-ER consistently improves the performance of continuous-action, off-policy RL on fully observable benchmarks and partially observable flow control problems. △ Less

Submitted 20 May, 2019; v1 submitted 16 July, 2018; originally announced July 2018.

Deep-Reinforcement-Learning for Gliding and Perching Bodies

Authors: Guido Novati, Lakshminarayanan Mahadevan, Petros Koumoutsakos

Abstract: Controlled gliding is one of the most energetically efficient modes of transportation for natural and human powered fliers. Here we demonstrate that gliding and landing strategies with different optimality criteria can be identified through deep reinforcement learning without explicit knowledge of the underlying physics. We combine a two dimensional model of a controlled elliptical body with deep… ▽ More Controlled gliding is one of the most energetically efficient modes of transportation for natural and human powered fliers. Here we demonstrate that gliding and landing strategies with different optimality criteria can be identified through deep reinforcement learning without explicit knowledge of the underlying physics. We combine a two dimensional model of a controlled elliptical body with deep reinforcement learning (D-RL) to achieve gliding with either minimum energy expenditure, or fastest time of arrival, at a predetermined location. In both cases the gliding trajectories are smooth, although energy/time optimal strategies are distinguished by small/high frequency actuations. We examine the effects of the ellipse's shape and weight on the optimal policies for controlled gliding. Surprisingly, we find that the model-free reinforcement learning leads to more robust gliding than model-based optimal control strategies with a modest additional computational cost. We also demonstrate that the gliders with D-RL can generalize their strategies to reach the target location from previously unseen starting positions. The model-free character and robustness of D-RL suggests a promising framework for develo** mechanical devices capable of exploiting complex flow environments. △ Less

Submitted 7 July, 2018; originally announced July 2018.

Personalized Radiotherapy Design for Glioblastoma: Integrating Mathematical Tumor Models, Multimodal Scans and Bayesian Inference

Authors: Jana Lipkova, Panagiotis Angelikopoulos, Stephen Wu, Esther Alberts, Benedikt Wiestler, Christian Diehl, Christine Preibisch, Thomas Pyka, Stephanie Combs, Panagiotis Hadjidoukas, Koen Van Leemput, Petros Koumoutsakos, John S. Lowengrub, Bjoern Menze

Abstract: Glioblastoma is a highly invasive brain tumor, whose cells infiltrate surrounding normal brain tissue beyond the lesion outlines visible in the current medical scans. These infiltrative cells are treated mainly by radiotherapy. Existing radiotherapy plans for brain tumors derive from population studies and scarcely account for patient-specific conditions. Here we provide a Bayesian machine learnin… ▽ More Glioblastoma is a highly invasive brain tumor, whose cells infiltrate surrounding normal brain tissue beyond the lesion outlines visible in the current medical scans. These infiltrative cells are treated mainly by radiotherapy. Existing radiotherapy plans for brain tumors derive from population studies and scarcely account for patient-specific conditions. Here we provide a Bayesian machine learning framework for the rational design of improved, personalized radiotherapy plans using mathematical modeling and patient multimodal medical scans. Our method, for the first time, integrates complementary information from high resolution MRI scans and highly specific FET-PET metabolic maps to infer tumor cell density in glioblastoma patients. The Bayesian framework quantifies imaging and modeling uncertainties and predicts patient-specific tumor cell density with confidence intervals. The proposed methodology relies only on data acquired at a single time point and thus is applicable to standard clinical settings. An initial clinical population study shows that the radiotherapy plans generated from the inferred tumor cell infiltration maps spare more healthy tissue thereby reducing radiation toxicity while yielding comparable accuracy with standard radiotherapy protocols. Moreover, the inferred regions of high tumor cell densities coincide with the tumor radioresistant areas, providing guidance for personalized dose-escalation. The proposed integration of multimodal scans and mathematical modeling provides a robust, non-invasive tool to assist personalized radiotherapy design. △ Less

Submitted 12 March, 2019; v1 submitted 2 July, 2018; originally announced July 2018.

Comments: Copyright (c) 2019 IEEE. Personal use of this material is permitted. However, permission to use this material for any other purposes must be obtained from the IEEE by sending a request to [email protected]. Accepted to IEEE Transactions on Medical Imaging

A Computational Study of the Collapse of a Cloud with 12500 Gas Bubbles in a Liquid

Authors: Ursula Rasthofer, Fabian Wermelinger, Petr Karnakov, Jonas Šukys, Petros Koumoutsakos

Abstract: We investigate the process of cloud cavitation collapse through large-scale simulation of a cloud composed of 12500 gas bubbles. A finite volume scheme is used on a structured Cartesian grid to solve the Euler equations, and the bubbles are discretized by a diffuse interface method. We investigate the propagation of the collapse wave front through the cloud and provide comparisons to simplified mo… ▽ More We investigate the process of cloud cavitation collapse through large-scale simulation of a cloud composed of 12500 gas bubbles. A finite volume scheme is used on a structured Cartesian grid to solve the Euler equations, and the bubbles are discretized by a diffuse interface method. We investigate the propagation of the collapse wave front through the cloud and provide comparisons to simplified models. We analyze the flow field to identify each bubble of the cloud and its associated microjet. We find that the oscillation frequency of the bubbles and the velocity magnitude of the microjets depend on the local strength of the collapse wave and hence on the radial position of the bubbles in the cloud. At the same time, the direction of the microjets is influenced by the distribution of the bubbles in its vicinity. Finally, an analysis of the pressure pulse spectrum shows that the pressure pulse rate is well captured by an exponential law. △ Less

Submitted 30 April, 2018; originally announced April 2018.

Comments: 24 pages, 22 figures

Journal ref: Phys. Rev. Fluids 4, 063602 (2019)

Data-assisted reduced-order modeling of extreme events in complex dynamical systems

Authors: Zhong Yi Wan, Pantelis R. Vlachas, Petros Koumoutsakos, Themistoklis P. Sapsis

Abstract: Dynamical systems with high intrinsic dimensionality are often characterized by extreme events having the form of rare transitions several standard deviations away from the mean. For such systems, order-reduction methods through projection of the governing equations have limited applicability due to the large intrinsic dimensionality of the underlying attractor but also the complexity of the trans… ▽ More Dynamical systems with high intrinsic dimensionality are often characterized by extreme events having the form of rare transitions several standard deviations away from the mean. For such systems, order-reduction methods through projection of the governing equations have limited applicability due to the large intrinsic dimensionality of the underlying attractor but also the complexity of the transient events. An alternative approach is data-driven techniques that aim to quantify the dynamics of specific modes utilizing data-streams. Several of these approaches have improved performance by expanding the state representation using delayed coordinates. However, such strategies are limited in regions of the phase space where there is a small amount of data available, as is the case for extreme events. In this work, we develop a blended framework that integrates an imperfect model, obtained from projecting equations into a subspace that still contains crucial dynamical information, with data-streams through a recurrent neural network (RNN) architecture. In particular, we employ the long-short-term memory (LSTM), to model portions of the dynamics which cannot be accounted by the equations. The RNN is trained by analyzing the mismatch between the imperfect model and the data-streams, projected in the reduced-order space. In this way, the data-driven model improves the imperfect model in regions where data is available, while for locations where data is sparse the imperfect model still provides a baseline for the prediction of the system dynamics. We assess the developed framework on two challenging prototype systems exhibiting extreme events and show that the blended approach has improved performance compared with methods that use either data streams or the imperfect model alone. The improvement is more significant in regions associated with extreme events, where data is sparse. △ Less

Submitted 30 April, 2018; v1 submitted 8 March, 2018; originally announced March 2018.

Comments: Submitted to PLOS ONE on March 8, 2018

Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks

Authors: Pantelis R. Vlachas, Wonmin Byeon, Zhong Y. Wan, Themistoklis P. Sapsis, Petros Koumoutsakos

Abstract: We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in their reduced order space and are shown to be an effective set of nonlinear approximators of their attractor. We demonstrate the forecasting performance of the L… ▽ More We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in their reduced order space and are shown to be an effective set of nonlinear approximators of their attractor. We demonstrate the forecasting performance of the LSTM and compare it with Gaussian processes (GPs) in time series obtained from the Lorenz 96 system, the Kuramoto-Sivashinsky equation and a prototype climate model. The LSTM networks outperform the GPs in short-term forecasting accuracy in all applications considered. A hybrid architecture, extending the LSTM with a mean stochastic model (MSM-LSTM), is proposed to ensure convergence to the invariant measure. This novel hybrid method is fully data-driven and extends the forecasting capabilities of LSTM networks. △ Less

Submitted 19 September, 2019; v1 submitted 21 February, 2018; originally announced February 2018.

Comments: 31 pages

Efficient collective swimming by harnessing vortices through deep reinforcement learning

Authors: Siddhartha Verma, Guido Novati, Petros Koumoutsakos

Abstract: Fish in schooling formations navigate complex flow-fields replete with mechanical energy in the vortex wakes of their companions. Their schooling behaviour has been associated with evolutionary advantages including collective energy savings. How fish harvest energy from their complex fluid environment and the underlying physical mechanisms governing energy-extraction during collective swimming, is… ▽ More Fish in schooling formations navigate complex flow-fields replete with mechanical energy in the vortex wakes of their companions. Their schooling behaviour has been associated with evolutionary advantages including collective energy savings. How fish harvest energy from their complex fluid environment and the underlying physical mechanisms governing energy-extraction during collective swimming, is still unknown. Here we show that fish can improve their sustained propulsive efficiency by actively following, and judiciously intercepting, vortices in the wake of other swimmers. This swimming strategy leads to collective energy-savings and is revealed through the first ever combination of deep reinforcement learning with high-fidelity flow simulations. We find that a `smart-swimmer' can adapt its position and body deformation to synchronise with the momentum of the oncoming vortices, improving its average swimming-efficiency at no cost to the leader. The results show that fish may harvest energy deposited in vortices produced by their peers, and support the conjecture that swimming in formation is energetically advantageous. Moreover, this study demonstrates that deep reinforcement learning can produce navigation algorithms for complex flow-fields, with promising implications for energy savings in autonomous robotic swarms. △ Less

Submitted 7 February, 2018; originally announced February 2018.

Comments: 26 pages, 14 figures

$S$-Lea**: An adaptive, accelerated stochastic simulation algorithm, bridging $τ$-lea** and $R$-lea**

Authors: Jana Lipková, Georgios Arampatzis, Philippe Chatelain, Bjoern Menze, Petros Koumoutsakos

Abstract: We propose the $S$-lea** algorithm for the acceleration of Gillespie's stochastic simulation algorithm that combines the advantages of the two main accelerated methods; the $τ$-lea** and $R$-lea** algorithms. These algorithms are known to be efficient under different conditions; the $τ$-lea** is efficient for non-stiff systems or systems with partial equilibrium, while the $R$-lea** perf… ▽ More We propose the $S$-lea** algorithm for the acceleration of Gillespie's stochastic simulation algorithm that combines the advantages of the two main accelerated methods; the $τ$-lea** and $R$-lea** algorithms. These algorithms are known to be efficient under different conditions; the $τ$-lea** is efficient for non-stiff systems or systems with partial equilibrium, while the $R$-lea** performs better in stiff system thanks to an efficient sampling procedure. However, even a small change in a system's set up can critically affect the nature of the simulated system and thus reduce the efficiency of an accelerated algorithm. The proposed algorithm combines the efficient time step selection from the $τ$-lea** with the effective sampling procedure from the $R$-lea** algorithm. The $S$-lea** is shown to maintain its efficiency under different conditions and in the case of large and stiff systems or systems with fast dynamics, the $S$-lea** outperforms both methods. We demonstrate the performance and the accuracy of the $S$-lea** in comparison with the $τ$-lea** and $R$-lea** on a number of benchmark systems involving biological reaction networks. △ Less

Submitted 29 June, 2018; v1 submitted 1 February, 2018; originally announced February 2018.

ContextVP: Fully Context-Aware Video Prediction

Authors: Wonmin Byeon, Qin Wang, Rupesh Kumar Srivastava, Petros Koumoutsakos

Abstract: Video prediction models based on convolutional networks, recurrent networks, and their combinations often result in blurry predictions. We identify an important contributing factor for imprecise predictions that has not been studied adequately in the literature: blind spots, i.e., lack of access to all relevant past information for accurately predicting the future. To address this issue, we introd… ▽ More Video prediction models based on convolutional networks, recurrent networks, and their combinations often result in blurry predictions. We identify an important contributing factor for imprecise predictions that has not been studied adequately in the literature: blind spots, i.e., lack of access to all relevant past information for accurately predicting the future. To address this issue, we introduce a fully context-aware architecture that captures the entire available past context for each pixel using Parallel Multi-Dimensional LSTM units and aggregates it using blending units. Our model outperforms a strong baseline network of 20 recurrent convolutional layers and yields state-of-the-art performance for next step prediction on three challenging real-world video datasets: Human 3.6M, Caltech Pedestrian, and UCF-101. Moreover, it does so with fewer parameters than several recently proposed models, and does not rely on deep convolutional networks, multi-scale architectures, separation of background and foreground modeling, motion flow learning, or adversarial training. These results highlight that full awareness of past context is of crucial importance for video prediction. △ Less

Submitted 9 September, 2018; v1 submitted 23 October, 2017; originally announced October 2017.

Comments: 19 pages. ECCV 2018 oral presentation. Project webpage is at https://wonmin-byeon.github.io/publication/2018-eccv

Data-driven prediction and origin identification of epidemics in population networks

Authors: Karen Larson, Clark Bowman, Zhizhong Chen, Panagiotis Hadjidoukas, Costas Papadimitriou, Petros Koumoutsakos, Anastasios Matzavinos

Abstract: Effective intervention strategies for epidemics rely on the identification of their origin and on the robustness of the predictions made by network disease models. We introduce a Bayesian uncertainty quantification framework to infer model parameters for a disease spreading on a network of communities from limited, noisy observations; the state-of-the-art computational framework compensates for th… ▽ More Effective intervention strategies for epidemics rely on the identification of their origin and on the robustness of the predictions made by network disease models. We introduce a Bayesian uncertainty quantification framework to infer model parameters for a disease spreading on a network of communities from limited, noisy observations; the state-of-the-art computational framework compensates for the model complexity by exploiting massively parallel computing architectures. Using noisy, synthetic data, we show the potential of the approach to perform robust model fitting and additionally demonstrate that we can effectively identify the disease origin via Bayesian model selection. As disease-related data are increasingly available, the proposed framework has broad practical relevance for the prediction and management of epidemics. △ Less

Submitted 1 April, 2020; v1 submitted 21 October, 2017; originally announced October 2017.

MSC Class: 62P10; 92-08

Experimental data over quantum mechanics simulations for inferring the repulsive exponent of the Lennard-Jones potential in Molecular Dynamics

Authors: Lina Kulakova, Georgios Arampatzis, Panagiotis Angelikopoulos, Panagiotis Chatzidoukas, Costas Papadimitriou, Petros Koumoutsakos

Abstract: The Lennard-Jones (LJ) potential is a cornerstone of Molecular Dynamics (MD) simulations and among the most widely used computational kernels in science. The potential models atomistic attraction and repulsion with century old prescribed parameters ($q=6, \; p=12$, respectively), originally related by a factor of two for simplicity of calculations. We re-examine the value of the repulsion exponent… ▽ More The Lennard-Jones (LJ) potential is a cornerstone of Molecular Dynamics (MD) simulations and among the most widely used computational kernels in science. The potential models atomistic attraction and repulsion with century old prescribed parameters ($q=6, \; p=12$, respectively), originally related by a factor of two for simplicity of calculations. We re-examine the value of the repulsion exponent through data driven uncertainty quantification. We perform Hierarchical Bayesian inference on MD simulations of argon using experimental data of the radial distribution function (RDF) for a range of thermodynamic conditions, as well as dimer interaction energies from quantum mechanics simulations. The experimental data suggest a repulsion exponent ($p \approx 6.5$), in contrast to the quantum simulations data that support values closer to the original ($p=12$) exponent. Most notably, we find that predictions of RDF, diffusion coefficient and density of argon are more accurate and robust in producing the correct argon phase around its triple point, when using the values inferred from experimental data over those from quantum mechanics simulations. The present results suggest the need for data driven recalibration of the LJ potential across MD simulations. △ Less

Submitted 16 May, 2017; originally announced May 2017.

Optimal fidelity multi-level Monte Carlo for quantification of uncertainty in simulations of cloud cavitation collapse

Authors: Jonas Šukys, Ursula Rasthofer, Fabian Wermelinger, Panagiotis Hadjidoukas, Petros Koumoutsakos

Abstract: We quantify uncertainties in the location and magnitude of extreme pressure spots revealed from large scale multi-phase flow simulations of cloud cavitation collapse. We examine clouds containing 500 cavities and quantify uncertainties related to their initial spatial arrangement. The resulting 2000-dimensional space is sampled using a non-intrusive and computationally efficient Multi-Level Monte… ▽ More We quantify uncertainties in the location and magnitude of extreme pressure spots revealed from large scale multi-phase flow simulations of cloud cavitation collapse. We examine clouds containing 500 cavities and quantify uncertainties related to their initial spatial arrangement. The resulting 2000-dimensional space is sampled using a non-intrusive and computationally efficient Multi-Level Monte Carlo (MLMC) methodology. We introduce novel optimal control variate coefficients to enhance the variance reduction in MLMC. The proposed optimal fidelity MLMC leads to more than two orders of magnitude speedup when compared to standard Monte Carlo methods. We identify large uncertainties in the location and magnitude of the peak pressure pulse and present its statistical correlations and joint probability density functions with the geometrical characteristics of the cloud. Characteristic properties of spatial cloud structure are identified as potential causes of significant uncertainties in exerted collapse pressures. △ Less

Submitted 11 May, 2017; originally announced May 2017.

MSC Class: 76B10; 68W10; 65C05; 65C60; 68M15