-
Individualizing Glioma Radiotherapy Planning by Optimization of Data and Physics-Informed Discrete Loss
Authors:
Michal Balcerak,
Jonas Weidner,
Petr Karnakov,
Ivan Ezhov,
Sergey Litvinov,
Petros Koumoutsakos,
Ray Zirui Zhang,
John S. Lowengrub,
Bene Wiestler,
Bjoern Menze
Abstract:
Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to…
▽ More
Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to target this invisible tumor growth. This "one size fits all" approach is derived from population studies and often fails to account for the nuances of individual patient conditions. We present the GliODIL framework, which infers the full spatial distribution of tumor cell concentration from available multi-modal imaging, leveraging a Fisher-Kolmogorov type physics model to describe tumor growth. This is achieved through the newly introduced method of Optimizing the Discrete Loss (ODIL), where both data and physics-based constraints are softly assimilated into the solution. Our test dataset comprises 152 glioblastoma patients with pre-treatment imaging and post-treatment follow-ups for tumor recurrence monitoring. By blending data-driven techniques with physics-based constraints, GliODIL enhances recurrence prediction in radiotherapy planning, challenging traditional uniform margins and strict adherence to the Fisher-Kolmogorov partial differential equation (PDE) model, which is adapted for complex cases.
△ Less
Submitted 14 April, 2024; v1 submitted 8 December, 2023;
originally announced December 2023.
-
Flow reconstruction by multiresolution optimization of a discrete loss with automatic differentiation
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We inco…
▽ More
We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We incorporate this multigrid technique to the ODIL (Optimizing a DIscrete Loss) framework. The multiresolution ODIL (mODIL) accelerates by an order of magnitude the original formalism and improves the avoidance of local minima. Moreover, mODIL accommodates the use of automatic differentiation for calculating the gradients of the loss function, thus facilitating the implementation of the framework. We demonstrate the capabilities of mODIL on a variety of inverse and flow reconstruction problems: solution reconstruction for the Burgers equation, inferring conductivity from temperature measurements, and inferring the body shape from wake velocity measurements in three dimensions. We also provide a comparative study with the related, popular Physics-Informed Neural Networks (PINNs) method. We demonstrate that mODIL has three to five orders of magnitude lower computational cost than PINNs in benchmark problems including simple PDEs and lid-driven cavity problems. Our results suggest that mODIL is a very potent, fast and consistent method for solving inverse problems in fluid mechanics.
△ Less
Submitted 24 July, 2023; v1 submitted 8 March, 2023;
originally announced March 2023.
-
Optimizing a DIscrete Loss (ODIL) to solve forward and inverse problems for partial differential equations using machine learning tools
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals that are solved using gradient descent and Newton's methods. We demonstrate the value of this approach on equations that may have missing parameters or where n…
▽ More
We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals that are solved using gradient descent and Newton's methods. We demonstrate the value of this approach on equations that may have missing parameters or where no sufficient data is available to form a well-posed initial-value problem. The framework is presented for mesh based discretizations of PDEs and inherits their accuracy, convergence, and conservation properties. It preserves the sparsity of the solutions and is readily applicable to inverse and ill-posed problems. It is applied to PDE-constrained optimization, optical flow, system identification, and data assimilation using gradient descent algorithms including those often deployed in machine learning. We compare ODIL with related approach that represents the solution with neural networks. We compare the two methodologies and demonstrate advantages of ODIL that include significantly higher convergence rates and several orders of magnitude lower computational cost. We evaluate the method on various linear and nonlinear partial differential equations including the Navier-Stokes equations for flow reconstruction problems.
△ Less
Submitted 9 May, 2022;
originally announced May 2022.
-
Computing foaming flows across scales: from breaking waves to microfluidics
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage…
▽ More
Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage and rupture of the microscopic liquid films at their interface. We present a novel multilayer simulation framework (Multi-VOF) that advances the state of the art in simulation capabilities of foamy flows. The framework introduces a novel scheme for the distinct handling of multiple neighboring bubbles and a new regularization method that produces sharp interfaces and removes spurious fragments. Multi-VOF is verified and validated with experimental results and complemented with open source, efficient scalable software. We demonstrate capturing of bubble crystalline structures in realistic microfluidics devices and foamy flows involving tens of thousands of bubbles in a waterfall. The present multilayer framework extends the classical volume-of-fluid methodology and allows for unprecedented large scale, predictive simulations of flows with multiple interfaces.
△ Less
Submitted 2 March, 2021;
originally announced March 2021.
-
Korali: Efficient and Scalable Software Framework for Bayesian Uncertainty Quantification and Stochastic Optimization
Authors:
Sergio M. Martin,
Daniel Wälchli,
Georgios Arampatzis,
Athena E. Economides,
Petr Karnakov,
Petros Koumoutsakos
Abstract:
We present Korali, an open-source framework for large-scale Bayesian uncertainty quantification and stochastic optimization. The framework relies on non-intrusive sampling of complex multiphysics models and enables their exploitation for optimization and decision-making. In addition, its distributed sampling engine makes efficient use of massively-parallel architectures while introducing novel fau…
▽ More
We present Korali, an open-source framework for large-scale Bayesian uncertainty quantification and stochastic optimization. The framework relies on non-intrusive sampling of complex multiphysics models and enables their exploitation for optimization and decision-making. In addition, its distributed sampling engine makes efficient use of massively-parallel architectures while introducing novel fault tolerance and load balancing mechanisms. We demonstrate these features by interfacing Korali with existing high-performance software such as Aphros, Lammps (CPU-based), and Mirheo (GPU-based) and show efficient scaling for up to 512 nodes of the CSCS Piz Daint supercomputer. Finally, we present benchmarks demonstrating that Korali outperforms related state-of-the-art software frameworks.
△ Less
Submitted 11 March, 2021; v1 submitted 27 May, 2020;
originally announced May 2020.
-
Bubbles in Turbulent Flows: Data-driven, kinematic models with memory terms
Authors:
Zhong Yi Wan,
Petr Karnakov,
Petros Koumoutsakos,
Themistoklis P. Sapsis
Abstract:
We present data driven kinematic models for the motion of bubbles in high-Re turbulent fluid flows based on recurrent neural networks with long-short term memory enhancements. The models extend empirical relations, such as Maxey-Riley (MR) and its variants, whose applicability is limited when either the bubble size is large or the flow is very complex. The recurrent neural networks are trained on…
▽ More
We present data driven kinematic models for the motion of bubbles in high-Re turbulent fluid flows based on recurrent neural networks with long-short term memory enhancements. The models extend empirical relations, such as Maxey-Riley (MR) and its variants, whose applicability is limited when either the bubble size is large or the flow is very complex. The recurrent neural networks are trained on the trajectories of bubbles obtained by Direct Numerical Simulations (DNS) of the Navier Stokes equations for a two-component incompressible flow model. Long short term memory components exploit the time history of the flow field that the bubbles have encountered along their trajectories and the networks are further augmented by imposing rotational invariance to their structure. We first train and validate the formulated model using DNS data for a turbulent Taylor-Green vortex. Then we examine the model predictive capabilities and its generalization to Reynolds numbers that are different from those of the training data on benchmark problems, including a steady (Hill's spherical vortex) and an unsteady (Gaussian vortex ring) flow field. We find that the predictions of the developed model are significantly improved compared with those obtained by the MR equation. Our results indicate that data-driven models with history terms are well suited in capturing the trajectories of bubbles in turbulent flows.
△ Less
Submitted 4 October, 2019;
originally announced October 2019.
-
A hybrid particle volume-of-fluid method for curvature estimation in multiphase flows
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We present a particle method for estimating the curvature of interfaces in volume-of-fluid simulations of multiphase flows. The method is well suited for under-resolved interfaces, and it is shown to be more accurate than the parabolic fitting that is employed in such cases. The curvature is computed from the equilibrium positions of particles constrained to circular arcs and attracted to the inte…
▽ More
We present a particle method for estimating the curvature of interfaces in volume-of-fluid simulations of multiphase flows. The method is well suited for under-resolved interfaces, and it is shown to be more accurate than the parabolic fitting that is employed in such cases. The curvature is computed from the equilibrium positions of particles constrained to circular arcs and attracted to the interface. The proposed particle method is combined with the method of height functions at higher resolutions, and it is shown to outperform the current combinations of height functions and parabolic fitting. The algorithm is conceptually simple and straightforward to implement on new and existing software frameworks for multiphase flow simulations thus enhancing their capabilities in challenging flow problems. We evaluate the proposed hybrid method on a number of two- and three-dimensional benchmark flow problems and illustrate its capabilities on simulations of flows involving bubble coalescence and turbulent multiphase flows.
△ Less
Submitted 22 January, 2020; v1 submitted 1 June, 2019;
originally announced June 2019.
-
A Computational Study of the Collapse of a Cloud with 12500 Gas Bubbles in a Liquid
Authors:
Ursula Rasthofer,
Fabian Wermelinger,
Petr Karnakov,
Jonas Šukys,
Petros Koumoutsakos
Abstract:
We investigate the process of cloud cavitation collapse through large-scale simulation of a cloud composed of 12500 gas bubbles. A finite volume scheme is used on a structured Cartesian grid to solve the Euler equations, and the bubbles are discretized by a diffuse interface method. We investigate the propagation of the collapse wave front through the cloud and provide comparisons to simplified mo…
▽ More
We investigate the process of cloud cavitation collapse through large-scale simulation of a cloud composed of 12500 gas bubbles. A finite volume scheme is used on a structured Cartesian grid to solve the Euler equations, and the bubbles are discretized by a diffuse interface method. We investigate the propagation of the collapse wave front through the cloud and provide comparisons to simplified models. We analyze the flow field to identify each bubble of the cloud and its associated microjet. We find that the oscillation frequency of the bubbles and the velocity magnitude of the microjets depend on the local strength of the collapse wave and hence on the radial position of the bubbles in the cloud. At the same time, the direction of the microjets is influenced by the distribution of the bubbles in its vicinity. Finally, an analysis of the pressure pulse spectrum shows that the pressure pulse rate is well captured by an exponential law.
△ Less
Submitted 30 April, 2018;
originally announced April 2018.
