-
Generative modeling of Sparse Approximate Inverse Preconditioners
Authors:
Mou Li,
He Wang,
Peter K. Jimack
Abstract:
We present a new deep learning paradigm for the generation of sparse approximate inverse (SPAI) preconditioners for matrix systems arising from the mesh-based discretization of elliptic differential operators. Our approach is based upon the observation that matrices generated in this manner are not arbitrary, but inherit properties from differential operators that they discretize. Consequently, we…
▽ More
We present a new deep learning paradigm for the generation of sparse approximate inverse (SPAI) preconditioners for matrix systems arising from the mesh-based discretization of elliptic differential operators. Our approach is based upon the observation that matrices generated in this manner are not arbitrary, but inherit properties from differential operators that they discretize. Consequently, we seek to represent a learnable distribution of high-performance preconditioners from a low-dimensional subspace through a carefully-designed autoencoder, which is able to generate SPAI preconditioners for these systems. The concept has been implemented on a variety of finite element discretizations of second- and fourth-order elliptic partial differential equations with highly promising results.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
Investigating Guiding Information for Adaptive Collocation Point Sampling in PINNs
Authors:
Jose Florido,
He Wang,
Amirul Khan,
Peter K. Jimack
Abstract:
Physics-informed neural networks (PINNs) provide a means of obtaining approximate solutions of partial differential equations and systems through the minimisation of an objective function which includes the evaluation of a residual function at a set of collocation points within the domain. The quality of a PINNs solution depends upon numerous parameters, including the number and distribution of th…
▽ More
Physics-informed neural networks (PINNs) provide a means of obtaining approximate solutions of partial differential equations and systems through the minimisation of an objective function which includes the evaluation of a residual function at a set of collocation points within the domain. The quality of a PINNs solution depends upon numerous parameters, including the number and distribution of these collocation points. In this paper we consider a number of strategies for selecting these points and investigate their impact on the overall accuracy of the method. In particular, we suggest that no single approach is likely to be ``optimal'' but we show how a number of important metrics can have an impact in improving the quality of the results obtained when using a fixed number of residual evaluations. We illustrate these approaches through the use of two benchmark test problems: Burgers' equation and the Allen-Cahn equation.
△ Less
Submitted 18 April, 2024;
originally announced April 2024.
-
Understanding the Efficacy of U-Net & Vision Transformer for Groundwater Numerical Modelling
Authors:
Maria Luisa Taccari,
Oded Ovadia,
He Wang,
Adar Kahana,
Xiaohui Chen,
Peter K. Jimack
Abstract:
This paper presents a comprehensive comparison of various machine learning models, namely U-Net, U-Net integrated with Vision Transformers (ViT), and Fourier Neural Operator (FNO), for time-dependent forward modelling in groundwater systems. Through testing on synthetic datasets, it is demonstrated that U-Net and U-Net + ViT models outperform FNO in accuracy and efficiency, especially in sparse da…
▽ More
This paper presents a comprehensive comparison of various machine learning models, namely U-Net, U-Net integrated with Vision Transformers (ViT), and Fourier Neural Operator (FNO), for time-dependent forward modelling in groundwater systems. Through testing on synthetic datasets, it is demonstrated that U-Net and U-Net + ViT models outperform FNO in accuracy and efficiency, especially in sparse data scenarios. These findings underscore the potential of U-Net-based models for groundwater modelling in real-world applications where data scarcity is prevalent.
△ Less
Submitted 8 July, 2023;
originally announced July 2023.
-
Develo** a cost-effective emulator for groundwater flow modeling using deep neural operators
Authors:
Maria Luisa Taccari,
He Wang,
Somdatta Goswami,
Jonathan Nuttall,
Xiaohui Chen,
Peter K. Jimack
Abstract:
Current groundwater models face a significant challenge in their implementation due to heavy computational burdens. To overcome this, our work proposes a cost-effective emulator that efficiently and accurately forecasts the impact of abstraction in an aquifer. Our approach uses a deep neural operator (DeepONet) to learn operators that map between infinite-dimensional function spaces via deep neura…
▽ More
Current groundwater models face a significant challenge in their implementation due to heavy computational burdens. To overcome this, our work proposes a cost-effective emulator that efficiently and accurately forecasts the impact of abstraction in an aquifer. Our approach uses a deep neural operator (DeepONet) to learn operators that map between infinite-dimensional function spaces via deep neural networks. The goal is to infer the distribution of hydraulic head in a confined aquifer in the presence of a pum** well. We successfully tested the DeepONet on four problems, including two forward problems, an inverse analysis, and a nonlinear system. Additionally, we propose a novel extension of the DeepONet-based architecture to generate accurate predictions for varied hydraulic conductivity fields and pum** well locations that are unseen during training. Our emulator's predictions match the target data with excellent performance, demonstrating that the proposed model can act as an efficient and fast tool to support a range of tasks that require repetitive forward numerical simulations or inverse simulations of groundwater flow problems. Overall, our work provides a promising avenue for develo** cost-effective and accurate groundwater models.
△ Less
Submitted 5 March, 2023;
originally announced April 2023.
-
Attention U-Net as a surrogate model for groundwater prediction
Authors:
Maria Luisa Taccari,
Jonathan Nuttall,
Xiaohui Chen,
He Wang,
Bennie Minnema,
Peter K. Jimack
Abstract:
Numerical simulations of groundwater flow are used to analyze and predict the response of an aquifer system to its change in state by approximating the solution of the fundamental groundwater physical equations. The most used and classical methodologies, such as Finite Difference (FD) and Finite Element (FE) Methods, use iterative solvers which are associated with high computational cost. This stu…
▽ More
Numerical simulations of groundwater flow are used to analyze and predict the response of an aquifer system to its change in state by approximating the solution of the fundamental groundwater physical equations. The most used and classical methodologies, such as Finite Difference (FD) and Finite Element (FE) Methods, use iterative solvers which are associated with high computational cost. This study proposes a physics-based convolutional encoder-decoder neural network as a surrogate model to quickly calculate the response of the groundwater system. Holding strong promise in cross-domain map**s, encoder-decoder networks are applicable for learning complex input-output map**s of physical systems. This manuscript presents an Attention U-Net model that attempts to capture the fundamental input-output relations of the groundwater system and generates solutions of hydraulic head in the whole domain given a set of physical parameters and boundary conditions. The model accurately predicts the steady state response of a highly heterogeneous groundwater system given the locations and piezometric head of up to 3 wells as input. The network learns to pay attention only in the relevant parts of the domain and the generated hydraulic head field corresponds to the target samples in great detail. Even relative to coarse finite difference approximations the proposed model is shown to be significantly faster than a comparative state-of-the-art numerical solver, thus providing a base for further development of the presented networks as surrogate models for groundwater prediction.
△ Less
Submitted 9 April, 2022;
originally announced April 2022.
-
MeshingNet: A New Mesh Generation Method based on Deep Learning
Authors:
Zheyan Zhang,
Yongxing Wang,
Peter K. Jimack,
He Wang
Abstract:
We introduce a novel approach to automatic unstructured mesh generation using machine learning to predict an optimal finite element mesh for a previously unseen problem. The framework that we have developed is based around training an artificial neural network (ANN) to guide standard mesh generation software, based upon a prediction of the required local mesh density throughout the domain. We desc…
▽ More
We introduce a novel approach to automatic unstructured mesh generation using machine learning to predict an optimal finite element mesh for a previously unseen problem. The framework that we have developed is based around training an artificial neural network (ANN) to guide standard mesh generation software, based upon a prediction of the required local mesh density throughout the domain. We describe the training regime that is proposed, based upon the use of \emph{a posteriori} error estimation, and discuss the topologies of the ANNs that we have considered. We then illustrate performance using two standard test problems, a single elliptic partial differential equation (PDE) and a system of PDEs associated with linear elasticity. We demonstrate the effective generation of high quality meshes for arbitrary polygonal geometries and a range of material parameters, using a variety of user-selected error norms.
△ Less
Submitted 15 April, 2020;
originally announced April 2020.
-
An energy stable one-field monolithic arbitrary Lagrangian-Eulerian formulation for fluid-structure interaction
Authors:
Yongxing Wang,
Peter K. Jimack,
Mark A. Walkley,
Olivier Pironneau
Abstract:
In this article we present a one-field monolithic finite element method in the Arbitrary Lagrangian-Eulerian (ALE) formulation for Fluid-Structure Interaction (FSI) problems. The method only solves for one velocity field in the whole FSI domain, and it solves in a monolithic manner so that the fluid solid interface conditions are satisfied automatically. We prove that the proposed scheme is uncond…
▽ More
In this article we present a one-field monolithic finite element method in the Arbitrary Lagrangian-Eulerian (ALE) formulation for Fluid-Structure Interaction (FSI) problems. The method only solves for one velocity field in the whole FSI domain, and it solves in a monolithic manner so that the fluid solid interface conditions are satisfied automatically. We prove that the proposed scheme is unconditionally stable, through energy analysis, by utilising a conservative formulation and an exact quadrature rule. We implement the algorithm using both ${\bf F}$-scheme and ${\bf d}$-scheme, and demonstrate that the former has the same formulation in two and three dimensions. Finally several numerical examples are presented to validate this methodology, including combination with remesh techniques to handle the case of very large solid displacement.
△ Less
Submitted 8 March, 2020;
originally announced March 2020.
-
An Energy Stable One-Field Fictitious Domain Method for Fluid-Structure Interactions
Authors:
Yongxing Wang,
Peter K. Jimack,
Mark A. Walkley
Abstract:
In this article, the energy stability of a one-field fictitious domain method is proved and validated by numerical tests in two and three dimensions. The distinguishing feature of this method is that it only solves for one velocity field for the whole fluid-structure domain; the interactions remain decoupled until solving the final linear algebraic equations. To achieve this the finite element pro…
▽ More
In this article, the energy stability of a one-field fictitious domain method is proved and validated by numerical tests in two and three dimensions. The distinguishing feature of this method is that it only solves for one velocity field for the whole fluid-structure domain; the interactions remain decoupled until solving the final linear algebraic equations. To achieve this the finite element procedures are carried out separately on two different meshes for the fluid and solid respectively, and the assembly of the final linear system brings the fluid and solid parts together via an isoparametric interpolation matrix between the two meshes. The weak formulations are introduced in the continuous case and after discretization in time. Then the stability is analyzed through an energy estimate. Finally, numerical examples are presented to validate the energy stability properties.
△ Less
Submitted 28 January, 2018;
originally announced January 2018.
-
A One-Field Energy-conserving Monolithic Fictitious Domain Method for Fluid-Structure Interactions
Authors:
Yongxing Wang,
Peter K. Jimack,
Mark A. Walkley
Abstract:
In this article, we analyze and numerically assess a new fictitious domain method for fluid-structure interactions in two and three dimensions. The distinguishing feature of the proposed method is that it only solves for one velocity field for the whole fluid-structure domain; the interactions remain decoupled until solving the final linear algebraic equations. To achieve this the finite element p…
▽ More
In this article, we analyze and numerically assess a new fictitious domain method for fluid-structure interactions in two and three dimensions. The distinguishing feature of the proposed method is that it only solves for one velocity field for the whole fluid-structure domain; the interactions remain decoupled until solving the final linear algebraic equations. To achieve this the finite element procedures are carried out separately on two different meshes for the fluid and solid respectively, and the assembly of the final linear system brings the fluid and solid parts together via an isoparametric interpolation matrix between the two meshes. In this article, an implicit version of this approach is introduced. The property of energy conservation is proved, which is a strong indication of stability. The solvability and error estimate for the corresponding stationary problem (one time step of the transient problem) are analyzed. Finally, 2D and 3D numerical examples are presented to validate the conservation properties.
△ Less
Submitted 10 May, 2017;
originally announced May 2017.
-
A One-Field Monolithic Fictitious Domain Method for Fluid-Structure Interactions
Authors:
Yongxing Wang,
Peter Jimack,
Mark Walkley
Abstract:
In this article, we present a one-field monolithic fictitious domain (FD) method for simulation of general fluid-structure interactions (FSI). One-field means only one velocity field is solved in the whole domain, based upon the use of an appropriate L2 projection. Monolithic means the fluid and solid equations are solved synchronously (rather than sequentially). We argue that the proposed method…
▽ More
In this article, we present a one-field monolithic fictitious domain (FD) method for simulation of general fluid-structure interactions (FSI). One-field means only one velocity field is solved in the whole domain, based upon the use of an appropriate L2 projection. Monolithic means the fluid and solid equations are solved synchronously (rather than sequentially). We argue that the proposed method has the same generality and robustness as FD methods with distributed Lagrange multiplier (DLM) but is significantly more computationally efficient (because of one-field) whilst being very straightforward to implement. The method is described in detail, followed by the presentation of multiple computational examples in order to validate it across a wide range of fluid and solid parameters and interactions.
△ Less
Submitted 5 December, 2016;
originally announced December 2016.
-
Research and Education in Computational Science and Engineering
Authors:
Ulrich Rüde,
Karen Willcox,
Lois Curfman McInnes,
Hans De Sterck,
George Biros,
Hans Bungartz,
James Corones,
Evin Cramer,
James Crowley,
Omar Ghattas,
Max Gunzburger,
Michael Hanke,
Robert Harrison,
Michael Heroux,
Jan Hesthaven,
Peter Jimack,
Chris Johnson,
Kirk E. Jordan,
David E. Keyes,
Rolf Krause,
Vipin Kumar,
Stefan Mayer,
Juan Meza,
Knut Martin Mørken,
J. Tinsley Oden
, et al. (8 additional authors not shown)
Abstract:
Over the past two decades the field of computational science and engineering (CSE) has penetrated both basic and applied research in academia, industry, and laboratories to advance discovery, optimize systems, support decision-makers, and educate the scientific and engineering workforce. Informed by centuries of theory and experiment, CSE performs computational experiments to answer questions that…
▽ More
Over the past two decades the field of computational science and engineering (CSE) has penetrated both basic and applied research in academia, industry, and laboratories to advance discovery, optimize systems, support decision-makers, and educate the scientific and engineering workforce. Informed by centuries of theory and experiment, CSE performs computational experiments to answer questions that neither theory nor experiment alone is equipped to answer. CSE provides scientists and engineers of all persuasions with algorithmic inventions and software systems that transcend disciplines and scales. Carried on a wave of digital technology, CSE brings the power of parallelism to bear on troves of data. Mathematics-based advanced computing has become a prevalent means of discovery and innovation in essentially all areas of science, engineering, technology, and society; and the CSE community is at the core of this transformation. However, a combination of disruptive developments---including the architectural complexity of extreme-scale computing, the data revolution that engulfs the planet, and the specialization required to follow the applications to new frontiers---is redefining the scope and reach of the CSE endeavor. This report describes the rapid expansion of CSE and the challenges to sustaining its bold advances. The report also presents strategies and directions for CSE research and education for the next decade.
△ Less
Submitted 31 December, 2017; v1 submitted 8 October, 2016;
originally announced October 2016.
-
A Unified Finite Element Method for Fluid-Structure Interaction
Authors:
Yongxing Wang,
Peter Jimack,
Mark Walkley
Abstract:
In this article, we present a new unified finite element method (UFEM) for simulation of general Fluid-Structure interaction (FSI) which has the same generality and robustness as monolithic methods but is significantly more computationally efficient and easier to implement. Our proposed approach has similarities with classical immersed finite element methods (IFEMs), by approximating a single velo…
▽ More
In this article, we present a new unified finite element method (UFEM) for simulation of general Fluid-Structure interaction (FSI) which has the same generality and robustness as monolithic methods but is significantly more computationally efficient and easier to implement. Our proposed approach has similarities with classical immersed finite element methods (IFEMs), by approximating a single velocity and pressure field in the entire domain (i.e. occupied by fluid and solid) on a single mesh, but differs by treating the corrections due to the solid deformation on the left-hand side of the modified fluid flow equations (i.e. implicitly). The method is described in detail, followed by the presentation of multiple computational examples in order to validate it across a wide range of fluid and solid parameters and interactions.
△ Less
Submitted 15 August, 2016;
originally announced August 2016.
