-
The Biot-Allard poro-elasticity system: equivalent forms and well-posedness
Authors:
Jakob S. Stokke,
Markus Bause,
Nils Margenberg,
Florin A. Radu
Abstract:
We consider the fully dynamic Biot-Allard model, which includes memory effects. Convolution integrals in time model the history of the porous medium. We use a series representation of the dynamic permeability in the frequency domain to rewrite the equations in a coupled system without convolution integrals, suitable for the design of efficient numerical approximation schemes. The main result is th…
▽ More
We consider the fully dynamic Biot-Allard model, which includes memory effects. Convolution integrals in time model the history of the porous medium. We use a series representation of the dynamic permeability in the frequency domain to rewrite the equations in a coupled system without convolution integrals, suitable for the design of efficient numerical approximation schemes. The main result is the well-posedness of the system, proved by the abstract theory of R. Picard for evolutionary problems.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
DNN-MG: A Hybrid Neural Network/Finite Element Method with Applications to 3D Simulations of the Navier-Stokes Equations
Authors:
Nils Margenberg,
Robert Jendersie,
Christian Lessig,
Thomas Richter
Abstract:
We extend and analyze the deep neural network multigrid solver (DNN-MG) for the Navier-Stokes equations in three dimensions. The idea of the method is to augment a finite element simulation on coarse grids with fine scale information obtained using deep neural networks.
The neural network operates locally on small patches of grid elements. The local approach proves to be highly efficient, since…
▽ More
We extend and analyze the deep neural network multigrid solver (DNN-MG) for the Navier-Stokes equations in three dimensions. The idea of the method is to augment a finite element simulation on coarse grids with fine scale information obtained using deep neural networks.
The neural network operates locally on small patches of grid elements. The local approach proves to be highly efficient, since the network can be kept (relatively) small and since it can be applied in parallel on all grid patches. However, the main advantage of the local approach is the inherent generalizability of the method. Since the network only processes data of small sub-areas, it never ``sees'' the global problem and thus does not learn false biases.
We describe the method with a focus on the interplay between the finite element method and deep neural networks. Further, we demonstrate with numerical examples the excellent efficiency of the hybrid approach, which allows us to achieve very high accuracy with a coarse grid and thus reduce the computation time by orders of magnitude.
△ Less
Submitted 1 November, 2023; v1 submitted 27 July, 2023;
originally announced July 2023.
-
Optimal Dirichlet Boundary Control by Fourier Neural Operators Applied to Nonlinear Optics
Authors:
Nils Margenberg,
Franz X. Kärtner,
Markus Bause
Abstract:
We present an approach for solving optimal Dirichlet boundary control problems of nonlinear optics by using deep learning. For computing high resolution approximations of the solution to the nonlinear wave model, we propose higher order space-time finite element methods in combination with collocation techniques. Thereby, $C^{l}$-regularity in time of the global discrete is ensured. The resulting…
▽ More
We present an approach for solving optimal Dirichlet boundary control problems of nonlinear optics by using deep learning. For computing high resolution approximations of the solution to the nonlinear wave model, we propose higher order space-time finite element methods in combination with collocation techniques. Thereby, $C^{l}$-regularity in time of the global discrete is ensured. The resulting simulation data is used to train solution operators that effectively leverage the higher regularity of the training data. The solution operator is represented by Fourier Neural Operators and Gated Recurrent Units and can be used as the forward solver in the optimal Dirichlet boundary control problem. The proposed algorithm is implemented and tested on modern high-performance computing platforms, with a focus on efficiency and scalability. The effectiveness of the approach is demonstrated on the problem of generating Terahertz radiation in periodically poled Lithium Niobate, where the neural network is used as the solver in the optimal control setting to optimize the parametrization of the optical input pulse and maximize the yield of $0.3\,$THz-frequency radiation. We exploit the periodic layering of the crystal to design the neural networks. The networks are trained to learn the propagation through one period of the layers. The recursive application of the network onto itself yields an approximation to the full problem. Our results indicate that the proposed method can achieve a significant speedup in computation time compared to classical methods. A comparison of our results to experimental data shows the potential to revolutionize the way we approach optimization problems in nonlinear optics.
△ Less
Submitted 14 July, 2023;
originally announced July 2023.
-
Benchmark computations of dynamic poroelasticity
Authors:
Mathias Anselmann,
Markus Bause,
Nils Margenberg,
Pavel Shamko
Abstract:
We present benchmark computations of dynamic poroelasticity modeling fluid flow in deformable porous media by a coupled hyperbolic-parabolic system of partial differential equations. A challenging benchmark setting and goal quantities of physical interest for this problem are proposed. Computations performed by space-time finite element approximations with continuous and discontinuous discretizati…
▽ More
We present benchmark computations of dynamic poroelasticity modeling fluid flow in deformable porous media by a coupled hyperbolic-parabolic system of partial differential equations. A challenging benchmark setting and goal quantities of physical interest for this problem are proposed. Computations performed by space-time finite element approximations with continuous and discontinuous discretizations of the time variable are summarized. By this work we intend to stimulate comparative studies by other research groups for the evaluation of dynamic poroelasticity solver regarding the accuracy of discretization techniques, the efficiency and robustness of iterative methods for the linear systems and the arrangement of the model equations in terms of their variables (two-field or multi-field formulations).
△ Less
Submitted 5 July, 2023;
originally announced July 2023.
-
An energy-efficient GMRES-Multigrid solver for space-time finite element computation of dynamic poro- and thermoelasticity
Authors:
Mathias Anselmann,
Markus Bause,
Nils Margenberg,
Pavel Shamko
Abstract:
We present families of space-time finite element methods (STFEMs) for a coupled hyperbolic-parabolic system of poro- or thermoelasticity. Well-posedness of the discrete problems is proved. Higher order approximations inheriting most of the rich structure of solutions to the continuous problem on computationally feasible grids are naturally embedded. However, the block structure and solution of the…
▽ More
We present families of space-time finite element methods (STFEMs) for a coupled hyperbolic-parabolic system of poro- or thermoelasticity. Well-posedness of the discrete problems is proved. Higher order approximations inheriting most of the rich structure of solutions to the continuous problem on computationally feasible grids are naturally embedded. However, the block structure and solution of the algebraic systems become increasingly complex for these members of the families. We present and analyze a robust geometric multigrid (GMG) preconditioner for GMRES iterations. The GMG method uses a local Vanka-type smoother. Its action is defined in an exact mathematical way. Due to nonlocal coupling mechanisms of unknowns, the smoother is applied on patches of elements. This ensures the dam** of error frequencies. In a sequence of numerical experiments, including a challenging three-dimensional benchmark of practical interest, the efficiency of the solver for STFEMs is illustrated and confirmed. Its parallel scalability is analyzed. Beyond this study of classical performance engineering, the solver's energy efficiency is investigated as an additional and emerging dimension in the design and tuning of algorithms and their implementation on the hardware.
△ Less
Submitted 12 March, 2023;
originally announced March 2023.
-
Accurate simulation of THz generation with Finite-Element Time Domain methods
Authors:
Nils Margenberg,
Franz X. Kärtner,
Markus Bause
Abstract:
We investigate the accurate full broadband simulation of complex nonlinear optical processes. A mathematical model and numerical simulation techniques in the time domain are developed to simulate complex nonlinear optical processes without the usual used slowly varying envelope approximation. We illustrate the accuracy by numerical simulations. Furthermore, they are used to elucidate THz generatio…
▽ More
We investigate the accurate full broadband simulation of complex nonlinear optical processes. A mathematical model and numerical simulation techniques in the time domain are developed to simulate complex nonlinear optical processes without the usual used slowly varying envelope approximation. We illustrate the accuracy by numerical simulations. Furthermore, they are used to elucidate THz generation in periodically poled Lithium Niobate (PPLN) including optical harmonic generation.
△ Less
Submitted 10 March, 2023; v1 submitted 13 November, 2022;
originally announced November 2022.
-
Deep neural networks for geometric multigrid methods
Authors:
Nils Margenberg,
Robert Jendersie,
Thomas Richter,
Christian Lessig
Abstract:
We investigate scaling and efficiency of the deep neural network multigrid method (DNN-MG).
DNN-MG is a novel neural network-based technique for the simulation of the Navier-Stokes equations that combines an adaptive geometric multigrid solver, i.e. a highly efficient
classical solution scheme, with a recurrent neural network with memory.
The neural network replaces in DNN-MG one or multiple…
▽ More
We investigate scaling and efficiency of the deep neural network multigrid method (DNN-MG).
DNN-MG is a novel neural network-based technique for the simulation of the Navier-Stokes equations that combines an adaptive geometric multigrid solver, i.e. a highly efficient
classical solution scheme, with a recurrent neural network with memory.
The neural network replaces in DNN-MG one or multiple finest multigrid layers and provides a correction for the classical solve in the next time step.
This leads to little degradation in the solution quality while substantially reducing the overall computational costs.
At the same time, the use of the multigrid solver at the coarse scales allows for a compact network that is easy to train, generalizes well, and allows for the incorporation of physical constraints.
Previous work on DNN-MG focused on the overall scheme and how to enforce divergence freedom in the solution.
In this work, we investigate how the network size affects training and solution quality and the overall runtime of the computations.
Our results demonstrate that larger networks are able to capture the
flow behavior better while requiring only little additional training time.
At runtime, the use of the neural network correction can even reduce the computation time compared to a classical multigrid simulation through a faster convergence of the nonlinear solve that is required at every time step.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
-
Structure Preservation for the Deep Neural Network Multigrid Solver
Authors:
Nils Margenberg,
Christian Lessig,
Thomas Richter
Abstract:
The simulation of partial differential equations is a central subject of numerical analysis and an indispensable tool in science, engineering and related fields. Existing approaches, such as finite elements, provide (highly) efficient tools but deep neural network-based techniques emerged in the last few years as an alternative with very promising results. We investigate the combination of both ap…
▽ More
The simulation of partial differential equations is a central subject of numerical analysis and an indispensable tool in science, engineering and related fields. Existing approaches, such as finite elements, provide (highly) efficient tools but deep neural network-based techniques emerged in the last few years as an alternative with very promising results. We investigate the combination of both approaches for the approximation of the Navier-Stokes equations and to what extent structural properties such as divergence freedom can and should be respected. Our work is based on DNN-MG, a deep neural network multigrid technique, that we introduced recently and which uses a neural network to represent fine grid fluctuations not resolved by a geometric multigrid finite element solver. Although DNN-MG provides solutions with very good accuracy and is computationally highly efficient, we noticed that the neural network-based corrections substantially violate the divergence freedom of the velocity vector field. In this contribution, we discuss these findings and analyze three approaches to address the problem: a penalty term to encourage divergence freedom of the network output; a penalty term for the corrected velocity field; and a network that learns the stream function, i.e. the scalar potential of the divergence free velocity vector field and which hence yields by construction divergence free corrections. Our experimental results show that the third approach based on the stream function outperforms the other two and not only improves the divergence freedom but in particular also the overall fidelity of the simulation.
△ Less
Submitted 9 December, 2020;
originally announced December 2020.
-
A neural network multigrid solver for the Navier-Stokes equations
Authors:
Nils Margenberg,
Dirk Hartmann,
Christian Lessig,
Thomas Richter
Abstract:
We present the deep neural network multigrid solver (DNN-MG) that we develop for the instationary Navier-Stokes equations. DNN-MG improves computational efficiency using a judicious combination of a geometric multigrid solver and a recurrent neural network with memory. DNN-MG uses the multi-grid method to classically solve on coarse levels while the neural network corrects interpolated solutions o…
▽ More
We present the deep neural network multigrid solver (DNN-MG) that we develop for the instationary Navier-Stokes equations. DNN-MG improves computational efficiency using a judicious combination of a geometric multigrid solver and a recurrent neural network with memory. DNN-MG uses the multi-grid method to classically solve on coarse levels while the neural network corrects interpolated solutions on fine ones, thus avoiding the increasingly expensive computations that would have to be performed there. This results in a reduction in computation time through DNN-MG's highly compact neural network. The compactness results from its design for local patches and the available coarse multigrid solutions that provides a "guide" for the corrections. A compact neural network with a small number of parameters also reduces training time and data. Furthermore, the network's locality facilitates generalizability and allows one to use DNN-MG trained on one mesh domain also on different ones. We demonstrate the efficacy of DNN-MG for variations of the 2D laminar flow around an obstacle. For these, our method significantly improves the solutions as well as lift and drag functionals while requiring only about half the computation time of a full multigrid solution. We also show that DNN-MG trained for the configuration with one obstacle can be generalized to other time dependent problems that can be solved efficiently using a geometric multigrid method.
△ Less
Submitted 29 November, 2021; v1 submitted 26 August, 2020;
originally announced August 2020.
-
Parallel time-step** for fluid-structure interactions
Authors:
Nils Margenberg,
Thomas Richter
Abstract:
We present a parallel time-step** method for fluid-structure interactions. The interaction between the incompressible Navier-Stokes equations and a hyperelastic solid is formulated in a fully monolithic framework. Discretization in space is based on equal order finite element for all variables and a variant of the Crank-Nicolson scheme is used as second order time integrator. To accelerate the s…
▽ More
We present a parallel time-step** method for fluid-structure interactions. The interaction between the incompressible Navier-Stokes equations and a hyperelastic solid is formulated in a fully monolithic framework. Discretization in space is based on equal order finite element for all variables and a variant of the Crank-Nicolson scheme is used as second order time integrator. To accelerate the solution of the systems, we analyze a parallel-in time method. For different numerical test cases in 2d and in 3d we present the efficiency of the resulting solution approach. We also discuss some special challenges and limitations that are connected to the special structure of fluid-structure interaction problem.
△ Less
Submitted 2 July, 2019;
originally announced July 2019.