-
Deterministic and statistical calibration of constitutive models from full-field data with parametric physics-informed neural networks
Authors:
David Anton,
Jendrik-Alexander Tröger,
Henning Wessels,
Ulrich Römer,
Alexander Henkes,
Stefan Hartmann
Abstract:
The calibration of constitutive models from full-field data has recently gained increasing interest due to improvements in full-field measurement capabilities. In addition to the experimental characterization of novel materials, continuous structural health monitoring is another application that is of great interest. However, monitoring is usually associated with severe time constraints, difficult…
▽ More
The calibration of constitutive models from full-field data has recently gained increasing interest due to improvements in full-field measurement capabilities. In addition to the experimental characterization of novel materials, continuous structural health monitoring is another application that is of great interest. However, monitoring is usually associated with severe time constraints, difficult to meet with standard numerical approaches. Therefore, parametric physics-informed neural networks (PINNs) for constitutive model calibration from full-field displacement data are investigated. In an offline stage, a parametric PINN can be trained to learn a parameterized solution of the underlying partial differential equation. In the subsequent online stage, the parametric PINN then acts as a surrogate for the parameters-to-state map in calibration. We test the proposed approach for the deterministic least-squares calibration of a linear elastic as well as a hyperelastic constitutive model from noisy synthetic displacement data. We further carry out Markov chain Monte Carlo-based Bayesian inference to quantify the uncertainty. A proper statistical evaluation of the results underlines the high accuracy of the deterministic calibration and that the estimated uncertainty is valid. Finally, we consider experimental data and show that the results are in good agreement with a Finite Element Method-based calibration. Due to the fast evaluation of PINNs, calibration can be performed in near real-time. This advantage is particularly evident in many-query applications such as Markov chain Monte Carlo-based Bayesian inference.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Reduced and All-at-Once Approaches for Model Calibration and Discovery in Computational Solid Mechanics
Authors:
Ulrich Römer,
Stefan Hartmann,
Jendrik-Alexander Tröger,
David Anton,
Henning Wessels,
Moritz Flaschel,
Laura De Lorenzis
Abstract:
In the framework of solid mechanics, the task of deriving material parameters from experimental data has recently re-emerged with the progress in full-field measurement capabilities and the renewed advances of machine learning. In this context, new methods such as the virtual fields method and physics-informed neural networks have been developed as alternatives to the already established least-squ…
▽ More
In the framework of solid mechanics, the task of deriving material parameters from experimental data has recently re-emerged with the progress in full-field measurement capabilities and the renewed advances of machine learning. In this context, new methods such as the virtual fields method and physics-informed neural networks have been developed as alternatives to the already established least-squares and finite element-based approaches. Moreover, model discovery problems are starting to emerge and can also be addressed in a parameter estimation framework. These developments call for a new unified perspective, which is able to cover both traditional parameter estimation methods and novel approaches in which the state variables or the model structure itself are inferred as well. Adopting concepts discussed in the inverse problems community, we distinguish between all-at-once and reduced approaches. With this general framework, we are able to structure a large portion of the literature on parameter estimation in computational mechanics - and we can identify combinations that have not yet been addressed, two of which are proposed in this paper. We also discuss statistical approaches to quantify the uncertainty related to the estimated parameters, and we propose a novel two-step procedure for identification of complex material models based on both frequentist and Bayesian principles. Finally, we illustrate and compare several of the aforementioned methods with mechanical benchmarks based on synthetic and real data.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
Parameter identification and uncertainty propagation of hydrogel coupled diffusion-deformation using POD-based reduced-order modeling
Authors:
Gopal Agarwal,
Jorge-Humberto Urrea-Quintero,
Henning Wessels,
Thomas Wick
Abstract:
This study explores reduced-order modeling for analyzing the time-dependent diffusion-deformation of hydrogels. The full-order model describing hydrogel transient behavior consists of a coupled system of partial differential equations in which chemical potential and displacements are coupled. This system is formulated in a monolithic fashion and solved using the finite element method. We employ pr…
▽ More
This study explores reduced-order modeling for analyzing the time-dependent diffusion-deformation of hydrogels. The full-order model describing hydrogel transient behavior consists of a coupled system of partial differential equations in which chemical potential and displacements are coupled. This system is formulated in a monolithic fashion and solved using the finite element method. We employ proper orthogonal decomposition as a model order reduction approach. The reduced-order model performance is tested through a benchmark problem on hydrogel swelling and a case study simulating co-axial printing. Then, we embed the reduced-order model into an optimization loop to efficiently identify the coupled problem's material parameters using full-field data. Finally, a study is conducted on the uncertainty propagation of the material parameter.
△ Less
Submitted 16 June, 2024; v1 submitted 13 March, 2024;
originally announced March 2024.
-
Inferring Displacement Fields from Sparse Measurements Using the Statistical Finite Element Method
Authors:
Vahab B. Narouie,
Henning Wessels,
Ulrich Römer
Abstract:
A well-established approach for inferring full displacement and stress fields from possibly sparse data is to calibrate the parameter of a given constitutive model using a Bayesian update. After calibration, a (stochastic) forward simulation is conducted with the identified model parameters to resolve physical fields in regions that were not accessible to the measurement device. A shortcoming of m…
▽ More
A well-established approach for inferring full displacement and stress fields from possibly sparse data is to calibrate the parameter of a given constitutive model using a Bayesian update. After calibration, a (stochastic) forward simulation is conducted with the identified model parameters to resolve physical fields in regions that were not accessible to the measurement device. A shortcoming of model calibration is that the model is deemed to best represent reality, which is only sometimes the case, especially in the context of the aging of structures and materials. While this issue is often addressed with repeated model calibration, a different approach is followed in the recently proposed statistical Finite Element Method (statFEM). Instead of using Bayes' theorem to update model parameters, the displacement is chosen as the stochastic prior and updated to fit the measurement data more closely. For this purpose, the statFEM framework introduces a so-called model-reality mismatch, parametrized by only three hyperparameters. This makes the inference of full-field data computationally efficient in an online stage: If the stochastic prior can be computed offline, solving the underlying partial differential equation (PDE) online is unnecessary. Compared to solving a PDE, identifying only three hyperparameters and conditioning the state on the sensor data requires much fewer computational resources.
This paper presents two contributions to the existing statFEM approach: First, we use a non-intrusive polynomial chaos method to compute the prior, enabling the use of complex mechanical models in deterministic formulations. Second, we examine the influence of prior material models (linear elastic and St.Venant Kirchhoff material with uncertain Young's modulus) on the updated solution. We present statFEM results for 1D and 2D examples, while an extension to 3D is straightforward.
△ Less
Submitted 6 June, 2023; v1 submitted 27 December, 2022;
originally announced December 2022.
-
Faithful Heteroscedastic Regression with Neural Networks
Authors:
Andrew Stirn,
Hans-Hermann Wessels,
Megan Schertzer,
Laura Pereira,
Neville E. Sanjana,
David A. Knowles
Abstract:
Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data. Yet, optimizing network parameters via log likelihood gradients can yield suboptimal mean and uncalibrated variance estimates. Current solutions side-step this optimization probl…
▽ More
Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data. Yet, optimizing network parameters via log likelihood gradients can yield suboptimal mean and uncalibrated variance estimates. Current solutions side-step this optimization problem with surrogate objectives or Bayesian treatments. Instead, we make two simple modifications to optimization. Notably, their combination produces a heteroscedastic model with mean estimates that are provably as accurate as those from its homoscedastic counterpart (i.e.~fitting the mean under squared error loss). For a wide variety of network and task complexities, we find that mean estimates from existing heteroscedastic solutions can be significantly less accurate than those from an equivalently expressive mean-only model. Our approach provably retains the accuracy of an equally flexible mean-only model while also offering best-in-class variance calibration. Lastly, we show how to leverage our method to recover the underlying heteroscedastic noise variance.
△ Less
Submitted 18 December, 2022;
originally announced December 2022.
-
Physics-Informed Neural Networks for Material Model Calibration from Full-Field Displacement Data
Authors:
David Anton,
Henning Wessels
Abstract:
The identification of material parameters occurring in constitutive models has a wide range of applications in practice. One of these applications is the monitoring and assessment of the actual condition of infrastructure buildings, as the material parameters directly reflect the resistance of the structures to external impacts. Physics-informed neural networks (PINNs) have recently emerged as a s…
▽ More
The identification of material parameters occurring in constitutive models has a wide range of applications in practice. One of these applications is the monitoring and assessment of the actual condition of infrastructure buildings, as the material parameters directly reflect the resistance of the structures to external impacts. Physics-informed neural networks (PINNs) have recently emerged as a suitable method for solving inverse problems. The advantages of this method are a straightforward inclusion of observation data. Unlike grid-based methods, such as the least square finite element method (LS-FEM) approach, no computational grid and no interpolation of the data is required. In the current work, we propose PINNs for the calibration of constitutive models from full-field displacement and global force data in a realistic regime on the example of linear elasticity. We show that conditioning and reformulation of the optimization problem play a crucial role in real-world applications. Therefore, among others, we identify the material parameters from initial estimates and balance the individual terms in the loss function. In order to reduce the dependency of the identified material parameters on local errors in the displacement approximation, we base the identification not on the stress boundary conditions but instead on the global balance of internal and external work. We demonstrate that the enhanced PINNs are capable of identifying material parameters from both experimental one-dimensional data and synthetic full-field displacement data in a realistic regime. Since displacement data measured by, e.g., a digital image correlation (DIC) system is noisy, we additionally investigate the robustness of the method to different levels of noise.
△ Less
Submitted 13 June, 2023; v1 submitted 15 December, 2022;
originally announced December 2022.
-
Spiking neural networks for nonlinear regression
Authors:
Alexander Henkes,
Jason K. Eshraghian,
Henning Wessels
Abstract:
Spiking neural networks, also often referred to as the third generation of neural networks, carry the potential for a massive reduction in memory and energy consumption over traditional, second-generation neural networks. Inspired by the undisputed efficiency of the human brain, they introduce temporal and neuronal sparsity, which can be exploited by next-generation neuromorphic hardware. To open…
▽ More
Spiking neural networks, also often referred to as the third generation of neural networks, carry the potential for a massive reduction in memory and energy consumption over traditional, second-generation neural networks. Inspired by the undisputed efficiency of the human brain, they introduce temporal and neuronal sparsity, which can be exploited by next-generation neuromorphic hardware. To open the pathway toward engineering applications, we introduce this exciting technology in the context of continuum mechanics. However, the nature of spiking neural networks poses a challenge for regression problems, which frequently arise in the modeling of engineering sciences. To overcome this problem, a framework for regression using spiking neural networks is proposed. In particular, a network topology for decoding binary spike trains to real numbers is introduced, utilizing the membrane potential of spiking neurons. As the aim of this contribution is a concise introduction to this new methodology, several different spiking neural architectures, ranging from simple spiking feed-forward to complex spiking long short-term memory neural networks, are derived. Several numerical experiments directed towards regression of linear and nonlinear, history-dependent material models are carried out. A direct comparison with counterparts of traditional neural networks shows that the proposed framework is much more efficient while retaining precision and generalizability. All code has been made publicly available in the interest of reproducibility and to promote continued enhancement in this new domain.
△ Less
Submitted 26 October, 2022; v1 submitted 6 October, 2022;
originally announced October 2022.
-
Three-dimensional microstructure generation using generative adversarial neural networks in the context of continuum micromechanics
Authors:
Alexander Henkes,
Henning Wessels
Abstract:
Multiscale simulations are demanding in terms of computational resources. In the context of continuum micromechanics, the multiscale problem arises from the need of inferring macroscopic material parameters from the microscale. If the underlying microstructure is explicitly given by means of microCT-scans, convolutional neural networks can be used to learn the microstructure-property map**, whic…
▽ More
Multiscale simulations are demanding in terms of computational resources. In the context of continuum micromechanics, the multiscale problem arises from the need of inferring macroscopic material parameters from the microscale. If the underlying microstructure is explicitly given by means of microCT-scans, convolutional neural networks can be used to learn the microstructure-property map**, which is usually obtained from computational homogenization. The CNN approach provides a significant speedup, especially in the context of heterogeneous or functionally graded materials. Another application is uncertainty quantification, where many expansive evaluations are required. However, one bottleneck of this approach is the large number of training microstructures needed. This work closes this gap by proposing a generative adversarial network tailored towards three-dimensional microstructure generation. The lightweight algorithm is able to learn the underlying properties of the material from a single microCT-scan without the need of explicit descriptors. During prediction time, the network can produce unique three-dimensional microstructures with the same properties of the original data in a fraction of seconds and at consistently high quality.
△ Less
Submitted 11 August, 2022; v1 submitted 31 May, 2022;
originally announced June 2022.
-
Physics informed neural networks for continuum micromechanics
Authors:
Alexander Henkes,
Henning Wessels,
Rolf Mahnken
Abstract:
Recently, physics informed neural networks have successfully been applied to a broad variety of problems in applied mathematics and engineering. The principle idea is to use a neural network as a global ansatz function to partial differential equations. Due to the global approximation, physics informed neural networks have difficulties in displaying localized effects and strong non-linear solution…
▽ More
Recently, physics informed neural networks have successfully been applied to a broad variety of problems in applied mathematics and engineering. The principle idea is to use a neural network as a global ansatz function to partial differential equations. Due to the global approximation, physics informed neural networks have difficulties in displaying localized effects and strong non-linear solutions by optimization. In this work we consider material non-linearities invoked by material inhomogeneities with sharp phase interfaces. This constitutes a challenging problem for a method relying on a global ansatz. To overcome convergence issues, adaptive training strategies and domain decomposition are studied. It is shown, that the domain decomposition approach is able to accurately resolve nonlinear stress, displacement and energy fields in heterogeneous microstructures obtained from real-world $μ$CT-scans.
△ Less
Submitted 25 March, 2022; v1 submitted 14 October, 2021;
originally announced October 2021.
-
The Neural Particle Method -- An Updated Lagrangian Physics Informed Neural Network for Computational Fluid Dynamics
Authors:
Henning Wessels,
Christian Weißenfels,
Peter Wriggers
Abstract:
Numerical simulation is indispensable in industrial design processes. It can replace expensive experiments and even reduce the need for prototypes. While products designed with the aid of numerical simulation undergo continuous improvement, this must also be true for numerical simulation itself. Up to date, no general purpose numerical method is available which can accurately resolve a variety of…
▽ More
Numerical simulation is indispensable in industrial design processes. It can replace expensive experiments and even reduce the need for prototypes. While products designed with the aid of numerical simulation undergo continuous improvement, this must also be true for numerical simulation itself. Up to date, no general purpose numerical method is available which can accurately resolve a variety of physics ranging from fluid to solid mechanics including large deformations and free surface flow phenomena. These complex multi-physics problems occur for example in Additive Manufacturing processes. In this sense, the recent developments in Machine Learning display promise for numerical simulation. It has recently been shown that instead of solving a system of equations as in standard numerical methods, a neural network can be trained solely based on initial and boundary conditions. Neural networks are smooth, differentiable functions that can be used as a global ansatz for Partial Differential Equations (PDEs). While this idea dates back to more than 20 years ago [Lagaris et al., 1998], it is only recently that an approach for the solution of time dependent problems has been developed [Raissi et al., 2019]. With the latter, implicit Runge Kutta schemes with unprecedented high order have been constructed to solve scalar-valued PDEs. We build on the aforementioned work in order to develop an Updated Lagrangian method for the solution of incompressible free surface flow subject to the inviscid Euler equations. The method is easy to implement and does not require any specific algorithmic treatment which is usually necessary to accurately resolve the incompressibility constraint. Due to its meshfree character, we will name it the Neural Particle Method (NPM). It will be demonstrated that the NPM remains stable and accurate even if the location of discretization points is highly irregular.
△ Less
Submitted 3 June, 2020; v1 submitted 18 March, 2020;
originally announced March 2020.
-
Group classification of the Sachs equations for a radiating axisymmetric, non-rotating, vacuum space-time
Authors:
Nail H. Ibragimov,
Ewald J. H. Wessels,
George F. R. Ellis
Abstract:
We carry out a Lie group analysis of the Sachs equations for a time-dependent axisymmetric non-rotating space-time in which the Ricci tensor vanishes. These equations, which are the first two members of the set of Newman-Penrose equations, define the characteristic initial-value problem for the space-time. We find a particular form for the initial data such that these equations admit a Lie symme…
▽ More
We carry out a Lie group analysis of the Sachs equations for a time-dependent axisymmetric non-rotating space-time in which the Ricci tensor vanishes. These equations, which are the first two members of the set of Newman-Penrose equations, define the characteristic initial-value problem for the space-time. We find a particular form for the initial data such that these equations admit a Lie symmetry, and so defines a geometrically special class of such spacetimes. These should additionally be of particular physical interest because of this special geometric feature.
△ Less
Submitted 21 November, 2006;
originally announced November 2006.