Interpreting and generalizing deep learning in physics-based problems with functional linear models
Authors:
Amirhossein Arzani,
Lingxiao Yuan,
Pania Newell,
Bei Wang
Abstract:
Although deep learning has achieved remarkable success in various scientific machine learning applications, its opaque nature poses concerns regarding interpretability and generalization capabilities beyond the training data. Interpretability is crucial and often desired in modeling physical systems. Moreover, acquiring extensive datasets that encompass the entire range of input features is challe…
▽ More
Although deep learning has achieved remarkable success in various scientific machine learning applications, its opaque nature poses concerns regarding interpretability and generalization capabilities beyond the training data. Interpretability is crucial and often desired in modeling physical systems. Moreover, acquiring extensive datasets that encompass the entire range of input features is challenging in many physics-based learning tasks, leading to increased errors when encountering out-of-distribution (OOD) data. In this work, motivated by the field of functional data analysis (FDA), we propose generalized functional linear models as an interpretable surrogate for a trained deep learning model. We demonstrate that our model could be trained either based on a trained neural network (post-hoc interpretation) or directly from training data (interpretable operator learning). A library of generalized functional linear models with different kernel functions is considered and sparse regression is used to discover an interpretable surrogate model that could be analytically presented. We present test cases in solid mechanics, fluid mechanics, and transport. Our results demonstrate that our model can achieve comparable accuracy to deep learning and can improve OOD generalization while providing more transparency and interpretability. Our study underscores the significance of interpretable representation in scientific machine learning and showcases the potential of functional linear models as a tool for interpreting and generalizing deep learning.
△ Less
Submitted 17 April, 2024; v1 submitted 10 July, 2023;
originally announced July 2023.
Determining parameters in generalized thermomechanics for metamaterials by means of asymptotic homogenization
Authors:
Bozo Vazic,
Bilen Emek Abali,
Pania Newell
Abstract:
Advancement in manufacturing methods enable designing so called metamaterials with a tailor-made microstructure. Microstructure affects materials response within a length-scale, where we model this behavior by using the generalized thermomechanics. Strain gradient theory is employed as a higher-order theory with thermodynamics modeled as a first-order theory. Develo** multiphysics models for het…
▽ More
Advancement in manufacturing methods enable designing so called metamaterials with a tailor-made microstructure. Microstructure affects materials response within a length-scale, where we model this behavior by using the generalized thermomechanics. Strain gradient theory is employed as a higher-order theory with thermodynamics modeled as a first-order theory. Develo** multiphysics models for heterogeneous materials is indeed a challenge and even this ``simplest'' model in generalized thermomechanics causes dozens of parameters to be determined. We develop a computational model by using a given microstructure, modeled as a periodic domain, and numerically calculate all parameters by means of asymptotic homogenization. Finite element method (FEM) is employed with the aid of open-source codes (FEniCS). Some example with symmetric and random distribution of voids in a model problem verifies the method and provides an example at which length-scale we need to consider generalized thermoeleasticity in composite materials.
△ Less
Submitted 7 July, 2022;
originally announced July 2022.
Machine Learning in Heterogeneous Porous Materials
Authors:
Marta D'Elia,
Hang Deng,
Cedric Fraces,
Krishna Garikipati,
Lori Graham-Brady,
Amanda Howard,
George Karniadakis,
Vahid Keshavarzzadeh,
Robert M. Kirby,
Nathan Kutz,
Chunhui Li,
Xing Liu,
Hannah Lu,
Pania Newell,
Daniel O'Malley,
Masa Prodanovic,
Gowri Srinivasan,
Alexandre Tartakovsky,
Daniel M. Tartakovsky,
Hamdi Tchelepi,
Bozo Vazic,
Hari Viswanathan,
Hongkyu Yoon,
Piotr Zarzycki
Abstract:
The "Workshop on Machine learning in heterogeneous porous materials" brought together international scientific communities of applied mathematics, porous media, and material sciences with experts in the areas of heterogeneous materials, machine learning (ML) and applied mathematics to identify how ML can advance materials research. Within the scope of ML and materials research, the goal of the wor…
▽ More
The "Workshop on Machine learning in heterogeneous porous materials" brought together international scientific communities of applied mathematics, porous media, and material sciences with experts in the areas of heterogeneous materials, machine learning (ML) and applied mathematics to identify how ML can advance materials research. Within the scope of ML and materials research, the goal of the workshop was to discuss the state-of-the-art in each community, promote crosstalk and accelerate multi-disciplinary collaborative research, and identify challenges and opportunities. As the end result, four topic areas were identified: ML in predicting materials properties, and discovery and design of novel materials, ML in porous and fractured media and time-dependent phenomena, Multi-scale modeling in heterogeneous porous materials via ML, and Discovery of materials constitutive laws and new governing equations. This workshop was part of the AmeriMech Symposium series sponsored by the National Academies of Sciences, Engineering and Medicine and the U.S. National Committee on Theoretical and Applied Mechanics.
△ Less
Submitted 4 February, 2022;
originally announced February 2022.
