-
In-Context Learning of Physical Properties: Few-Shot Adaptation to Out-of-Distribution Molecular Graphs
Authors:
Grzegorz Kaszuba,
Amirhossein D. Naghdi,
Dario Massa,
Stefanos Papanikolaou,
Andrzej Jaszkiewicz,
Piotr Sankowski
Abstract:
Large language models manifest the ability of few-shot adaptation to a sequence of provided examples. This behavior, known as in-context learning, allows for performing nontrivial machine learning tasks during inference only. In this work, we address the question: can we leverage in-context learning to predict out-of-distribution materials properties? However, this would not be possible for struct…
▽ More
Large language models manifest the ability of few-shot adaptation to a sequence of provided examples. This behavior, known as in-context learning, allows for performing nontrivial machine learning tasks during inference only. In this work, we address the question: can we leverage in-context learning to predict out-of-distribution materials properties? However, this would not be possible for structure property prediction tasks unless an effective method is found to pass atomic-level geometric features to the transformer model. To address this problem, we employ a compound model in which GPT-2 acts on the output of geometry-aware graph neural networks to adapt in-context information. To demonstrate our model's capabilities, we partition the QM9 dataset into sequences of molecules that share a common substructure and use them for in-context learning. This approach significantly improves the performance of the model on out-of-distribution examples, surpassing the one of general graph neural network models.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
Unbiased Atomistic Predictions of Crystal Dislocation Dynamics using Bayesian Force Fields
Authors:
Cameron J. Owen,
Amirhossein D. Naghdi,
Anders Johansson,
Dario Massa,
Stefanos Papanikolaou,
Boris Kozinsky
Abstract:
Crystal dislocation dynamics, especially at high temperatures, represents a subject where experimental phenomenological input is commonly required, and parameter-free predictions, starting from quantum methods, have been beyond reach. This is especially true for phenomena like stacking faults and dislocation cross-slip, which are computationally intractable with methods like density functional the…
▽ More
Crystal dislocation dynamics, especially at high temperatures, represents a subject where experimental phenomenological input is commonly required, and parameter-free predictions, starting from quantum methods, have been beyond reach. This is especially true for phenomena like stacking faults and dislocation cross-slip, which are computationally intractable with methods like density functional theory, as $\sim 10^5-10^6$ atoms are required to reliably simulate such systems. Hence, this work extends quantum-mechanical accuracy to mesoscopic molecular dynamics simulations and opens unprecedented possibilities in material design for extreme mechanical conditions with direct atomistic insight at the deformation mesoscale. To accomplish this, we construct a Bayesian machine-learned force field (MLFF) from ab initio quantum training data, enabling direct observations of high-temperature and high-stress dislocation dynamics in single-crystalline Cu with atomistic resolution. In doing so, a generalizable training protocol is developed for construction of MLFFs for dislocation kinetics, with wide-ranging applicability to other single element systems and alloys. The resulting FLARE MLFF provides excellent predictions of static bulk elastic properties, stacking fault widths and energies, dynamic evolutions and mobilities of edge and screw dislocations, as well as cross-slip energy barriers for screw dislocations, all of which are compared to available experimental measurements. This work marks the first reliable quantitative determination of dislocation mobilities and cross-slip barriers, demonstrating a substantial advancement over previous empirical and machine learned force field models.
△ Less
Submitted 9 January, 2024;
originally announced January 2024.
-
Neural Network Interatomic Potentials For Open Surface Nano-mechanics Applications
Authors:
Amirhossein D. Naghdi,
Franco Pellegrini,
Emine Küçükbenli,
Dario Massa,
F. Javier Dominguez Gutierrez,
Efthimios Kaxiras,
Stefanos Papanikolaou
Abstract:
Material characterization in nano-mechanical tests requires precise interatomic potentials for the computation of atomic energies and forces with near-quantum accuracy. For such purposes, we develop a robust neural-network interatomic potential (NNIP), and we provide a test for the example of molecular dynamics (MD) nanoindentation, and the case of body-centered cubic crystalline molybdenum (Mo).…
▽ More
Material characterization in nano-mechanical tests requires precise interatomic potentials for the computation of atomic energies and forces with near-quantum accuracy. For such purposes, we develop a robust neural-network interatomic potential (NNIP), and we provide a test for the example of molecular dynamics (MD) nanoindentation, and the case of body-centered cubic crystalline molybdenum (Mo). We employ a similarity measurement protocol, using standard local environment descriptors, to select ab initio configurations for the training dataset that capture the behavior of the indented sample. We find that it is critical to include generalized stacking fault (GSF) configurations, featuring a dumbbell interstitial on the surface, to capture dislocation cores, and also high-temperature configurations with frozen atom layers for the indenter tip contact. We develop a NNIP with distinct dislocation nucleation mechanisms, realistic generalized stacking fault energy (GSFE) curves, and an informative energy landscape for the atoms on the sample surface during nanoindentation. We compare our NNIP results with nanoindentation simulations, performed with three existing potentials -- an embedded atom method (EAM) potential, a gaussian approximation potential (GAP), and a tabulated GAP (tabGAP) potential -- that predict different dislocation nucleation mechanisms, and display the absence of essential information on the shear stress at the sample surface in the elastic region. We believe that these features render specialized NNIPs essential for simulations of nanoindentation and nano-mechanics with near-quantum accuracy.
△ Less
Submitted 17 December, 2023;
originally announced December 2023.
