-
CSPBench: a benchmark and critical evaluation of Crystal Structure Prediction
Authors:
Lai Wei,
Sadman Sadeed Omee,
Rongzhi Dong,
Nihang Fu,
Yuqi Song,
Edirisuriya M. D. Siriwardane,
Meiling Xu,
Chris Wolverton,
Jianjun Hu
Abstract:
Crystal structure prediction (CSP) is now increasingly used in discovering novel materials with applications in diverse industries. However, despite decades of developments and significant progress in this area, there lacks a set of well-defined benchmark dataset, quantitative performance metrics, and studies that evaluate the status of the field. We aim to fill this gap by introducing a CSP bench…
▽ More
Crystal structure prediction (CSP) is now increasingly used in discovering novel materials with applications in diverse industries. However, despite decades of developments and significant progress in this area, there lacks a set of well-defined benchmark dataset, quantitative performance metrics, and studies that evaluate the status of the field. We aim to fill this gap by introducing a CSP benchmark suite with 180 test structures along with our recently implemented CSP performance metric set. We benchmark a collection of 13 state-of-the-art (SOTA) CSP algorithms including template-based CSP algorithms, conventional CSP algorithms based on DFT calculations and global search such as CALYPSO, CSP algorithms based on machine learning (ML) potentials and global search, and distance matrix based CSP algorithms. Our results demonstrate that the performance of the current CSP algorithms is far from being satisfactory. Most algorithms cannot even identify the structures with the correct space groups except for the template-based algorithms when applied to test structures with similar templates. We also find that the ML potential based CSP algorithms are now able to achieve competitive performances compared to the DFT-based algorithms. These CSP algorithms' performance is strongly determined by the quality of the neural potentials as well as the global optimization algorithms. Our benchmark suite comes with a comprehensive open-source codebase and 180 well-selected benchmark crystal structures, making it convenient to evaluate the advantages and disadvantages of CSP algorithms from future studies. All the code and benchmark data are available at https://github.com/usccolumbia/cspbenchmark
△ Less
Submitted 30 June, 2024;
originally announced July 2024.
-
Elucidating the Role of Stacking Faults in TlGaSe$_{2}$ on its Thermoelectric Properties
Authors:
Tigran Simonian,
Ahin Roy,
Akash Bajaj,
Rui Dong,
Zheng Lei,
Zdeněk Sofer,
Stefano Sanvito,
Valeria Nicolosi
Abstract:
Thermoelectric materials are of great interest for heat energy harvesting applications. One such promising material is TlGaSe$_{2}$, a p-type semiconducting ternary chalcogenide. Recent reports show it can be processed as a thin film, opening the door for large-scale commercialization. However, TlGaSe$_{2}$ is prone to stacking faults along the [001] stacking direction and their role in its thermo…
▽ More
Thermoelectric materials are of great interest for heat energy harvesting applications. One such promising material is TlGaSe$_{2}$, a p-type semiconducting ternary chalcogenide. Recent reports show it can be processed as a thin film, opening the door for large-scale commercialization. However, TlGaSe$_{2}$ is prone to stacking faults along the [001] stacking direction and their role in its thermoelectric properties has not been understood to date. Herein, TlGaSe$_{2}$ is investigated via (scanning) transmission electron microscopy and first-principles calculations. Stacking faults are found to be present throughout the material, as density functional theory calculations reveal a lack of preferential stacking order. Electron transport calculations show an enhancement of thermoelectric power factors when stacking faults are present. This implies the presence of stacking faults is key to the material's excellent thermoelectric properties along the [001] stacking direction, which can be further enhanced by do** the material to hole carrier concentrations to approx. 10$^{19}$ cm$^{-3}$.
△ Less
Submitted 31 May, 2024;
originally announced May 2024.
-
Near IR bandgap semiconductive 2D conjugated metal-organic framework with rhombic lattice and high mobility
Authors:
Lukas Sporrer,
Guojun Zhou,
Mingchao Wang,
Vasileios Balos,
Sergio Revuelta,
Kamil Jastrzembski,
Markus Loeffler,
Petko Petkov,
Thomas Heine,
Angieszka Kuc,
Enrique Canovas,
Zhehao Huang,
Xinliang Feng,
Renhao Dong
Abstract:
Two-dimensional conjugated metal-organic frameworks (2D c-MOFs) are emerging as a unique class of 2D electronic materials. However, intrinsically semiconducting 2D c-MOFs with gaps in the Vis-NIR and high charge carrier mobility have been rare. Most of the reported semiconducting 2D c-MOFs are metallic (i.e. gapless), which limits their use in applications where larger band gaps are needed for log…
▽ More
Two-dimensional conjugated metal-organic frameworks (2D c-MOFs) are emerging as a unique class of 2D electronic materials. However, intrinsically semiconducting 2D c-MOFs with gaps in the Vis-NIR and high charge carrier mobility have been rare. Most of the reported semiconducting 2D c-MOFs are metallic (i.e. gapless), which limits their use in applications where larger band gaps are needed for logic devices. Herein, we design a new D2h-geometric ligand, 2,3,6,7,11,12,15,16-octahydroxyphenanthro(9,10b)triphenylene (OHPTP), and synthesize the first example of a 2D c-MOF single crystal (OHPTP-Cu) with a rhombohedral pore geometry after coordination with copper. The continuous rotation electron diffraction (cRED) analysis unveils the orthorhombic crystal structure at the atomic level with a unique AB layer stacking. The resultant Cu2(OHPTP) is a p-type semiconductor with an indirect band gap of about 0.50 eV and exhibits high electrical conductivity of 0.10 S cm-1 and high charge carrier mobility of 10.0 cm2V-1s-1. Density-functional theory calculations underline the predominant role of the out-of-plane charge transport in this semiquinone-based 2D c-MOFs.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
On-liquid-gallium surface synthesis of ultra-smooth conductive metal-organic framework thin films
Authors:
**xin Liu,
Yunxu Chen,
Xing Huang,
Yanhan Ren,
Mike Hambsch,
David Bodesheim,
Darius Pohl,
Xiaodong Li,
Marielle Deconinck,
Bowen Zhang,
Markus Löffler,
Zhongquan Liao,
Fengxiang Zhao,
Arezoo Dianat,
Gianaurelio Cuniberti,
Yana Vaynzof,
Junfeng Gao,
**gcheng Hao,
Stefan C. B. Mannsfeld,
Xinliang Feng,
Renhao Dong
Abstract:
Conductive metal-organic frameworks (MOFs) are emerging electroactive materials for (opto-)electronics. However, it remains a great challenge to achieve reliable MOF-based devices via the existing synthesis methods that are compatible with the complementary metal-oxide-semiconductor technology, as the surface roughness of thus-far synthetic MOF films or pellets is rather high for efficient electro…
▽ More
Conductive metal-organic frameworks (MOFs) are emerging electroactive materials for (opto-)electronics. However, it remains a great challenge to achieve reliable MOF-based devices via the existing synthesis methods that are compatible with the complementary metal-oxide-semiconductor technology, as the surface roughness of thus-far synthetic MOF films or pellets is rather high for efficient electrode contact. Here, we develop an on-liquid-gallium surface synthesis (OLGSS) strategy under chemical vapor deposition (CVD) conditions for the controlled growth of two-dimensional conjugated MOF (2D c-MOF) thin films with ten-fold improvement of surface flatness (surface roughness can reach as low as ~2 Å) compared with MOF films grown by the traditional methods. Supported by theoretical modeling, we unveil a layer-by-layer CVD growth mode for constructing flattening surfaces, that is triggered by the high adhesion energy between gallium (Ga) and planar aromatic ligands. We further demonstrate the generality of the as-proposed OLGSS strategy by reproducing such a flat surface over nine different 2D c-MOF films with variable thicknesses (~2 to 208 nm) and large lateral sizes (over 1 cm2). The resultant ultra-smooth 2D c-MOF films enable the formation of high-quality electrical contacts with gold (Au) electrodes, leading to a reduction of contact resistance by over ten orders of magnitude compared to the traditional uneven MOF films. Furthermore, due to the efficient interfacial interaction benifited from the high-quality contacts, the prepared van der Waals heterostructure (vdWH) of OLGSS c-MOF and MoS2 exhibits intriguing photoluminescence (PL) enhancement, PL peak shift and large work function modulation. The establishment of the reliable OLGSS method provides the chances to push the development of MOF electronics and the construction of multicomponent MOF-based heterostructure materials.
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
AlphaCrystal-II: Distance matrix based crystal structure prediction using deep learning
Authors:
Yuqi Song,
Rongzhi Dong,
Lai Wei,
Qin Li,
Jianjun Hu
Abstract:
Computational prediction of stable crystal structures has a profound impact on the large-scale discovery of novel functional materials. However, predicting the crystal structure solely from a material's composition or formula is a promising yet challenging task, as traditional ab initio crystal structure prediction (CSP) methods rely on time-consuming global searches and first-principles free ener…
▽ More
Computational prediction of stable crystal structures has a profound impact on the large-scale discovery of novel functional materials. However, predicting the crystal structure solely from a material's composition or formula is a promising yet challenging task, as traditional ab initio crystal structure prediction (CSP) methods rely on time-consuming global searches and first-principles free energy calculations. Inspired by the recent success of deep learning approaches in protein structure prediction, which utilize pairwise amino acid interactions to describe 3D structures, we present AlphaCrystal-II, a novel knowledge-based solution that exploits the abundant inter-atomic interaction patterns found in existing known crystal structures. AlphaCrystal-II predicts the atomic distance matrix of a target crystal material and employs this matrix to reconstruct its 3D crystal structure. By leveraging the wealth of inter-atomic relationships of known crystal structures, our approach demonstrates remarkable effectiveness and reliability in structure prediction through comprehensive experiments. This work highlights the potential of data-driven methods in accelerating the discovery and design of new materials with tailored properties.
△ Less
Submitted 7 April, 2024;
originally announced April 2024.
-
Structure-based out-of-distribution (OOD) materials property prediction: a benchmark study
Authors:
Sadman Sadeed Omee,
Nihang Fu,
Rongzhi Dong,
Ming Hu,
Jianjun Hu
Abstract:
In real-world material research, machine learning (ML) models are usually expected to predict and discover novel exceptional materials that deviate from the known materials. It is thus a pressing question to provide an objective evaluation of ML model performances in property prediction of out-of-distribution (OOD) materials that are different from the training set distribution. Traditional perfor…
▽ More
In real-world material research, machine learning (ML) models are usually expected to predict and discover novel exceptional materials that deviate from the known materials. It is thus a pressing question to provide an objective evaluation of ML model performances in property prediction of out-of-distribution (OOD) materials that are different from the training set distribution. Traditional performance evaluation of materials property prediction models through random splitting of the dataset frequently results in artificially high performance assessments due to the inherent redundancy of typical material datasets. Here we present a comprehensive benchmark study of structure-based graph neural networks (GNNs) for extrapolative OOD materials property prediction. We formulate five different categories of OOD ML problems for three benchmark datasets from the MatBench study. Our extensive experiments show that current state-of-the-art GNN algorithms significantly underperform for the OOD property prediction tasks on average compared to their baselines in the MatBench study, demonstrating a crucial generalization gap in realistic material prediction tasks. We further examine the latent physical spaces of these GNN models and identify the sources of CGCNN, ALIGNN, and DeeperGATGNN's significantly more robust OOD performance than those of the current best models in the MatBench study (coGN and coNGN), and provide insights to improve their performance.
△ Less
Submitted 15 January, 2024;
originally announced January 2024.
-
Tunable interfacial chemisorption with atomic-level precision in a graphene WSe2 heterostructure
Authors:
Mo-Han Zhang,
Fei Gao,
Aleksander Bach Lorentzen,
Ya-Ning Ren,
Ruo-Han Zhang,
Xiao-Feng Zhou,
Rui Dong,
Shi-Wu Gao,
Mads Brandbyge,
Lin He
Abstract:
It has long been an ultimate goal to introduce chemical do** at the atomic level to precisely tune properties of materials. Two-dimensional materials have natural advantage because of its highly-exposed surface atoms, however, it is still a grand challenge to achieve this goal experimentally. Here, we demonstrate the ability to introduce chemical do** in graphene with atomic-level precision by…
▽ More
It has long been an ultimate goal to introduce chemical do** at the atomic level to precisely tune properties of materials. Two-dimensional materials have natural advantage because of its highly-exposed surface atoms, however, it is still a grand challenge to achieve this goal experimentally. Here, we demonstrate the ability to introduce chemical do** in graphene with atomic-level precision by controlling chemical adsorption of individual Se atoms, which are extracted from the underneath WSe2, at the interface of graphene-WSe2 heterostructures. Our scanning tunneling microscopy (STM) measurements, combined with first-principles calculations, reveal that individual Se atoms can chemisorbed on three possible positions in graphene, which generate distinct pseudospin-mediated atomic-scale vortices in graphene. We demonstrate that the chemisorbed positions of individual Se atoms can be manipulated by STM tip, which enables us to achieve atomic-scale controlling quantum interference of the pseudospin-mediated vortices in graphene. This result offers the promise of controlling properties of materials through chemical do** with atomic-level precision.
△ Less
Submitted 11 November, 2023;
originally announced November 2023.
-
Generative Design of inorganic compounds using deep diffusion language models
Authors:
Rongzhi Dong,
Nihang Fu,
dirisuriya M. D. Siriwardane,
Jianjun Hu
Abstract:
Due to the vast chemical space, discovering materials with a specific function is challenging. Chemical formulas are obligated to conform to a set of exacting criteria such as charge neutrality, balanced electronegativity, synthesizability, and mechanical stability. In response to this formidable task, we introduce a deep learning-based generative model for material composition and structure desig…
▽ More
Due to the vast chemical space, discovering materials with a specific function is challenging. Chemical formulas are obligated to conform to a set of exacting criteria such as charge neutrality, balanced electronegativity, synthesizability, and mechanical stability. In response to this formidable task, we introduce a deep learning-based generative model for material composition and structure design by learning and exploiting explicit and implicit chemical knowledge. Our pipeline first uses deep diffusion language models as the generator of compositions and then applies a template-based crystal structure prediction algorithm to predict their corresponding structures, which is then followed by structure relaxation using a universal graph neural network-based potential. The density functional theory (DFT) calculations of the formation energies and energy-above-the-hull analysis are used to validate new structures generated through our pipeline. Based on the DFT calculation results, six new materials, including Ti2HfO5, TaNbP, YMoN2, TaReO4, HfTiO2, and HfMnO2, with formation energy less than zero have been found. Remarkably, among these, four materials, namely Ti2$HfO5, TaNbP, YMoN2, and TaReO4, exhibit an e-above-hull energy of less than 0.3 eV. These findings have proved the effectiveness of our approach.
△ Less
Submitted 30 September, 2023;
originally announced October 2023.
-
Improving realistic material property prediction using domain adaptation based machine learning
Authors:
Jeffrey Hu,
David Liu,
Nihang Fu,
Rongzhi Dong
Abstract:
Materials property prediction models are usually evaluated using random splitting of datasets into training and test datasets, which not only leads to over-estimated performance due to inherent redundancy, typically existent in material datasets, but also deviate away from the common practice of materials scientists: they are usually interested in predicting properties for a known subset of relate…
▽ More
Materials property prediction models are usually evaluated using random splitting of datasets into training and test datasets, which not only leads to over-estimated performance due to inherent redundancy, typically existent in material datasets, but also deviate away from the common practice of materials scientists: they are usually interested in predicting properties for a known subset of related out-of-distribution (OOD) materials rather than a universally distributed samples. Feeding such target material formulas/structures to the machine learning models should improve the prediction performance while most current machine learning (ML) models neglect this information. Here we propose to use domain adaptation (DA) to enhance current ML models for property prediction and evaluate their performance improvements in a set of five realistic application scenarios. Our systematic benchmark studies show that there exist DA models that can significantly improve the OOD test set prediction performance while standard ML models and most of the other DAs cannot improve or even deteriorate the performance. Our benchmark datasets and DA code can be freely accessed at https://github.com/Little-Cheryl/MatDA.
△ Less
Submitted 26 May, 2024; v1 submitted 5 August, 2023;
originally announced August 2023.
-
Global map** of structures and properties of crystal materials
Authors:
Qinyang Li,
Rongzhi Dong,
Nihang Fu,
Sadman Sadeed Omee,
Lai Wei,
Jianjun Hu
Abstract:
Understanding material composition-structure-function relationships is of critical importance for the design and discovery of novel functional materials. While most such studies focus on individual materials, we conducted a global map** study of all known materials deposited in the Material Project database to investigate their distributions in the space of a set of seven compositional, structur…
▽ More
Understanding material composition-structure-function relationships is of critical importance for the design and discovery of novel functional materials. While most such studies focus on individual materials, we conducted a global map** study of all known materials deposited in the Material Project database to investigate their distributions in the space of a set of seven compositional, structural, physical, and neural latent descriptors. These two-dimensional materials maps along with their density maps allow us to illustrate the distribution of the patterns and clusters of different shapes, which indicates the propensity of these materials and the tinkering history of existing materials. We then overlap the material properties such as composition prototypes and piezoelectric properties over the background materials maps to study the relationships of how material compositions and structures affect their physical properties. We also use these maps to study the spatial distributions of properties of known inorganic materials, in particular those of local vicinities in structural space such as structural density and functional diversity. These maps provide a uniquely comprehensive overview of materials and space and thus reveal previously undescribed fundamental properties. Our methodology can be easily extended by other researchers to generate their own global material maps with different background maps and overlap properties for both distribution understanding and cluster-based new material discovery. The source code for feature generation and generated maps are available at https://github.com/usccolumbia/matglobalmap**
△ Less
Submitted 13 February, 2023;
originally announced February 2023.
-
Discovery of 2D materials using Transformer Network based Generative Design
Authors:
Rongzhi Dong,
Yuqi Song,
Edirisuriya M. D. Siriwardane,
Jianjun Hu
Abstract:
Two-dimensional (2D) materials have wide applications in superconductors, quantum, and topological materials. However, their rational design is not well established, and currently less than 6,000 experimentally synthesized 2D materials have been reported. Recently, deep learning, data-mining, and density functional theory (DFT)-based high-throughput calculations are widely performed to discover po…
▽ More
Two-dimensional (2D) materials have wide applications in superconductors, quantum, and topological materials. However, their rational design is not well established, and currently less than 6,000 experimentally synthesized 2D materials have been reported. Recently, deep learning, data-mining, and density functional theory (DFT)-based high-throughput calculations are widely performed to discover potential new materials for diverse applications. Here we propose a generative material design pipeline, namely material transformer generator(MTG), for large-scale discovery of hypothetical 2D materials. We train two 2D materials composition generators using self-learning neural language models based on Transformers with and without transfer learning. The models are then used to generate a large number of candidate 2D compositions, which are fed to known 2D materials templates for crystal structure prediction. Next, we performed DFT computations to study their thermodynamic stability based on energy-above-hull and formation energy. We report four new DFT-verified stable 2D materials with zero e-above-hull energies, including NiCl$_4$, IrSBr, CuBr$_3$, and CoBrCl. Our work thus demonstrates the potential of our MTG generative materials design pipeline in the discovery of novel 2D materials and other functional materials.
△ Less
Submitted 14 January, 2023;
originally announced January 2023.
-
Materials Property Prediction with Uncertainty Quantification: A Benchmark Study
Authors:
Daniel Varivoda,
Rongzhi Dong,
Sadman Sadeed Omee,
Jianjun Hu
Abstract:
Uncertainty quantification (UQ) has increasing importance in building robust high-performance and generalizable materials property prediction models. It can also be used in active learning to train better models by focusing on getting new training data from uncertain regions. There are several categories of UQ methods each considering different types of uncertainty sources. Here we conduct a compr…
▽ More
Uncertainty quantification (UQ) has increasing importance in building robust high-performance and generalizable materials property prediction models. It can also be used in active learning to train better models by focusing on getting new training data from uncertain regions. There are several categories of UQ methods each considering different types of uncertainty sources. Here we conduct a comprehensive evaluation on the UQ methods for graph neural network based materials property prediction and evaluate how they truly reflect the uncertainty that we want in error bound estimation or active learning. Our experimental results over four crystal materials datasets (including formation energy, adsorption energy, total energy, and band gap properties) show that the popular ensemble methods for uncertainty estimation is NOT the best choice for UQ in materials property prediction. For the convenience of the community, all the source code and data sets can be accessed freely at \url{https://github.com/usccolumbia/materialsUQ}.
△ Less
Submitted 11 November, 2022; v1 submitted 3 November, 2022;
originally announced November 2022.
-
Materials Transformers Language Models for Generative Materials Design: a benchmark study
Authors:
Nihang Fu,
Lai Wei,
Yuqi Song,
Qinyang Li,
Rui Xin,
Sadman Sadeed Omee,
Rongzhi Dong,
Edirisuriya M. Dilanga Siriwardane,
Jianjun Hu
Abstract:
Pre-trained transformer language models on large unlabeled corpus have produced state-of-the-art results in natural language processing, organic molecule design, and protein sequence generation. However, no such models have been applied to learn the composition patterns of inorganic materials. Here we train a series of seven modern transformer language models (GPT, GPT-2, GPT-Neo, GPT-J, BLMM, BAR…
▽ More
Pre-trained transformer language models on large unlabeled corpus have produced state-of-the-art results in natural language processing, organic molecule design, and protein sequence generation. However, no such models have been applied to learn the composition patterns of inorganic materials. Here we train a series of seven modern transformer language models (GPT, GPT-2, GPT-Neo, GPT-J, BLMM, BART, and RoBERTa) using the expanded formulas from material deposited in the ICSD, OQMD, and Materials Projects databases. Six different datasets with/out non-charge-neutral or balanced electronegativity samples are used to benchmark the performances and uncover the generation biases of modern transformer models for the generative design of materials compositions. Our extensive experiments showed that the causal language models based materials transformers can generate chemically valid materials compositions with as high as 97.54\% to be charge neutral and 91.40\% to be electronegativity balanced, which has more than 6 times higher enrichment compared to a baseline pseudo-random sampling algorithm. These models also demonstrate high novelty and their potential in new materials discovery has been proved by their capability to recover the leave-out materials. We also find that the properties of the generated samples can be tailored by training the models with selected training sets such as high-bandgap materials. Our experiments also showed that different models each have their own preference in terms of the properties of the generated samples and their running time complexity varies a lot. We have applied our materials transformer models to discover a set of new materials as validated using DFT calculations.
△ Less
Submitted 27 June, 2022;
originally announced June 2022.
-
DeepXRD, a Deep Learning Model for Predicting of XRD spectrum from Materials Composition
Authors:
Rongzhi Dong,
Yong Zhao,
Yuqi Song,
Nihang Fu,
Sadman Sadeed Omee,
Sourin Dey,
Qinyang Li,
Lai Wei,
Jianjun Hu
Abstract:
One of the long-standing problems in materials science is how to predict a material's structure and then its properties given only its composition. Experimental characterization of crystal structures has been widely used for structure determination, which is however too expensive for high-throughput screening. At the same time, directly predicting crystal structures from compositions remains a cha…
▽ More
One of the long-standing problems in materials science is how to predict a material's structure and then its properties given only its composition. Experimental characterization of crystal structures has been widely used for structure determination, which is however too expensive for high-throughput screening. At the same time, directly predicting crystal structures from compositions remains a challenging unsolved problem. Herein we propose a deep learning algorithm for predicting the XRD spectrum given only the composition of a material, which can then be used to infer key structural features for downstream structural analysis such as crystal system or space group classification or crystal lattice parameter determination or materials property predictions. Benchmark studies on two datasets show that our DeepXRD algorithm can achieve good performance for XRD prediction as evaluated over our test sets. It can thus be used in high-throughput screening in the huge materials composition space for new materials discovery.
△ Less
Submitted 27 March, 2022;
originally announced March 2022.
-
TCSP: a Template based crystal structure prediction algorithm and web server for materials discovery
Authors:
Lai Wei,
Nihang Fu,
Edirisuriya M. D. Siriwardane,
Wenhui Yang,
Sadman Sadeed Omee,
Rongzhi Dong,
Rui Xin,
Jianjun Hu
Abstract:
Fast and accurate crystal structure prediction (CSP) algorithms and web servers are highly desirable for exploring and discovering new materials out of the infinite design space. However, currently, the computationally expensive first principle calculation based crystal structure prediction algorithms are applicable to relatively small systems and are out of reach of most materials researchers due…
▽ More
Fast and accurate crystal structure prediction (CSP) algorithms and web servers are highly desirable for exploring and discovering new materials out of the infinite design space. However, currently, the computationally expensive first principle calculation based crystal structure prediction algorithms are applicable to relatively small systems and are out of reach of most materials researchers due to the requirement of high computing resources or the software cost related to ab initio code such as VASP. Several computational teams have used an element substitution approach for generating or predicting new structures, but usually in an ad hoc way. Here we develop a template based crystal structure prediction algorithm (TCSP) and its companion web server, which makes this tool to be accessible to all materials researchers. Our algorithm uses elemental/chemical similarity and oxidation states to guide the selection of template structures and then rank them based on the substitution compatibility and can return multiple predictions with ranking scores in a few minutes. Benchmark study on the ~98,290 formulas of the Materials Project database using leave-one-out evaluation shows that our algorithm can achieve high accuracy (for 13,145 target structures, TCSP predicted their structures with RMSD < 0.1) for a large portion of the formulas. We have also used TCSP to discover new materials of the Ga-B-N system showing its potential for high-throughput materials discovery. Our user-friendly web app TCSP can be accessed freely at \url{www.materialsatlas.org/crystalstructure} on our MaterialsAtlas.org web app platform.
△ Less
Submitted 27 November, 2021;
originally announced November 2021.
-
Scalable deeper graph neural networks for high-performance materials property prediction
Authors:
Sadman Sadeed Omee,
Steph-Yves Louis,
Nihang Fu,
Lai Wei,
Sourin Dey,
Rongzhi Dong,
Qinyang Li,
Jianjun Hu
Abstract:
Machine learning (ML) based materials discovery has emerged as one of the most promising approaches for breakthroughs in materials science. While heuristic knowledge based descriptors have been combined with ML algorithms to achieve good performance, the complexity of the physicochemical mechanisms makes it urgently needed to exploit representation learning from either compositions or structures f…
▽ More
Machine learning (ML) based materials discovery has emerged as one of the most promising approaches for breakthroughs in materials science. While heuristic knowledge based descriptors have been combined with ML algorithms to achieve good performance, the complexity of the physicochemical mechanisms makes it urgently needed to exploit representation learning from either compositions or structures for building highly effective materials machine learning models. Among these methods, the graph neural networks have shown the best performance by its capability to learn high-level features from crystal structures. However, all these models suffer from their inability to scale up the models due to the over-smoothing issue of their message-passing GNN architecture. Here we propose a novel graph attention neural network model DeeperGATGNN with differentiable group normalization and skip-connections, which allows to train very deep graph neural network models (e.g. 30 layers compared to 3-9 layers in previous works). Through systematic benchmark studies over six benchmark datasets for energy and band gap predictions, we show that our scalable DeeperGATGNN model needs little costly hyper-parameter tuning for different datasets and achieves the state-of-the-art prediction performances over five properties out of six with up to 10\% improvement. Our work shows that to deal with the high complexity of map** the crystal materials structures to their properties, large-scale very deep graph neural networks are needed to achieve robust performances.
△ Less
Submitted 25 September, 2021;
originally announced September 2021.
-
Stiffness and atomic-scale friction in superlubricant MoS$_2$ bilayers
Authors:
Rui Dong,
Alessandro Lunghi,
Stefano Sanvito
Abstract:
By using ab-initio-accurate force fields and molecular dynamics simulations we demonstrate that the layer stiffness has profound effects on the superlubricant state of two-dimensional van der Waals heterostructures. These are engineered to have identical inter-layer sliding energy surfaces, but layers of different rigidity, so that the effects of the stiffness on the microscopic friction in the su…
▽ More
By using ab-initio-accurate force fields and molecular dynamics simulations we demonstrate that the layer stiffness has profound effects on the superlubricant state of two-dimensional van der Waals heterostructures. These are engineered to have identical inter-layer sliding energy surfaces, but layers of different rigidity, so that the effects of the stiffness on the microscopic friction in the superlubricant state can be isolated. A twofold increase in the intra-layer stiffness reduces the friction by approximately a factor six. Most importantly, we find two sliding regimes as a function of the sliding velocity. At low velocity the heat generated by the motion is efficiently exchanged between the layers and the friction is independent on whether the sliding layer is softer or harder than the substrate. In contrast, at high velocity the friction heat flux cannot be exchanged fast enough, and the build up of significant temperature gradients between the layers is observed. In this situation the temperature profile depends on whether the slider is softer than the substrate.
△ Less
Submitted 1 July, 2021;
originally announced July 2021.
-
Composition based crystal materials symmetry prediction using machine learning with enhanced descriptors
Authors:
Yuxin Li,
Rongzhi Dong,
Wenhui Yang,
Jianjun Hu
Abstract:
Geometric information such as the space groups and crystal systems plays an important role in the properties of crystal materials. Prediction of crystal system and space group thus has wide applications in crystal material property estimation and structure prediction. Previous works on experimental X-ray diffraction (XRD) and density functional theory (DFT) based structure determination methods ac…
▽ More
Geometric information such as the space groups and crystal systems plays an important role in the properties of crystal materials. Prediction of crystal system and space group thus has wide applications in crystal material property estimation and structure prediction. Previous works on experimental X-ray diffraction (XRD) and density functional theory (DFT) based structure determination methods achieved outstanding performance, but they are not applicable for large-scale screening of materials compositions. There are also machine learning models using Magpie descriptors for composition based material space group determination, but their prediction accuracy only ranges between 0.638 and 0.907 in different kinds of crystals. Herein, we report an improved machine learning model for predicting the crystal system and space group of materials using only the formula information. Benchmark study on a dataset downloaded from Materials Project Database shows that our random forest models based on our new descriptor set, achieve significant performance improvements compared with previous work with accuracy scores ranging between 0.712 and 0.961 in terms of space group classification. Our model also shows large performance improvement for crystal system prediction. Trained models and source code are freely available at \url{https://github.com/Yuxinya/SG_predict}
△ Less
Submitted 15 May, 2021;
originally announced May 2021.
-
Crystal structure prediction of materials with high symmetry using differential evolution
Authors:
Wenhui Yang,
Edirisuriya M. Dilanga Siriwardane,
Rongzhi Dong,
Yuxin Li,
Jianjun Hu
Abstract:
Crystal structure determines properties of materials. With the crystal structure of a chemical substance, many physical and chemical properties can be predicted by first-principles calculations or machine learning models. Since it is relatively easy to generate a hypothetical chemically valid formula, crystal structure prediction becomes an important method for discovering new materials. In our pr…
▽ More
Crystal structure determines properties of materials. With the crystal structure of a chemical substance, many physical and chemical properties can be predicted by first-principles calculations or machine learning models. Since it is relatively easy to generate a hypothetical chemically valid formula, crystal structure prediction becomes an important method for discovering new materials. In our previous work, we proposed a contact map-based crystal structure prediction method, which uses global optimization algorithms such as genetic algorithms to maximize the match between the contact map of the predicted structure and the contact map of the real crystal structure to search for the coordinates at the Wyckoff Positions(WP). However, when predicting the crystal structure with high symmetry, we found that the global optimization algorithm has difficulty to find an effective combination of WPs that satisfies the chemical formula, which is mainly caused by the inconsistency between the dimensionality of the contact map of the predicted crystal structure and the dimensionality of the contact map of the target crystal structure. This makes it challenging to predict the crystal structures of high-symmetry crystals. In order to solve this problem, here we propose to use PyXtal to generate and filter random crystal structures with given symmetry constraints based on the information such as chemical formulas and space groups. With contact map as the optimization goal, we use differential evolution algorithms to search for non-special coordinates at the Wyckoff positions to realize the structure prediction of high-symmetry crystal materials. Our experimental results show that our proposed algorithm CMCrystalHS can effectively solve the problem of inconsistent contact map dimensions and predict the crystal structures with high symmetry.
△ Less
Submitted 20 April, 2021;
originally announced April 2021.
-
AlphaCrystal: Contact map based crystal structure prediction using deep learning
Authors:
Jianjun Hu,
Yong Zhao,
Qin Li,
Yuqi Song,
Rongzhi Dong,
Wenhui Yang,
Edirisuriya MD Siriwardane
Abstract:
Crystal structure prediction is one of the major unsolved problems in materials science. Traditionally, this problem is formulated as a global optimization problem for which global search algorithms are combined with first principle free energy calculations to predict the ground-state crystal structure given only a material composition or a chemical system. These ab initio algorithms usually canno…
▽ More
Crystal structure prediction is one of the major unsolved problems in materials science. Traditionally, this problem is formulated as a global optimization problem for which global search algorithms are combined with first principle free energy calculations to predict the ground-state crystal structure given only a material composition or a chemical system. These ab initio algorithms usually cannot exploit a large amount of implicit physicochemical rules or geometric constraints (deep knowledge) of atom configurations embodied in a large number of known crystal structures. Inspired by the deep learning enabled breakthrough in protein structure prediction, herein we propose AlphaCrystal, a crystal structure prediction algorithm that combines a deep residual neural network model that learns deep knowledge to guide predicting the atomic contact map of a target crystal material followed by reconstructing its 3D crystal structure using genetic algorithms. Based on the experiments of a selected set of benchmark crystal materials, we show that our AlphaCrystal algorithm can predict structures close to the ground truth structures. It can also speed up the crystal structure prediction process by predicting and exploiting the predicted contact map so that it has the potential to handle relatively large systems. We believe that our deep learning based ab initio crystal structure prediction method that learns from existing material structures can be used to scale up current crystal structure prediction practice. To our knowledge, AlphaCrystal is the first neural network based algorithm for crystal structure contact map prediction and the first method for directly reconstructing crystal structures from materials composition, which can be further optimized by DFT calculations.
△ Less
Submitted 10 June, 2023; v1 submitted 2 February, 2021;
originally announced February 2021.
-
MLatticeABC: Generic Lattice Constant Prediction of Crystal Materials using Machine Learning
Authors:
Yuxin Li,
Wenhui Yang,
Rongzhi Dong,
Jianjun Hu
Abstract:
Lattice constants such as unit cell edge lengths and plane angles are important parameters of the periodic structures of crystal materials. Predicting crystal lattice constants has wide applications in crystal structure prediction and materials property prediction. Previous work has used machine learning models such as neural networks and support vector machines combined with composition features…
▽ More
Lattice constants such as unit cell edge lengths and plane angles are important parameters of the periodic structures of crystal materials. Predicting crystal lattice constants has wide applications in crystal structure prediction and materials property prediction. Previous work has used machine learning models such as neural networks and support vector machines combined with composition features for lattice constant prediction and has achieved a maximum performance for cubic structures with an average $R^2$ of 0.82. Other models tailored for special materials family of a fixed form such as ABX3 perovskites can achieve much higher performance due to the homogeneity of the structures. However, these models trained with small datasets are usually not applicable to generic lattice parameter prediction of materials with diverse compositions. Herein, we report MLatticeABC, a random forest machine learning model with a new descriptor set for lattice unit cell edge length ($a,b,c$) prediction which achieves an R2 score of 0.979 for lattice parameter $a$ of cubic crystals and significant performance improvement for other crystal systems as well. Source code and trained models can be freely accessed at https://github.com/usccolumbia/MLatticeABC
△ Less
Submitted 30 October, 2020;
originally announced October 2020.
-
Inverse Design of Composite Metal Oxide Optical Materials based on Deep Transfer Learning
Authors:
Rongzhi Dong,
Yabo Dan,
Xiang Li,
Jianjun Hu
Abstract:
Optical materials with special optical properties are widely used in a broad span of technologies, from computer displays to solar energy utilization leading to large dataset accumulated from years of extensive materials synthesis and optical characterization. Previously, machine learning models have been developed to predict the optical absorption spectrum from a materials characterization image…
▽ More
Optical materials with special optical properties are widely used in a broad span of technologies, from computer displays to solar energy utilization leading to large dataset accumulated from years of extensive materials synthesis and optical characterization. Previously, machine learning models have been developed to predict the optical absorption spectrum from a materials characterization image or vice versa. Herein we propose TLOpt, a transfer learning based inverse optical materials design algorithm for suggesting material compositions with a desired target light absorption spectrum. Our approach is based on the combination of a deep neural network model and global optimization algorithms including a genetic algorithm and Bayesian optimization. A transfer learning strategy is employed to solve the small dataset issue in training the neural network predictor of optical absorption spectrum using the Magpie materials composition descriptor. Our extensive experiments show that our algorithm can inverse design the materials composition with stoichiometry with high accuracy.
△ Less
Submitted 24 August, 2020;
originally announced August 2020.
-
Contact Map based Crystal Structure Prediction using Global Optimization
Authors:
Jianjun Hu,
Wenhui Yang,
Rongzhi Dong,
Yuxin Li,
Xiang Li,
Shaobo Li
Abstract:
Crystal structure prediction is now playing an increasingly important role in discovery of new materials. Global optimization methods such as genetic algorithms (GA) and particle swarm optimization (PSO) have been combined with first principle free energy calculations to predict crystal structures given composition or only a chemical system. While these approaches can exploit certain crystal patte…
▽ More
Crystal structure prediction is now playing an increasingly important role in discovery of new materials. Global optimization methods such as genetic algorithms (GA) and particle swarm optimization (PSO) have been combined with first principle free energy calculations to predict crystal structures given composition or only a chemical system. While these approaches can exploit certain crystal patterns such as symmetry and periodicity in their search process, they usually do not exploit the large amount of implicit rules and constraints of atom configurations embodied in the large number of known crystal structures. They currently can only handle crystal structure prediction of relatively small systems. Inspired by the knowledge-rich protein structure prediction approach, herein we explore whether known geometric constraints such as the atomic contact map of a target crystal material can help predict its structure given its space group information. We propose a global optimization based algorithm, CMCrystal, for crystal structure reconstruction based on atomic contact maps. Based on extensive experiments using six global optimization algorithms, we show that it is viable to reconstruct the crystal structure given the atomic contact map for some crystal materials but more constraints are needed for other target materials to achieve successful reconstruction. This implies that atomic interaction information learned from existing materials can be used to improve crystal structure prediction.
△ Less
Submitted 7 February, 2021; v1 submitted 16 August, 2020;
originally announced August 2020.
-
Orbital Dependent Electronic Masses in Ce Heavy Fermion Materials studied via Gutzwiller Density Functional Theory
Authors:
Ruanchen Dong,
Xiangang Wan,
Xi Dai,
Sergey Y. Savrasov
Abstract:
A series of Cerium based heavy fermion materials is studied using a combination of local density functional theory and many-body Gutzwiller approximation. Computed orbial dependent electronic mass enhancements parameters are compared with available data extracted from measured values of the Sommerfeld coefficient. The Gutzwiller density functional theory is shown to remarkably follow the trends ac…
▽ More
A series of Cerium based heavy fermion materials is studied using a combination of local density functional theory and many-body Gutzwiller approximation. Computed orbial dependent electronic mass enhancements parameters are compared with available data extracted from measured values of the Sommerfeld coefficient. The Gutzwiller density functional theory is shown to remarkably follow the trends across a variety of Ce compounds, and to give important insights on orbital selective mass renormalizations that allows a better understanding of wide spread of data.
△ Less
Submitted 12 March, 2014; v1 submitted 23 January, 2014;
originally announced January 2014.
-
Wafer bonding solution to epitaxial graphene - silicon integration
Authors:
Rui Dong,
Zelei Guo,
James Palmer,
Yike Hu,
Ming Ruan,
John Hankinson,
Jan Kunc,
Swapan K Bhattacharya,
Claire Berger,
Walt A. de Heer
Abstract:
The development of graphene electronics requires the integration of graphene devices with Si-CMOS technology. Most strategies involve the transfer of graphene sheets onto silicon, with the inherent difficulties of clean transfer and subsequent graphene nano-patterning that degrades considerably the electronic mobility of nanopatterned graphene. Epitaxial graphene (EG) by contrast is grown on an es…
▽ More
The development of graphene electronics requires the integration of graphene devices with Si-CMOS technology. Most strategies involve the transfer of graphene sheets onto silicon, with the inherent difficulties of clean transfer and subsequent graphene nano-patterning that degrades considerably the electronic mobility of nanopatterned graphene. Epitaxial graphene (EG) by contrast is grown on an essentially perfect crystalline (semi-insulating) surface, and graphene nanostructures with exceptional properties have been realized by a selective growth process on tailored SiC surface that requires no graphene patterning. However, the temperatures required in this structured growth process are too high for silicon technology. Here we demonstrate a new graphene to Si integration strategy, with a bonded and interconnected compact double-wafer structure. Using silicon-on-insulator technology (SOI) a thin monocrystalline silicon layer ready for CMOS processing is applied on top of epitaxial graphene on SiC. The parallel Si and graphene platforms are interconnected by metal vias. This method inspired by the industrial development of 3d hyper-integration stacking thin-film electronic devices preserves the advantages of epitaxial graphene and enables the full spectrum of CMOS processing.
△ Less
Submitted 12 August, 2013;
originally announced August 2013.
-
Record Maximum Oscillation Frequency in C-face Epitaxial Graphene Transistors
Authors:
Zelei Guo,
Rui Dong,
Partha Sarathi Chakraborty,
Nelson Lourenco,
James Palmer,
Yike Hu,
Ming Ruan,
John Hankinson,
Jan Kunc,
John D. Cressler,
Claire Berger,
Walt A. de Heer
Abstract:
The maximum oscillation frequency (fmax) quantifies the practical upper bound for useful circuit operation. We report here an fmax of 70 GHz in transistors using epitaxial graphene grown on the C-face of SiC. This is a significant improvement over Si-face epitaxial graphene used in the prior high frequency transistor studies, exemplifying the superior electronics potential of C-face epitaxial grap…
▽ More
The maximum oscillation frequency (fmax) quantifies the practical upper bound for useful circuit operation. We report here an fmax of 70 GHz in transistors using epitaxial graphene grown on the C-face of SiC. This is a significant improvement over Si-face epitaxial graphene used in the prior high frequency transistor studies, exemplifying the superior electronics potential of C-face epitaxial graphene. Careful transistor design using a high κ dielectric T-gate and self-aligned contacts, further contributed to the record-breaking fmax.
△ Less
Submitted 15 February, 2013;
originally announced February 2013.
-
Scaling Between Periodic Anderson and Kondo Lattice Models
Authors:
R. Dong,
J. Otsuki,
S. Y. Savrasov
Abstract:
Continuous-Time Quantum Monte Carlo (CT-QMC) method combined with Dynamical Mean Field Theory (DMFT) is used to calculate both Periodic Anderson Model (PAM) and Kondo Lattice Model (KLM). Different parameter sets of both models are connected by the Schrieffer-Wolff transformation. For degeneracy N=2, a special particle-hole symmetric case of PAM at half filling which always fixes one electron per…
▽ More
Continuous-Time Quantum Monte Carlo (CT-QMC) method combined with Dynamical Mean Field Theory (DMFT) is used to calculate both Periodic Anderson Model (PAM) and Kondo Lattice Model (KLM). Different parameter sets of both models are connected by the Schrieffer-Wolff transformation. For degeneracy N=2, a special particle-hole symmetric case of PAM at half filling which always fixes one electron per impurity site is compared with the results of the KLM. We find a good map** between PAM and KLM in the limit of large on-site Hubbard interaction U for different properties like self-energy, quasiparticle residue and susceptibility. This allows us to extract quasiparticle mass renormalizations for the f electrons directly from KLM. The method is further applied to higher degenerate case and to realsitic heavy fermion system CeRhIn5 in which the estimate of the Sommerfeld coefficient is proven to be close to the experimental value.
△ Less
Submitted 24 December, 2012;
originally announced December 2012.
-
Creep motion of a domain wall in the two-dimensional random-field Ising model with a driving field
Authors:
R. H. Dong,
B. Zheng,
N. J. Zhou
Abstract:
With Monte Carlo simulations, we study the creep motion of a domain wall in the two-dimensional random-field Ising model with a driving field. We observe the nonlinear fieldvelocity relation, and determine the creep exponent μ. To further investigate the universality class of the creep motion, we also measure the roughness exponent ζ and energy barrier exponent ψ from the zero-field relaxation pro…
▽ More
With Monte Carlo simulations, we study the creep motion of a domain wall in the two-dimensional random-field Ising model with a driving field. We observe the nonlinear fieldvelocity relation, and determine the creep exponent μ. To further investigate the universality class of the creep motion, we also measure the roughness exponent ζ and energy barrier exponent ψ from the zero-field relaxation process. We find that all the exponents depend on the strength of disorder.
△ Less
Submitted 11 September, 2012;
originally announced September 2012.
-
Hamiltonian equation of motion and depinning phase transition in two-dimensional magnets
Authors:
R. H. Dong,
B. Zheng,
N. J. Zhou
Abstract:
Based on the Hamiltonian equation of motion of the $φ^4$ theory with quenched disorder, we investigate the depinning phase transition of the domain-wall motion in two-dimensional magnets. With the short-time dynamic approach, we numerically determine the transition field, and the static and dynamic critical exponents. The results show that the fundamental Hamiltonian equation of motion belongs to…
▽ More
Based on the Hamiltonian equation of motion of the $φ^4$ theory with quenched disorder, we investigate the depinning phase transition of the domain-wall motion in two-dimensional magnets. With the short-time dynamic approach, we numerically determine the transition field, and the static and dynamic critical exponents. The results show that the fundamental Hamiltonian equation of motion belongs to a universality class very different from those effective equations of motion.
△ Less
Submitted 3 September, 2012;
originally announced September 2012.
-
Critical domain-wall dynamics of model B
Authors:
R. H. Dong,
B. Zheng,
N. J. Zhou
Abstract:
With Monte Carlo methods, we simulate the critical domain-wall dynamics of model B, taking the two-dimensional Ising model as an example. In the macroscopic short-time regime, a dynamic scaling form is revealed. Due to the existence of the quasi-random walkers, the magnetization shows intrinsic dependence on the lattice size $L$. A new exponent which governs the $L$-dependence of the magnetization…
▽ More
With Monte Carlo methods, we simulate the critical domain-wall dynamics of model B, taking the two-dimensional Ising model as an example. In the macroscopic short-time regime, a dynamic scaling form is revealed. Due to the existence of the quasi-random walkers, the magnetization shows intrinsic dependence on the lattice size $L$. A new exponent which governs the $L$-dependence of the magnetization is measured to be $σ=0.243(8)$.
△ Less
Submitted 3 September, 2012;
originally announced September 2012.
-
Structured epitaxial graphene: growth and properties
Authors:
Yike Hu,
Ming Ruan,
Zelei Guo,
Rui Dong,
James Palmer,
John Hankinson,
Claire Berger,
Walt A. de Heer
Abstract:
Graphene is generally considered to be a strong candidate to succeed silicon as an electronic material. However, to date, it actually has not yet demonstrated capabilities that exceed standard semiconducting materials. Currently demonstrated viable graphene devices are essentially limited to micron size ultrahigh frequency analog field effect transistors and quantum Hall effect devices for metrolo…
▽ More
Graphene is generally considered to be a strong candidate to succeed silicon as an electronic material. However, to date, it actually has not yet demonstrated capabilities that exceed standard semiconducting materials. Currently demonstrated viable graphene devices are essentially limited to micron size ultrahigh frequency analog field effect transistors and quantum Hall effect devices for metrology. Nanoscopically patterned graphene tends to have disordered edges that severely reduce mobilities thereby obviating its advantage over other materials. Here we show that graphene grown on structured silicon carbide surfaces overcomes the edge roughness and promises to provide an inroad into nanoscale patterning of graphene. We show that high quality ribbons and rings can be made using this technique. We also report on progress towards high mobility graphene monolayers on silicon carbide for device applications.
△ Less
Submitted 27 February, 2012;
originally announced February 2012.
-
Exact diagonalization: the Bose-Hubbard model as an example
Authors:
J. M. Zhang,
R. X. Dong
Abstract:
We take the Bose-Hubbard model to illustrate exact diagonalization techniques in a pedagogical way. We follow the road of first generating all the basis vectors, then setting up the Hamiltonian matrix with respect to this basis, and finally using the Lanczos algorithm to solve low lying eigenstates and eigenvalues. Emphasis is placed on how to enumerate all the basis vectors and how to use the has…
▽ More
We take the Bose-Hubbard model to illustrate exact diagonalization techniques in a pedagogical way. We follow the road of first generating all the basis vectors, then setting up the Hamiltonian matrix with respect to this basis, and finally using the Lanczos algorithm to solve low lying eigenstates and eigenvalues. Emphasis is placed on how to enumerate all the basis vectors and how to use the hashing trick to set up the Hamiltonian matrix or matrices corresponding to other quantities. Although our route is not necessarily the most efficient one in practice, the techniques and ideas introduced are quite general and may find use in many other problems.
△ Less
Submitted 19 February, 2011;
originally announced February 2011.