Showing 1–50 of 58 results for author: Kalinin, S V

Size Effect of Negative Capacitance State and Subthreshold Swing in Van der Waals Ferrielectric Field-Effect Transistors

Authors: Anna N. Morozovska, Eugene A. Eliseev, Yulian M. Vysochanskii, Sergei V. Kalinin, Maksym V. Strikha

Abstract: Analytical calculations corroborated by the finite element modelling show that thin films of Van der Waals ferrielectrics covered by a 2D-semiconductor are promising candidates for the controllable reduction of the dielectric layer capacitance due to the negative capacitance (NC) effect emerging in the ferrielectric film. The NC state is conditioned by energy-degenerated poly-domain states of the… ▽ More Analytical calculations corroborated by the finite element modelling show that thin films of Van der Waals ferrielectrics covered by a 2D-semiconductor are promising candidates for the controllable reduction of the dielectric layer capacitance due to the negative capacitance (NC) effect emerging in the ferrielectric film. The NC state is conditioned by energy-degenerated poly-domain states of the ferrielectric polarization induced in the films under incomplete screening conditions in the presence of a dielectric layer. Calculations performed for the FET-type heterostructure "ferrielectric CuInP2S6 film - 2D-MoS2 single-layer - SiO2 dielectric layer" reveal the pronounced size effect of the multilayer capacitance. Derived analytical expressions for the electric polarization and multilayer capacitance allow to predict the thickness range of the dielectric layer and ferrielectric film for which the NC effect is the most pronounced in various Van der Waals ferrielectrics, and the corresponding subthreshold swing becomes much less than the Boltzmann's limit. Obtained results can be useful for the size and temperature control of the NC effect in the steep-slope ferrielectric FETs. △ Less

Submitted 18 June, 2024; originally announced June 2024.

Comments: 40 pages, 6 figures, 4 Appendices

Implementing dynamic high-performance computing supported workflows on Scanning Transmission Electron Microscope

Authors: Utkarsh Pratiush, Austin Houston, Sergei V Kalinin, Gerd Duscher

Abstract: Scanning Transmission Electron Microscopy (STEM) coupled with Electron Energy Loss Spectroscopy (EELS) presents a powerful platform for detailed material characterization via rich imaging and spectroscopic data. Modern electron microscopes can access multiple length scales and sampling rates far beyond human perception and reaction time. Recent advancements in machine learning (ML) offer a promisi… ▽ More Scanning Transmission Electron Microscopy (STEM) coupled with Electron Energy Loss Spectroscopy (EELS) presents a powerful platform for detailed material characterization via rich imaging and spectroscopic data. Modern electron microscopes can access multiple length scales and sampling rates far beyond human perception and reaction time. Recent advancements in machine learning (ML) offer a promising avenue to enhance these capabilities by integrating ML algorithms into the STEM-EELS framework, fostering an environment of active learning. This work enables the seamless integration of STEM with High-Performance Computing (HPC) systems. We present several implemented workflows that exemplify this integration. These workflows include sophisticated techniques such as object finding and Deep Kernel Learning (DKL). Through these developments, we demonstrate how the fusion of STEM-EELS with ML and HPC enhances the efficiency and scope of material characterization for 70% STEM available globally. The codes are available at GitHub link. △ Less

Submitted 16 June, 2024; originally announced June 2024.

Ferri-ionic Coupling in CuInP$_2$S$_6$ Nanoflakes: Polarization States and Controllable Negative Capacitance

Authors: Anna N. Morozovska, Sergei V. Kalinin, Eugene. A. Eliseev, Svitlana Kopyl, Yulian M. Vysochanskii, Dean R. Evans

Abstract: We consider nanoflakes of van der Waals ferrielectric CuInP$_2$S$_6$ covered by an ionic surface charge and reveal the appearance of polar states with relatively high polarization ~5 microC/cm$^2$ and stored free charge ~10 microC/cm$%2$, which can mimic "mid-gap" states associated with a surface field-induced transfer of Cu and/or In ions in the van der Waals gap. The change in the ionic screenin… ▽ More We consider nanoflakes of van der Waals ferrielectric CuInP$_2$S$_6$ covered by an ionic surface charge and reveal the appearance of polar states with relatively high polarization ~5 microC/cm$^2$ and stored free charge ~10 microC/cm$%2$, which can mimic "mid-gap" states associated with a surface field-induced transfer of Cu and/or In ions in the van der Waals gap. The change in the ionic screening degree and mismatch strains induce a broad range of the transitions between paraelectric phase, antiferroelectric, ferrielectric, and ferri-ionic states in CuInP$_2$S$_6$ nanoflakes. The states' stability and/or metastability is determined by the minimum of the system free energy consisting of electrostatic energy, elastic energy, and a Landau-type four-well potential of the ferrielectric dipole polarization. The possibility to govern the transitions by strain and ionic screening can be useful for controlling the tunneling barrier in thin film devices based on CuInP$_2$S$_6$ nanoflakes. Also, we predict that the CuInP$_2$S$_6$ nanoflakes reveal features of the controllable negative capacitance effect, which make them attractive for advanced electronic devices, such as nano-capacitors and gate oxide nanomaterials with reduced heat dissipation. △ Less

Submitted 5 June, 2024; v1 submitted 23 May, 2024; originally announced May 2024.

Comments: 39 pages, including 6 figures and Appendix with 3 figures

Active Deep Kernel Learning of Molecular Functionalities: Realizing Dynamic Structural Embeddings

Authors: Ayana Ghosh, Maxim Ziatdinov and, Sergei V. Kalinin

Abstract: Exploring molecular spaces is crucial for advancing our understanding of chemical properties and reactions, leading to groundbreaking innovations in materials science, medicine, and energy. This paper explores an approach for active learning in molecular discovery using Deep Kernel Learning (DKL), a novel approach surpassing the limits of classical Variational Autoencoders (VAEs). Employing the QM… ▽ More Exploring molecular spaces is crucial for advancing our understanding of chemical properties and reactions, leading to groundbreaking innovations in materials science, medicine, and energy. This paper explores an approach for active learning in molecular discovery using Deep Kernel Learning (DKL), a novel approach surpassing the limits of classical Variational Autoencoders (VAEs). Employing the QM9 dataset, we contrast DKL with traditional VAEs, which analyze molecular structures based on similarity, revealing limitations due to sparse regularities in latent spaces. DKL, however, offers a more holistic perspective by correlating structure with properties, creating latent spaces that prioritize molecular functionality. This is achieved by recalculating embedding vectors iteratively, aligning with the experimental availability of target properties. The resulting latent spaces are not only better organized but also exhibit unique characteristics such as concentrated maxima representing molecular functionalities and a correlation between predictive uncertainty and error. Additionally, the formation of exclusion regions around certain compounds indicates unexplored areas with potential for groundbreaking functionalities. This study underscores DKL's potential in molecular research, offering new avenues for understanding and discovering molecular functionalities beyond classical VAE limitations. △ Less

Submitted 2 March, 2024; originally announced March 2024.

Physics-driven discovery and bandgap engineering of hybrid perovskites

Authors: Sheryl L. Sanchez, Elham Foadian, Maxim Ziatdinov, Jonghee Yang, Sergei V. Kalinin, Yongtao Liu, Mahshid Ahmadi

Abstract: The unique aspect of the hybrid perovskites is their tunability, allowing to engineer the bandgap via substitution. From application viewpoint, this allows creation of the tandem cells between perovskites and silicon, or two or more perovskites, with associated increase of efficiency beyond single-junction Schokley-Queisser limit. However, the concentration dependence of optical bandgap in the hyb… ▽ More The unique aspect of the hybrid perovskites is their tunability, allowing to engineer the bandgap via substitution. From application viewpoint, this allows creation of the tandem cells between perovskites and silicon, or two or more perovskites, with associated increase of efficiency beyond single-junction Schokley-Queisser limit. However, the concentration dependence of optical bandgap in the hybrid perovskite solid solutions can be non-linear and even non-monotonic, as determined by the band alignments between endmembers, presence of the defect states and Urbach tails, and phase separation. Exploring new compositions brings forth the joint problem of the discovery of the composition with the desired band gap, and establishing the physical model of the band gap concentration dependence. Here we report the development of the experimental workflow based on structured Gaussian Process (sGP) models and custom sGP (c-sGP) that allow the joint discovery of the experimental behavior and the underpinning physical model. This approach is verified with simulated data sets with known ground truth, and was found to accelerate the discovery of experimental behavior and the underlying physical model. The d/c-sGP approach utilizes a few calculated thin film bandgap data points to guide targeted explorations, minimizing the number of thin film preparations. Through iterative exploration, we demonstrate that the c-sGP algorithm that combined 5 bandgap models converges rapidly, revealing a relationship in the bandgap diagram of MA1-xGAxPb(I1-xBrx)3. This approach offers a promising method for efficiently understanding the physical model of band gap concentration dependence in the binary systems, this method can also be extended to ternary or higher dimensional systems. △ Less

Submitted 10 October, 2023; originally announced October 2023.

The strain-induced transitions of the piezoelectric, pyroelectric and electrocaloric properties of the CuInP$_2$S$_6$ films

Authors: Anna N. Morozovska, Eugene A. Eliseev, Lesya P. Yurchenko, Valentin V. Laguta, Yongtao Liu, Sergei V. Kalinin, Andrei L Kholkin, Yulian M. Vysochanskii

Abstract: The low-dimensional ferroelectrics, ferrielectrics and antiferroelectrics are of urgent scientific interest due to their unusual polar, piezoelectric, electrocaloric and pyroelectric properties. The strain engineering and strain control of the ferroelectric properties of layered 2D Van der Waals materials, such as CuInP$_2$(S,Se)$_6$ monolayers, thin films and nanoflakes, are of fundamental intere… ▽ More The low-dimensional ferroelectrics, ferrielectrics and antiferroelectrics are of urgent scientific interest due to their unusual polar, piezoelectric, electrocaloric and pyroelectric properties. The strain engineering and strain control of the ferroelectric properties of layered 2D Van der Waals materials, such as CuInP$_2$(S,Se)$_6$ monolayers, thin films and nanoflakes, are of fundamental interest and especially promising for their advanced applications in nanoscale nonvolatile memories, energy conversion and storage, nano-coolers and sensors. Here, we study the polar, piezoelectric, electrocaloric and pyroelectric properties of thin strained films of a ferrielectric CuInP$_2$S$_6$ covered by semiconducting electrodes and reveal an unusually strong effect of a mismatch strain on these properties. In particular, the sign of the mismatch strain and its magnitude determine the complicated behavior of piezoelectric, electrocaloric and pyroelectric responses. The strain effect on these properties is opposite, i.e., "anomalous", in comparison with many other ferroelectric films, for which the out-of-plane remanent polarization, piezoelectric, electrocaloric and pyroelectric responses increase strongly for tensile strains and decrease or vanish for compressive strains. △ Less

Submitted 17 November, 2023; v1 submitted 10 September, 2023; originally announced September 2023.

Comments: 16 pages, 5 figures, to be presented at the VI Lithuanian-Polish Meeting on Physics of Ferroelectrics. arXiv admin note: text overlap with arXiv:2304.04097

Roadmap on Deep Learning for Microscopy

Authors: Giovanni Volpe, Carolina Wählby, Lei Tian, Michael Hecht, Artur Yakimovich, Kristina Monakhova, Laura Waller, Ivo F. Sbalzarini, Christopher A. Metzler, Mingyang Xie, Kevin Zhang, Isaac C. D. Lenton, Halina Rubinsztein-Dunlop, Daniel Brunner, Bijie Bai, Aydogan Ozcan, Daniel Midtvedt, Hao Wang, Nataša Sladoje, Joakim Lindblad, Jason T. Smith, Marien Ochoa, Margarida Barroso, Xavier Intes, Tong Qiu , et al. (50 additional authors not shown)

Abstract: Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the… ▽ More Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences. △ Less

Submitted 7 March, 2023; originally announced March 2023.

Revealing intrinsic vortex-core states in Fe-based superconductors through machine-learning-driven discovery

Authors: Yueming Guo, Hu Miao, Qiang Zou, Mingming Fu, Athena S. Sefat, Andrew R. Lupini, Sergei V. Kalinin, Zheng Gai

Abstract: Electronic states within superconducting vortices hold crucial information about paring mechanisms and topology. While scanning tunneling microscopy/spectroscopy(STM/S) can image the vortices, it is difficult to isolate the intrinsic electronic states from extrinsic effects like subsurface defects and disorders. We combine STM/S with unsupervised machine learning to develop a method for screening… ▽ More Electronic states within superconducting vortices hold crucial information about paring mechanisms and topology. While scanning tunneling microscopy/spectroscopy(STM/S) can image the vortices, it is difficult to isolate the intrinsic electronic states from extrinsic effects like subsurface defects and disorders. We combine STM/S with unsupervised machine learning to develop a method for screening out the vortices pinned by embedded disorder in Fe-based superconductors. The approach provides an unbiased way to reveal intrinsic vortex-core states and may address puzzles on Majorana zero modes. △ Less

Submitted 18 February, 2023; originally announced February 2023.

Exploring the microstructural origins of conductivity and hysteresis in metal halide perovskites via active learning driven automated scanning probe microscopy

Authors: Yongtao Liu, Jonghee Yang, Rama K. Vasudevan, Kyle P. Kelley, Maxim Ziatdinov, Sergei V. Kalinin, Mahshid Ahmadi

Abstract: Electronic transport and hysteresis in metal halide perovskites (MHPs) are key to the applications in photovoltaics, light emitting devices, and light and chemical sensors. These phenomena are strongly affected by the materials microstructure including grain boundaries, ferroic domain walls, and secondary phase inclusions. Here, we demonstrate an active machine learning framework for 'driving' an… ▽ More Electronic transport and hysteresis in metal halide perovskites (MHPs) are key to the applications in photovoltaics, light emitting devices, and light and chemical sensors. These phenomena are strongly affected by the materials microstructure including grain boundaries, ferroic domain walls, and secondary phase inclusions. Here, we demonstrate an active machine learning framework for 'driving' an automated scanning probe microscope (SPM) to discover the microstructures responsible for specific aspects of transport behavior in MHPs. In our setup, the microscope can discover the microstructural elements that maximize the onset of conduction, hysteresis, or any other characteristic that can be derived from a set of current-voltage spectra. This approach opens new opportunities for exploring the origins of materials functionality in complex materials by SPM and can be integrated with other characterization techniques either before (prior knowledge) or after (identification of locations of interest for detail studies) functional probing. △ Less

Submitted 14 December, 2022; originally announced December 2022.

Comments: 19 pages; 7 figures

Disentangling electronic transport and hysteresis at individual grain boundaries in hybrid perovskites via automated scanning probe microscopy

Authors: Yongtao Liu, Jonghee Yang, Benjamin J. Lawrie, Kyle P. Kelley, Maxim Ziatdinov, Sergei V. Kalinin, Mahshid Ahmadi

Abstract: Underlying the rapidly increasing photovoltaic efficiency and stability of metal halide perovskites (MHPs) is the advance in the understanding of the microstructure of polycrystalline MHP thin film. Over the past decade, intense efforts have aimed to understand the effect of microstructure on MHP properties, including chemical heterogeneity, strain disorder, phase impurity, etc. It has been found… ▽ More Underlying the rapidly increasing photovoltaic efficiency and stability of metal halide perovskites (MHPs) is the advance in the understanding of the microstructure of polycrystalline MHP thin film. Over the past decade, intense efforts have aimed to understand the effect of microstructure on MHP properties, including chemical heterogeneity, strain disorder, phase impurity, etc. It has been found that grain and grain boundary (GB) are tightly related to lots of microscale and nanoscale behavior in MHP thin film. Atomic force microscopy (AFM) is widely used to observe grain and boundary structures in topography and subsequently to study the correlative surface potential and conductivity of these structures. For now, most AFM measurements have been performed in imaging mode to study the static behavior, in contrast, AFM spectroscopy mode allows us to investigate the dynamic behavior of materials, e.g. conductivity under swee** voltage. However, a major limitation of AFM spectroscopy measurements is that it requests manual operation by human operators, as such only limited data can be obtained, hindering systematic investigations of these microstructures. In this work, we designed a workflow combining the conductive AFM measurement with a machine learning (ML) algorithm to systematically investigate grain boundaries in MHPs. The trained ML model can extract GBs locations from the topography image, and the workflow drives the AFM probe to each GB location to perform a current-voltage (IV) curve automatically. Then, we are able to IV curves at all GB locations, allowing us to systematically understand the property of GBs. Using this method, we discover that the GB junction points are more photoactive, while most previous works only focused on the difference between GB and grains. △ Less

Submitted 25 October, 2022; originally announced October 2022.

Comments: 19 pages, 8 figures

Delineating complex ferroelectric domain structures via second harmonic generation spectral imaging

Authors: Wei Li, Yunpeng Ma, Tianyi Feng, Sergei V. Kalinin, **g-Feng Li, Qian Li

Abstract: Understanding the mechanisms and spatial correlations of crystallographic symmetry breaking in ferroelectric materials is essential to tuning their functional properties. While optical second harmonic generation (SHG) has long been utilized in ferroelectric studies, its capability for probing complex polar materials has yet to be fully realized. Here, we develop a SHG spectral imaging method imple… ▽ More Understanding the mechanisms and spatial correlations of crystallographic symmetry breaking in ferroelectric materials is essential to tuning their functional properties. While optical second harmonic generation (SHG) has long been utilized in ferroelectric studies, its capability for probing complex polar materials has yet to be fully realized. Here, we develop a SHG spectral imaging method implemented on a home-designed laser-scanning SHG microscope, and demonstrate its application for a model system of (K,Na)NbO3 single crystals. Supervised model fitting analysis produces comprehensive information about the polarization vector orientations and relative fractions of constituent domain variants as well as their thermal evolution across the polymorphic phase transitions. We observe an unexpected persistence of the orthorhombic phase at low temperatures, pointing to the phase competitions. Besides, we show that unsupervised matrix decomposition analysis can quickly and faithfully reveal domain configurations without a priori knowledge about specific material systems. The SHG spectral imaging method can be readily extended to other ferroelectric materials with potentials to be further enhanced. △ Less

Submitted 9 August, 2022; originally announced August 2022.

Comments: 16 pages, 4 figures

Learning and predicting photonic responses of plasmonic nanoparticle assemblies via dual variational autoencoders

Authors: Muammer Y. Yaman, Sergei V. Kalinin, Kathryn N. Guye, David Ginger, Maxim Ziatdinov

Abstract: We demonstrate the application of machine learning for rapid and accurate extraction of plasmonic particles cluster geometries from hyperspectral image data via a dual variational autoencoder (dual-VAE). In this approach, the information is shared between the latent spaces of two VAEs acting on the particle shape data and spectral data, respectively, but enforcing a common encoding on the shape-sp… ▽ More We demonstrate the application of machine learning for rapid and accurate extraction of plasmonic particles cluster geometries from hyperspectral image data via a dual variational autoencoder (dual-VAE). In this approach, the information is shared between the latent spaces of two VAEs acting on the particle shape data and spectral data, respectively, but enforcing a common encoding on the shape-spectra pairs. We show that this approach can establish the relationship between the geometric characteristics of nanoparticles and their far-field photonic responses, demonstrating that we can use hyperspectral darkfield microscopy to accurately predict the geometry (number of particles, arrangement) of a multiparticle assemblies below the diffraction limit in an automated fashion with high fidelity (for monomers (0.96), dimers (0.86), and trimers (0.58). This approach of building structure-property relationships via shared encoding is universal and should have applications to a broader range of materials science and physics problems in imaging of both molecular and nanomaterial systems. △ Less

Submitted 7 August, 2022; originally announced August 2022.

Comments: 12 pages, 5 figures

Probing temperature-induced phase transitions at individual ferroelectric domain walls

Authors: Kyle P. Kelley, Sergei V. Kalinin, Eugene Eliseev, Shivaranjan Raghuraman, Stephen Jesse, Peter Maksymovych, Anna N. Morozovska

Abstract: Ferroelectric domain walls have emerged as one of the most fascinating objects in condensed matter physics due to the broad variability of functional behaviors they exhibit. However, the vast majority of domain walls studies have been focused on bias-induced dynamics and transport behaviors. Here, we introduce the scanning probe microscopy approach based on piezoresponse force microscopy (PFM) wit… ▽ More Ferroelectric domain walls have emerged as one of the most fascinating objects in condensed matter physics due to the broad variability of functional behaviors they exhibit. However, the vast majority of domain walls studies have been focused on bias-induced dynamics and transport behaviors. Here, we introduce the scanning probe microscopy approach based on piezoresponse force microscopy (PFM) with a dynamically heated probe, combining local heating and local biasing of the material. This approach is used to explore the thermal polarization dynamics in soft Sn2P2S6 ferroelectrics, and allows for the exploration of phase transitions at individual domain walls. The strong and weak modulation regimes for the thermal PFM are introduced. The future potential applications of heated probe approach for functional SPM measurements including piezoelectric, elastic, microwave, and transport measurements are discussed. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Learning the right channel in multimodal imaging: automated experiment in Piezoresponse Force Microscopy

Authors: Yongtao Liu, Rama K. Vasudevan, Kyle P. Kelley, Hiroshi Funakubo, Maxim Ziatdinov, Sergei V. Kalinin

Abstract: We report the development and experimental implementation of the automated experiment workflows for the identification of the best predictive channel for a phenomenon of interest in spectroscopic measurements. The approach is based on the combination of ensembled deep kernel learning for probabilistic predictions and a basic reinforcement learning policy for channel selection. It allows the identi… ▽ More We report the development and experimental implementation of the automated experiment workflows for the identification of the best predictive channel for a phenomenon of interest in spectroscopic measurements. The approach is based on the combination of ensembled deep kernel learning for probabilistic predictions and a basic reinforcement learning policy for channel selection. It allows the identification of which of the available observational channels, sampled sequentially, are most predictive of selected behaviors, and hence have the strongest correlations. We implement this approach for multimodal imaging in Piezoresponse Force Microscopy (PFM), with the behaviors of interest manifesting in piezoresponse spectroscopy. We illustrate the best predictive channel for polarization-voltage hysteresis loop and frequency-voltage hysteresis loop areas is amplitude in the model samples. The same workflow and code are universal and applicable for any multimodal imaging and local characterization methods. △ Less

Submitted 13 February, 2023; v1 submitted 6 July, 2022; originally announced July 2022.

Comments: 17 pages, 5 figures

Bayesian Optimization in Continuous Spaces via Virtual Process Embeddings

Authors: Mani Valleti, Rama K. Vasudevan, Maxim A. Ziatdinov, Sergei V. Kalinin

Abstract: Automated chemical synthesis, materials fabrication, and spectroscopic physical measurements often bring forth the challenge of process trajectory optimization, i.e., discovering the time dependence of temperature, electric field, or pressure that gives rise to optimal properties. Due to the high dimensionality of the corresponding vectors, these problems are not directly amenable to Bayesian Opti… ▽ More Automated chemical synthesis, materials fabrication, and spectroscopic physical measurements often bring forth the challenge of process trajectory optimization, i.e., discovering the time dependence of temperature, electric field, or pressure that gives rise to optimal properties. Due to the high dimensionality of the corresponding vectors, these problems are not directly amenable to Bayesian Optimization (BO). Here we propose an approach based on the combination of the generative statistical models, specifically variational autoencoders, and Bayesian optimization. Here, the set of potential trajectories is formed based on best practices in the field, domain intuition, or human expertise. The variational autoencoder is used to encode the thus generated trajectories as a latent vector, and also allows for the generation of trajectories via sampling from latent space. In this manner, Bayesian Optimization of the process is realized in the latent space of the system, reducing the problem to a low-dimensional one. Here we apply this approach to a ferroelectric lattice model and demonstrate that this approach allows discovering the field trajectories that maximize curl in the system. The analysis of the corresponding polarization and curl distributions allows the relevant physical mechanisms to be decoded. △ Less

Submitted 24 June, 2022; originally announced June 2022.

Comments: 22 pages and 9 figures

Physics is the New Data

Authors: Sergei V. Kalinin, Maxim Ziatdinov, Bobby G. Sumpter, Andrew D. White

Abstract: The rapid development of machine learning (ML) methods has fundamentally affected numerous applications ranging from computer vision, biology, and medicine to accounting and text analytics. Until now, it was the availability of large and often labeled data sets that enabled significant breakthroughs. However, the adoption of these methods in classical physical disciplines has been relatively slow,… ▽ More The rapid development of machine learning (ML) methods has fundamentally affected numerous applications ranging from computer vision, biology, and medicine to accounting and text analytics. Until now, it was the availability of large and often labeled data sets that enabled significant breakthroughs. However, the adoption of these methods in classical physical disciplines has been relatively slow, a tendency that can be traced to the intrinsic differences between correlative approaches of purely data-based ML and the causal hypothesis-driven nature of physical sciences. Furthermore, anomalous behaviors of classical ML necessitate addressing issues such as explainability and fairness of ML. We also note the sequence in which deep learning became mainstream in different scientific disciplines - starting from medicine and biology and then towards theoretical chemistry, and only after that, physics - is rooted in the progressively more complex level of descriptors, constraints, and causal structures available for incorporation in ML architectures. Here we put forth that over the next decade, physics will become a new data, and this will continue the transition from dot-coms and scientific computing concepts of the 90ies to big data of 2000-2010 to deep learning of 2010-2020 to physics-enabled scientific ML. △ Less

Submitted 11 April, 2022; originally announced April 2022.

Active learning in open experimental environments: selecting the right information channel(s) based on predictability in deep kernel learning

Authors: Maxim Ziatdinov, Yongtao Liu, Sergei V. Kalinin

Abstract: Active learning methods are rapidly becoming the integral component of automated experiment workflows in imaging, materials synthesis, and computation. The distinctive aspect of many experimental scenarios is the presence of multiple information channels, including both the intrinsic modalities of the measurement system and the exogenous environment and noise signals. One of the key tasks in exper… ▽ More Active learning methods are rapidly becoming the integral component of automated experiment workflows in imaging, materials synthesis, and computation. The distinctive aspect of many experimental scenarios is the presence of multiple information channels, including both the intrinsic modalities of the measurement system and the exogenous environment and noise signals. One of the key tasks in experimental studies is hence establishing which of these channels is predictive of the behaviors of interest. Here we explore the problem of discovery of the optimal predictive channel for structure-property relationships (in microscopy) using deep kernel learning for modality selection in an active experiment setting. We further pose that this approach can be directly applicable to similar active learning tasks in automated synthesis and the discovery of quantitative structure-activity relations in molecular systems. △ Less

Submitted 18 March, 2022; originally announced March 2022.

Hypothesis Learning in Automated Experiment: Application to Combinatorial Materials Libraries

Authors: Maxim Ziatdinov, Yongtao Liu, Anna N. Morozovska, Eugene A. Eliseev, Xiaohang Zhang, Ichiro Takeuchi, Sergei V. Kalinin

Abstract: Machine learning is rapidly becoming an integral part of experimental physical discovery via automated and high-throughput synthesis, and active experiments in scattering and electron/probe microscopy. This, in turn, necessitates the development of active learning methods capable of exploring relevant parameter spaces with the smallest number of steps. Here we introduce an active learning approach… ▽ More Machine learning is rapidly becoming an integral part of experimental physical discovery via automated and high-throughput synthesis, and active experiments in scattering and electron/probe microscopy. This, in turn, necessitates the development of active learning methods capable of exploring relevant parameter spaces with the smallest number of steps. Here we introduce an active learning approach based on co-navigation of the hypothesis and experimental spaces. This is realized by combining the structured Gaussian Processes containing probabilistic models of the possible system's behaviors (hypotheses) with reinforcement learning policy refinement (discovery). This approach closely resembles classical human-driven physical discovery, when several alternative hypotheses realized via models with adjustable parameters are tested during an experiment. We demonstrate this approach for exploring concentration-induced phase transitions in combinatorial libraries of Sm-doped BiFeO3 using Piezoresponse Force Microscopy, but it is straightforward to extend it to higher-dimensional parameter spaces and more complex physical problems once the experimental workflow and hypothesis-generation are available. △ Less

Submitted 20 April, 2022; v1 submitted 13 December, 2021; originally announced December 2021.

Comments: Fixed typo in Eq. 1. Expanded the introduction part. The code reproducing Algorithm 1 is available at https://github.com/ziatdinovmax/hypoAL

Journal ref: Adv. Mater. 2022, 2201345

Exploring leakage in dielectric films via automated experiment in scanning probe microscopy

Authors: Yongtao Liu, Shelby S. Fields, Takanori Mimura, Kyle P. Kelley, Jon F. Ihlefeld, Sergei V. Kalinin

Abstract: Electronic conduction pathways in dielectric thin films are explored using automated experiments in scanning probe microscopy (SPM). Here, we use large field of view scanning to identify the position of localized conductive spots and develop a SPM workflow to probe their dynamic behavior at higher spatial resolution as a function of time, voltage, and scanning process in an automated fashion. Usin… ▽ More Electronic conduction pathways in dielectric thin films are explored using automated experiments in scanning probe microscopy (SPM). Here, we use large field of view scanning to identify the position of localized conductive spots and develop a SPM workflow to probe their dynamic behavior at higher spatial resolution as a function of time, voltage, and scanning process in an automated fashion. Using this approach, we observe the variable behaviors of the conductive spots in a 20 nm thick ferroelectric Hf0.54Zr0.48O2 film, where conductive spots disappear and reappear during continuous scanning. There are also new conductive spots that appear during scanning. The automated workflow is universal and can be integrated into a wide range of microscopy techniques, including SPM, electron microscopy, optical microscopy, and chemical imaging. △ Less

Submitted 18 November, 2021; originally announced November 2021.

Comments: 12 pages, 6 figures

Bridging microscopy with molecular dynamics and quantum simulations: An AtomAI based pipeline

Authors: Ayana Ghosh, Maxim Ziatdinov, Ondrej Dyck, Bobby Sumpter, Sergei V. Kalinin

Abstract: Recent advances in (scanning) transmission electron microscopy have enabled routine generation of large volumes of high-veracity structural data on 2D and 3D materials, naturally offering the challenge of using these as starting inputs for atomistic simulations. In this fashion, theory will address experimentally emerging structures, as opposed to the full range of theoretically possible atomic co… ▽ More Recent advances in (scanning) transmission electron microscopy have enabled routine generation of large volumes of high-veracity structural data on 2D and 3D materials, naturally offering the challenge of using these as starting inputs for atomistic simulations. In this fashion, theory will address experimentally emerging structures, as opposed to the full range of theoretically possible atomic configurations. However, this challenge is highly non-trivial due to the extreme disparity between intrinsic time scales accessible to modern simulations and microscopy, as well as latencies of microscopy and simulations per se. Addressing this issue requires as a first step bridging the instrumental data flow and physics-based simulation environment, to enable the selection of regions of interest and exploring them using physical simulations. Here we report the development of the machine learning workflow that directly bridges the instrument data stream into Python-based molecular dynamics and density functional theory environments using pre-trained neural networks to convert imaging data to physical descriptors. The pathways to ensure the structural stability and compensate for the observational biases universally present in the data are identified in the workflow. This approach is used for a graphene system to reconstruct optimized geometry and simulate temperature-dependent dynamics including adsorption of Cr as an ad-atom and graphene healing effects. However, it is universal and can be used for other material systems. △ Less

Submitted 21 December, 2021; v1 submitted 9 September, 2021; originally announced September 2021.

Physics makes the difference: Bayesian optimization and active learning via augmented Gaussian process

Authors: Maxim Ziatdinov, Ayana Ghosh, Sergei V. Kalinin

Abstract: Both experimental and computational methods for the exploration of structure, functionality, and properties of materials often necessitate the search across broad parameter spaces to discover optimal experimental conditions and regions of interest in the image space or parameter space of computational models. The direct grid search of the parameter space tends to be extremely time-consuming, leadi… ▽ More Both experimental and computational methods for the exploration of structure, functionality, and properties of materials often necessitate the search across broad parameter spaces to discover optimal experimental conditions and regions of interest in the image space or parameter space of computational models. The direct grid search of the parameter space tends to be extremely time-consuming, leading to the development of strategies balancing exploration of unknown parameter spaces and exploitation towards required performance metrics. However, classical Bayesian optimization strategies based on the Gaussian process (GP) do not readily allow for the incorporation of the known physical behaviors or past knowledge. Here we explore a hybrid optimization/exploration algorithm created by augmenting the standard GP with a structured probabilistic model of the expected system's behavior. This approach balances the flexibility of the non-parametric GP approach with a rigid structure of physical knowledge encoded into the parametric model. The fully Bayesian treatment of the latter allows additional control over the optimization via the selection of priors for the model parameters. The method is demonstrated for a noisy version of the classical objective function used to evaluate optimization algorithms and further extended to physical lattice models. This methodology is expected to be universally suitable for injecting prior knowledge in the form of physical models and past data in the Bayesian optimization framework △ Less

Submitted 29 August, 2021; v1 submitted 23 August, 2021; originally announced August 2021.

Comments: Expanded the discussion and added additional info to the supplemental materials

Physics discovery in nanoplasmonic systems via autonomous experiments in Scanning Transmission Electron Microscopy

Authors: Kevin M. Roccapriore, Sergei V. Kalinin, Maxim Ziatdinov

Abstract: Physics-driven discovery in an autonomous experiment has emerged as a dream application of machine learning in physical sciences. Here we develop and experimentally implement a deep kernel learning workflow combining the correlative prediction of the target functional response and its uncertainty from the structure, and physics-based selection of acquisition function, which autonomously guides the… ▽ More Physics-driven discovery in an autonomous experiment has emerged as a dream application of machine learning in physical sciences. Here we develop and experimentally implement a deep kernel learning workflow combining the correlative prediction of the target functional response and its uncertainty from the structure, and physics-based selection of acquisition function, which autonomously guides the navigation of the image space. Compared to classical Bayesian optimization methods, this approach allows to capture the complex spatial features present in the images of realistic materials, and dynamically learn structure-property relationships. In combination with the flexible scalarizer function that allows to ascribe the degree of physical interest to predicted spectra, this enables physical discovery in automated experiment. Here, this approach is illustrated for nanoplasmonic studies of nanoparticles and experimentally implemented in a truly autonomous fashion for bulk- and edge plasmon discovery in MnPS3, a lesser-known beam-sensitive layered 2D material. This approach is universal, can be directly used as-is with any specimen, and is expected to be applicable to any probe-based microscopic techniques including other STEM modalities, Scanning Probe Microscopies, chemical, and optical imaging. △ Less

Submitted 22 November, 2022; v1 submitted 6 August, 2021; originally announced August 2021.

Journal ref: Adv. Sci. 2022, 2203422

High-Throughput Study of Antisolvents on the Stability of Multicomponent Metal Halide Perovskites through Robotics-Based Synthesis and Machine Learning Approaches

Authors: Kate Higgins, Maxim Ziatdinov, Sergei V. Kalinin, Mahshid Ahmadi

Abstract: Antisolvent crystallization methods are frequently used to fabricate high-quality perovskite thin films, to produce sizable single crystals, and to synthesize nanoparticles at room temperature. However, a systematic exploration of the effect of specific antisolvents on the intrinsic stability of multicomponent metal halide perovskites has yet to be demonstrated. Here, we develop a high-throughput… ▽ More Antisolvent crystallization methods are frequently used to fabricate high-quality perovskite thin films, to produce sizable single crystals, and to synthesize nanoparticles at room temperature. However, a systematic exploration of the effect of specific antisolvents on the intrinsic stability of multicomponent metal halide perovskites has yet to be demonstrated. Here, we develop a high-throughput experimental workflow that incorporates chemical robotic synthesis, automated characterization, and machine learning techniques to explore how the choice of antisolvent affects the intrinsic stability of binary perovskite systems in ambient conditions over time. Different combinations of the endmembers, MAPbI3, MAPbBr3, FAPbI3, FAPbBr3, CsPbI3, and CsPbBr3, are used to synthesize 15 combinatorial libraries, each with 96 unique combinations. In total, roughly 1100 different compositions are synthesized. Each library is fabricated twice using two different antisolvents: toluene and chloroform. Once synthesized, photoluminescence spectroscopy is automatically performed every 5 minutes for approximately 6 hours. Non-negative Matrix Factorization (NMF) is then utilized to map the time- and compositional-dependent optoelectronic properties. Through the utilization of this workflow for each library, we demonstrate that the selection of antisolvent is critical to the stability of metal halide perovskites in ambient conditions. We explore possible dynamical processes, such as halide segregation, responsible for either the stability or eventual degradation as caused by the choice of antisolvent. Overall, this high-throughput study demonstrates the vital role that antisolvents play in the synthesis of high-quality multicomponent metal halide perovskite systems. △ Less

Submitted 6 June, 2021; originally announced June 2021.

Semi-supervised learning of images with strong rotational disorder: assembling nanoparticle libraries

Authors: Maxim Ziatdinov, Muammer Yusuf Yaman, Yongtao Liu, David Ginger, Sergei V. Kalinin

Abstract: The proliferation of optical, electron, and scanning probe microscopies gives rise to large volumes of imaging data of objects as diversified as cells, bacteria, pollen, to nanoparticles and atoms and molecules. In most cases, the experimental data streams contain images having arbitrary rotations and translations within the image. At the same time, for many cases, small amounts of labeled data ar… ▽ More The proliferation of optical, electron, and scanning probe microscopies gives rise to large volumes of imaging data of objects as diversified as cells, bacteria, pollen, to nanoparticles and atoms and molecules. In most cases, the experimental data streams contain images having arbitrary rotations and translations within the image. At the same time, for many cases, small amounts of labeled data are available in the form of prior published results, image collections, and catalogs, or even theoretical models. Here we develop an approach that allows generalizing from a small subset of labeled data with a weak orientational disorder to a large unlabeled dataset with a much stronger orientational (and positional) disorder, i.e., it performs a classification of image data given a small number of examples even in the presence of a distribution shift between the labeled and unlabeled parts. This approach is based on the semi-supervised rotationally invariant variational autoencoder (ss-rVAE) model consisting of the encoder-decoder "block" that learns a rotationally (and translationally) invariant continuous latent representation of data and a classifier that encodes data into a finite number of discrete classes. The classifier part of the trained ss-rVAE inherits the rotational (and translational) invariances and can be deployed independently of the other parts of the model. The performance of the ss-rVAE is illustrated using the synthetic data sets with known factors of variation. We further demonstrate its application for experimental data sets of nanoparticles, creating nanoparticle libraries and disentangling the representations defining the physical factors of variation in the data. The code reproducing the results is available at https://github.com/ziatdinovmax/Semi-Supervised-VAE-nanoparticles. △ Less

Submitted 24 May, 2021; originally announced May 2021.

AtomAI: A Deep Learning Framework for Analysis of Image and Spectroscopy Data in (Scanning) Transmission Electron Microscopy and Beyond

Authors: Maxim Ziatdinov, Ayana Ghosh, Tommy Wong, Sergei V. Kalinin

Abstract: AtomAI is an open-source software package bridging instrument-specific Python libraries, deep learning, and simulation tools into a single ecosystem. AtomAI allows direct applications of the deep convolutional neural networks for atomic and mesoscopic image segmentation converting image and spectroscopy data into class-based local descriptors for downstream tasks such as statistical and graph anal… ▽ More AtomAI is an open-source software package bridging instrument-specific Python libraries, deep learning, and simulation tools into a single ecosystem. AtomAI allows direct applications of the deep convolutional neural networks for atomic and mesoscopic image segmentation converting image and spectroscopy data into class-based local descriptors for downstream tasks such as statistical and graph analysis. For atomically-resolved imaging data, the output is types and positions of atomic species, with an option for subsequent refinement. AtomAI further allows the implementation of a broad range of image and spectrum analysis functions, including invariant variational autoencoders (VAEs). The latter consists of VAEs with rotational and (optionally) translational invariance for unsupervised and class-conditioned disentanglement of categorical and continuous data representations. In addition, AtomAI provides utilities for map** structure-property relationships via im2spec and spec2im type of encoder-decoder models. Finally, AtomAI allows seamless connection to the first principles modeling with a Python interface, including molecular dynamics and density functional theory calculations on the inferred atomic position. While the majority of applications to date were based on atomically resolved electron microscopy, the flexibility of AtomAI allows straightforward extension towards the analysis of mesoscopic imaging data once the labels and feature identification workflows are established/available. The source code and example notebooks are available at https://github.com/pycroscopy/atomai. △ Less

Submitted 16 May, 2021; originally announced May 2021.

Journal ref: Nat Mach Intell 4, 1101-1112 (2022)

Sculpting the plasmonic responses of nanoparticles by directed electron beam irradiation

Authors: Kevin M. Roccapriore, Shin-Hum Cho, Andrew R. Lupini, Delia J. Milliron, Sergei V. Kalinin

Abstract: Spatial confinement of matter in functional nanostructures has propelled these systems to the forefront of nanoscience, both as a playground for exotic physics and quantum phenomena and in multiple applications including plasmonics, optoelectronics, and sensing. In parallel, the emergence of monochromated electron energy loss spectroscopy (EELS) has enabled exploration of local nanoplasmonic funct… ▽ More Spatial confinement of matter in functional nanostructures has propelled these systems to the forefront of nanoscience, both as a playground for exotic physics and quantum phenomena and in multiple applications including plasmonics, optoelectronics, and sensing. In parallel, the emergence of monochromated electron energy loss spectroscopy (EELS) has enabled exploration of local nanoplasmonic functionalities within single nanoparticles and the collective response of nanoparticle assemblies, providing deep insight into the associated mechanisms. However, modern synthesis processes for plasmonic nanostructures are often limited in the types of accessible geometry and materials, and even then, limited to spatial precisions on the order of tens of nm, precluding the direct exploration of critical aspects of the structure-property relationships. Here, we use the atomic-sized probe of the scanning transmission electron microscope (STEM) to perform precise sculpting and design of nanoparticle configurations. Furthermore, using low-loss (EELS), we provide dynamic analyses of evolution of the plasmonic response during the sculpting process. We show that within self-assembled systems of nanoparticles, individual nanoparticles can be selectively removed, reshaped, or arbitrarily patterned with nanometer-level resolution, effectively modifying the plasmonic response in both space and energy domains. This process significantly increases the scope for design possibilities and presents opportunities for arbitrary structure development, which are ultimately key for nanophotonic design. Nanosculpting introduces yet another capability to the electron microscope. △ Less

Submitted 5 April, 2021; originally announced April 2021.

Map** causal patterns in crystalline solids

Authors: Chris Nelson, Anna N. Morozovska, Maxim A. Ziatdinov, Eugene A. Eliseev, Xiaohang Zhang, Ichiro Takeuchi, Sergei V. Kalinin

Abstract: The evolution of the atomic structures of the combinatorial library of Sm-substituted thin film BiFeO3 along the phase transition boundary from the ferroelectric rhombohedral phase to the non-ferroelectric orthorhombic phase is explored using scanning transmission electron microscopy (STEM). Localized properties including polarization, lattice parameter, and chemical composition are parameterized… ▽ More The evolution of the atomic structures of the combinatorial library of Sm-substituted thin film BiFeO3 along the phase transition boundary from the ferroelectric rhombohedral phase to the non-ferroelectric orthorhombic phase is explored using scanning transmission electron microscopy (STEM). Localized properties including polarization, lattice parameter, and chemical composition are parameterized from atomic-scale imaging and their causal relationships are reconstructed using a linear non-Gaussian acyclic model (LiNGAM). This approach is further extended toward exploring the spatial variability of the causal coupling using the sliding window transform method, which revealed that new causal relationships emerged both at the expected locations, such as domain walls and interfaces, but also at additional regions forming clusters in the vicinity of the walls or spatially distributed features. While the exact physical origins of these relationships are unclear, they likely represent nanophase separated regions in the morphotropic phase boundaries. Overall, we pose that an in-depth understanding of complex disordered materials away from thermodynamic equilibrium necessitates understanding not only of the generative processes that can lead to observed microscopic states, but also the causal links between multiple interacting subsystems. △ Less

Submitted 2 March, 2021; originally announced March 2021.

Deep learning polarization distributions in ferroelectrics from STEM data: with and without atom finding

Authors: Ayana Ghosh, Christopher T. Nelson, Mark Oxley, Xiaohang Zhang, Maxim Ziatdinov, Ichiro Takeuchi, Sergei V. Kalinin

Abstract: Over the last decade, scanning transmission electron microscopy (STEM) has emerged as a powerful tool for probing atomic structures of complex materials with picometer precision, opening the pathway toward exploring ferroelectric, ferroelastic, and chemical phenomena on the atomic-scale. Analyses to date extracting a polarization signal from lattice coupled distortions in STEM imaging rely on disc… ▽ More Over the last decade, scanning transmission electron microscopy (STEM) has emerged as a powerful tool for probing atomic structures of complex materials with picometer precision, opening the pathway toward exploring ferroelectric, ferroelastic, and chemical phenomena on the atomic-scale. Analyses to date extracting a polarization signal from lattice coupled distortions in STEM imaging rely on discovery of atomic positions from intensity maxima/minima and subsequent calculation of polarization and other order parameter fields from the atomic displacements. Here, we explore the feasibility of polarization map** directly from the analysis of STEM images using deep convolutional neural networks (DCNNs). In this approach, the DCNN is trained on the labeled part of the image (i.e., for human labelling), and the trained network is subsequently applied to other images. We explore the effects of the choice of the descriptors (centered on atomic columns and grid-based), the effects of observational bias, and whether the network trained on one composition can be applied to a different one. This analysis demonstrates the tremendous potential of the DCNN for the analysis of high-resolution STEM imaging and spectral data and highlights the associated limitations. △ Less

Submitted 24 February, 2021; originally announced February 2021.

Ensemble learning and iterative training (ELIT) machine learning: applications towards uncertainty quantification and automated experiment in atom-resolved microscopy

Authors: Ayana Ghosh, Bobby G. Sumpter, Ondrej Dyck, Sergei V. Kalinin, Maxim Ziatdinov

Abstract: Deep learning has emerged as a technique of choice for rapid feature extraction across imaging disciplines, allowing rapid conversion of the data streams to spatial or spatiotemporal arrays of features of interest. However, applications of deep learning in experimental domains are often limited by the out-of-distribution drift between the experiments, where the network trained for one set of imagi… ▽ More Deep learning has emerged as a technique of choice for rapid feature extraction across imaging disciplines, allowing rapid conversion of the data streams to spatial or spatiotemporal arrays of features of interest. However, applications of deep learning in experimental domains are often limited by the out-of-distribution drift between the experiments, where the network trained for one set of imaging conditions becomes sub-optimal for different ones. This limitation is particularly stringent in the quest to have an automated experiment setting, where retraining or transfer learning becomes impractical due to the need for human intervention and associated latencies. Here we explore the reproducibility of deep learning for feature extraction in atom-resolved electron microscopy and introduce workflows based on ensemble learning and iterative training to greatly improve feature detection. This approach both allows incorporating uncertainty quantification into the deep learning analysis and also enables rapid automated experimental workflows where retraining of the network to compensate for out-of-distribution drift due to subtle change in imaging conditions is substituted for a human operator or programmatic selection of networks from the ensemble. This methodology can be further applied to machine learning workflows in other imaging areas including optical and chemical imaging. △ Less

Submitted 21 January, 2021; v1 submitted 21 January, 2021; originally announced January 2021.

Comments: Add supplemental material

Bayesian learning of adatom interactions from atomically-resolved imaging data

Authors: Mani Valleti, Qiang Zou, Rui Xue, Lukas Vlcek, Maxim Ziatdinov, Rama Vasudevan, Mingming Fu, Jiaqiang Yan, David Mandrus, Zheng Gai, Sergei V. Kalinin

Abstract: Atomic structures and adatom geometries of surfaces encode information about the thermodynamics and kinetics of the processes that lead to their formation, and which can be captured by a generative physical model. Here we develop a workflow based on a machine learning-based analysis of scanning tunneling microscopy images to reconstruct the atomic and adatom positions, and a Bayesian optimization… ▽ More Atomic structures and adatom geometries of surfaces encode information about the thermodynamics and kinetics of the processes that lead to their formation, and which can be captured by a generative physical model. Here we develop a workflow based on a machine learning-based analysis of scanning tunneling microscopy images to reconstruct the atomic and adatom positions, and a Bayesian optimization procedure to minimize statistical distance between the chosen physical models and experimental observations. We optimize the parameters of a 2- and 3-parameter Ising model describing surface ordering and use the derived generative model to make predictions across the parameter space. For concentration dependence, we compare the predicted morphologies at different adatom concentrations with the dissimilar regions on the sample surfaces that serendipitously had different adatom concentrations. The proposed workflow is universal and can be used to reconstruct the thermodynamic models and associated uncertainties from the experimental observations of materials microstructures. The code used in the manuscript is available at https://github.com/saimani5/Adatom_interactions. △ Less

Submitted 22 December, 2020; originally announced December 2020.

Deep Bayesian Local Crystallography

Authors: Sergei V. Kalinin, Mark P. Oxley, Mani Valleti, Junjie Zhang, Raphael P. Hermann, Hong Zheng, Wenrui Zhang, Gyula Eres, Rama K. Vasudevan, Maxim Ziatdinov

Abstract: The advent of high-resolution electron and scanning probe microscopy imaging has opened the floodgates for acquiring atomically resolved images of bulk materials, 2D materials, and surfaces. This plethora of data contains an immense volume of information on materials structures, structural distortions, and physical functionalities. Harnessing this knowledge regarding local physical phenomena neces… ▽ More The advent of high-resolution electron and scanning probe microscopy imaging has opened the floodgates for acquiring atomically resolved images of bulk materials, 2D materials, and surfaces. This plethora of data contains an immense volume of information on materials structures, structural distortions, and physical functionalities. Harnessing this knowledge regarding local physical phenomena necessitates the development of the mathematical frameworks for extraction of relevant information. However, the analysis of atomically resolved images is often based on the adaptation of concepts from macroscopic physics, notably translational and point group symmetries and symmetry lowering phenomena. Here, we explore the bottom-up definition of structural units and symmetry in atomically resolved data using a Bayesian framework. We demonstrate the need for a Bayesian definition of symmetry using a simple toy model and demonstrate how this definition can be extended to the experimental data using deep learning networks in a Bayesian setting, namely rotationally invariant variational autoencoders. △ Less

Submitted 13 December, 2020; originally announced December 2020.

Comments: Combined Paper and Supplementary Information. 40 pages. 8 Figures plus 12 Supplementary figures

Autonomous Experiments in Scanning Probe Microscopy and Spectroscopy: Choosing Where to Explore Polarization Dynamics in Ferroelectrics

Authors: Rama K. Vasudevan, Kyle Kelley, Jacob Hinkle, Hiroshi Funakubo, Stephen Jesse, Sergei V. Kalinin, Maxim Ziatdinov

Abstract: Polarization dynamics in ferroelectric materials are explored via the automated experiment in Piezoresponse Force Spectroscopy. A Bayesian Optimization framework for imaging is developed and its performance for a variety of acquisition and pathfinding functions is explored using previously acquired data. The optimized algorithm is then deployed on an operational scanning probe microscope (SPM) for… ▽ More Polarization dynamics in ferroelectric materials are explored via the automated experiment in Piezoresponse Force Spectroscopy. A Bayesian Optimization framework for imaging is developed and its performance for a variety of acquisition and pathfinding functions is explored using previously acquired data. The optimized algorithm is then deployed on an operational scanning probe microscope (SPM) for finding areas of large electromechanical response in a thin film of PbTiO3, with metrics showing gains of ~3x in the sampling efficiency. This approach opens the pathway to perform more complex spectroscopies in SPM that were previously not possible due to time constraints and sample stability, tip wear, and/or stochastic sample damage that occurs at specific, a priori unknown spatial positions. Potential improvements to the framework to enable the incorporation of more prior information and improve efficiency further are discussed. △ Less

Submitted 22 June, 2021; v1 submitted 25 November, 2020; originally announced November 2020.

Probing atomic-scale symmetry breaking by rotationally invariant machine learning of multidimensional electron scattering

Authors: Mark P. Oxley, Maxim Ziatdinov, Ondrej Dyck, Andrew R. Lupini, Rama Vasudevan, Sergei V. Kalinin

Abstract: The 4D scanning transmission electron microscopy (STEM) method has enabled map** of the structure and functionality of solids on the atomic scale, yielding information-rich data sets containing information on the interatomic electric and magnetic fields, structural and electronic order parameters, and other symmetry breaking distortions. A critical bottleneck on the pathway toward harnessing 4D-… ▽ More The 4D scanning transmission electron microscopy (STEM) method has enabled map** of the structure and functionality of solids on the atomic scale, yielding information-rich data sets containing information on the interatomic electric and magnetic fields, structural and electronic order parameters, and other symmetry breaking distortions. A critical bottleneck on the pathway toward harnessing 4D-STEM for materials exploration is the dearth of analytical tools that can reduce complex 4D-STEM data sets to physically relevant descriptors. Classical machine learning (ML) methods such as principal component analysis and other linear unmixing techniques are limited by the presence of multiple point-group symmetric variants, where diffractograms from each rotationally equivalent position will form its own component. This limitation even holds for more complex ML methods, such as convolutional neural networks. Here, we propose and implement an approach for the systematic exploration of symmetry breaking phenomena from 4D-STEM data sets using rotationally invariant variational autoencoders (rrVAE), which is designed to disentangle the general rotation of the object from other latent representations. The implementation of purely rotational rrVAE is discussed as are applications to simulated data for graphene and zincblende structures that illustrate the effect of site symmetry breaking. Finally, the rrVAE analysis of 4D-STEM data of vacancies in graphene is illustrated and compared to the classical center-of-mass (COM) analysis. This approach is universal for probing of symmetry breaking phenomena in complex systems and can be implemented for a broad range of diffraction methods exploring the 2D diffraction space of the system, including X-ray ptychography, electron backscatter diffraction (EBSD), and more complex methods. △ Less

Submitted 22 September, 2020; originally announced September 2020.

The Joint Automated Repository for Various Integrated Simulations (JARVIS) for data-driven materials design

Authors: Kamal Choudhary, Kevin F. Garrity, Andrew C. E. Reid, Brian DeCost, Adam J. Biacchi, Angela R. Hight Walker, Zachary Trautt, Jason Hattrick-Simpers, A. Gilad Kusne, Andrea Centrone, Albert Davydov, Jie Jiang, Ruth Pachter, Gowoon Cheon, Evan Reed, Ankit Agrawal, Xiaofeng Qian, Vinit Sharma, Houlong Zhuang, Sergei V. Kalinin, Bobby G. Sumpter, Ghanshyam Pilania, Pinar Acar, Subhasish Mandal, Kristjan Haule , et al. (3 additional authors not shown)

Abstract: The Joint Automated Repository for Various Integrated Simulations (JARVIS) is an integrated infrastructure to accelerate materials discovery and design using density functional theory (DFT), classical force-fields (FF), and machine learning (ML) techniques. JARVIS is motivated by the Materials Genome Initiative (MGI) principles of develo** open-access databases and tools to reduce the cost and d… ▽ More The Joint Automated Repository for Various Integrated Simulations (JARVIS) is an integrated infrastructure to accelerate materials discovery and design using density functional theory (DFT), classical force-fields (FF), and machine learning (ML) techniques. JARVIS is motivated by the Materials Genome Initiative (MGI) principles of develo** open-access databases and tools to reduce the cost and development time of materials discovery, optimization, and deployment. The major features of JARVIS are: JARVIS-DFT, JARVIS-FF, JARVIS-ML, and JARVIS-Tools. To date, JARVIS consists of 40,000 materials and 1 million calculated properties in JARVIS-DFT, 1,500 materials and 110 force-fields in JARVIS-FF, and 25 ML models for material-property predictions in JARVIS-ML, all of which are continuously expanding. JARVIS-Tools provides scripts and workflows for running and analyzing various simulations. We compare our computational data to experiments or high-fidelity computational methods wherever applicable to evaluate error/uncertainty in predictions. In addition to the existing workflows, the infrastructure can support a wide variety of other technologically important applications as part of the data-driven materials design paradigm. The JARVIS datasets and tools are publicly available at the website: https://jarvis.nist.gov . △ Less

Submitted 11 July, 2021; v1 submitted 3 July, 2020; originally announced July 2020.

Quantifying the dynamics of protein self-organization using deep learning analysis of atomic force microscopy data

Authors: Maxim Ziatdinov, Shuai Zhang, Orion Dollar, Jim Pfaendtner, Chris Mundi, Xin Li, Harley Pyles, David Baker, James J. De Yoreo, Sergei V. Kalinin

Abstract: Dynamics of protein self-assembly on the inorganic surface and the resultant geometric patterns are visualized using high-speed atomic force microscopy. The time dynamics of the classical macroscopic descriptors such as 2D Fast Fourier Transforms (FFT), correlation and pair distribution function are explored using the unsupervised linear unmixing, demonstrating the presence of static ordered and d… ▽ More Dynamics of protein self-assembly on the inorganic surface and the resultant geometric patterns are visualized using high-speed atomic force microscopy. The time dynamics of the classical macroscopic descriptors such as 2D Fast Fourier Transforms (FFT), correlation and pair distribution function are explored using the unsupervised linear unmixing, demonstrating the presence of static ordered and dynamic disordered phases and establishing their time dynamics. The deep learning (DL)-based workflow is developed to analyze detailed particle dynamics on the particle-by-particle level. Beyond the macroscopic descriptors, we utilize the knowledge of local particle geometries and configurations to explore the evolution of local geometries and reconstruct the interaction potential between the particles. Finally, we use the machine learning-based feature extraction to define particle neighborhood free of physics constraints. This approach allowed separating the possible classes of particle behavior, identify the associated transition probabilities, and further extend this analysis to identify slow modes and associated configurations, allowing for systematic exploration and predictive modeling of the time dynamics of the system. Overall, this work establishes the DL based workflow for the analysis of the self-organization processes in complex systems from observational data and provides insight into the fundamental mechanisms. △ Less

Submitted 5 June, 2020; originally announced June 2020.

Gaussian process analysis of Electron Energy Loss Spectroscopy (EELS) data: parallel reconstruction and kernel control

Authors: Sergei V. Kalinin, Andrew R. Lupini, Rama K. Vasudevan, Maxim Ziatdinov

Abstract: Advances in hyperspectral imaging modes including electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM) bring forth the challenges of exploratory and subsequently physics-based analysis of multidimensional data sets. The (by now common) multivariate unsupervised linear unmixing methods and their nonlinear analogs generally explore similarities in the energy d… ▽ More Advances in hyperspectral imaging modes including electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM) bring forth the challenges of exploratory and subsequently physics-based analysis of multidimensional data sets. The (by now common) multivariate unsupervised linear unmixing methods and their nonlinear analogs generally explore similarities in the energy dimension but ignore correlations in the spatial domain. At the same time, Gaussian process (GP) methods that explicitly incorporate spatial correlations in the form of kernel functions tend to be extremely computationally intensive, while the use of inducing point-based sparse methods often leads to reconstruction artefacts. Here, we suggest and implement a parallel GP method operating on the full spatial domain and reduced representations in the energy domain. In this parallel GP, the information between the components is shared via a common spatial kernel structure while allowing for variability in the relative noise magnitude or image morphology. We explore the role of common spatial structures and kernel constraints on the quality of the reconstruction and suggest an approach for estimating these factors from the experimental data. Application of this method to an example EELS dataset demonstrates that spatial information contained in higher-order components can be reconstructed and spatially localized. This approach can be further applied to other hyperspectral and multimodal imaging modes. The notebooks developed in this manuscript are freely available as part of a GPim package (https://github.com/ziatdinovmax/GPim). △ Less

Submitted 21 May, 2020; originally announced May 2020.

Off-the-shelf deep learning is not enough: parsimony, Bayes and causality

Authors: Rama K. Vasudevan, Maxim Ziatdinov, Lukas Vlcek, Sergei V. Kalinin

Abstract: Deep neural networks ("deep learning") have emerged as a technology of choice to tackle problems in natural language processing, computer vision, speech recognition and gameplay, and in just a few years has led to superhuman level performance and ushered in a new wave of "AI." Buoyed by these successes, researchers in the physical sciences have made steady progress in incorporating deep learning i… ▽ More Deep neural networks ("deep learning") have emerged as a technology of choice to tackle problems in natural language processing, computer vision, speech recognition and gameplay, and in just a few years has led to superhuman level performance and ushered in a new wave of "AI." Buoyed by these successes, researchers in the physical sciences have made steady progress in incorporating deep learning into their respective domains. However, such adoption brings substantial challenges that need to be recognized and confronted. Here, we discuss both opportunities and roadblocks to implementation of deep learning within materials science, focusing on the relationship between correlative nature of machine learning and causal hypothesis driven nature of physical sciences. We argue that deep learning and AI are now well positioned to revolutionize fields where causal links are known, as is the case for applications in theory. When confounding factors are frozen or change only weakly, this leaves open the pathway for effective deep learning solutions in experimental domains. Similarly, these methods offer a pathway towards understanding the physics of real-world systems, either via deriving reduced representations, deducing algorithmic complexity, or recovering generative physical models. However, extending deep learning and "AI" for models with unclear causal relationship can produce misleading and potentially incorrect results. Here, we argue the broad adoption of Bayesian methods incorporating prior knowledge, development of DL solutions with incorporated physical constraints, and ultimately adoption of causal models, offers a path forward for fundamental and applied research. Most notably, while these advances can change the way science is carried out in ways we cannot imagine, machine learning is not going to substitute science any time soon. △ Less

Submitted 4 May, 2020; originally announced May 2020.

Comments: 3 figures, 12 pages

Guided search for desired functional responses via Bayesian optimization of generative model: Hysteresis loop shape engineering in ferroelectrics

Authors: Sergei V. Kalinin, Maxim Ziatdinov, Rama K. Vasudevan

Abstract: Advances in predictive modeling across multiple disciplines have yielded generative models capable of high veracity in predicting macroscopic functional responses of materials. Correspondingly, of interest is the inverse problem of finding the model parameter that will yield desired macroscopic responses, such as stress-strain curves, ferroelectric hysteresis loops, etc. Here we suggest and implem… ▽ More Advances in predictive modeling across multiple disciplines have yielded generative models capable of high veracity in predicting macroscopic functional responses of materials. Correspondingly, of interest is the inverse problem of finding the model parameter that will yield desired macroscopic responses, such as stress-strain curves, ferroelectric hysteresis loops, etc. Here we suggest and implement a Gaussian Process based methods that allow to effectively sample the degenerate parameter space of a complex non-local model to output regions of parameter space which yield desired functionalities. We discuss the specific adaptation of the acquisition function and sampling function to make the process efficient and balance the efficient exploration of parameter space for multiple possible minima and exploitation to densely sample the regions of interest where target behaviors are optimized. This approach is illustrated via the hysteresis loop engineering in ferroelectric materials, but can be adapted to other functionalities and generative models. The code is open-sourced and available at [github.com/ramav87/Ferrosim]. △ Less

Submitted 9 August, 2020; v1 submitted 26 April, 2020; originally announced April 2020.

Comments: Update title to match the journal one

Journal ref: Journal of Applied Physics 128, 024102 (2020)

Fast Scanning Probe Microscopy via Machine Learning: Non-rectangular scans with compressed sensing and Gaussian process optimization

Authors: Kyle P. Kelley, Maxim Ziatdinov, Liam Collins, Michael A. Susner, Rama K. Vasudevan, Nina Balke, Sergei V. Kalinin, Stephen Jesse

Abstract: Fast scanning probe microscopy enabled via machine learning allows for a broad range of nanoscale, temporally resolved physics to be uncovered. However, such examples for functional imaging are few in number. Here, using piezoresponse force microscopy (PFM) as a model application, we demonstrate a factor of 5.8 improvement in imaging rate using a combination of sparse spiral scanning with compress… ▽ More Fast scanning probe microscopy enabled via machine learning allows for a broad range of nanoscale, temporally resolved physics to be uncovered. However, such examples for functional imaging are few in number. Here, using piezoresponse force microscopy (PFM) as a model application, we demonstrate a factor of 5.8 improvement in imaging rate using a combination of sparse spiral scanning with compressive sensing and Gaussian processing reconstruction. It is found that even extremely sparse scans offer strong reconstructions with less than 6 % error for Gaussian processing reconstructions. Further, we analyze the error associated with each reconstructive technique per reconstruction iteration finding the error is similar past approximately 15 iterations, while at initial iterations Gaussian processing outperforms compressive sensing. This study highlights the capabilities of reconstruction techniques when applied to sparse data, particularly sparse spiral PFM scans, with broad applications in scanning probe and electron microscopies. △ Less

Submitted 23 April, 2020; originally announced April 2020.

Exploration of lattice Hamiltonians for functional and structural discovery via Gaussian Process-based Exploration-Exploitation

Authors: Sergei V. Kalinin, Mani Valleti, Rama K. Vasudevan, Maxim Ziatdinov

Abstract: Statistical physics models ranging from simple lattice to complex quantum Hamiltonians are one of the mainstays of modern physics, that have allowed both decades of scientific discovery and provided a universal framework to understand a broad range of phenomena from alloying to frustrated and phase-separated materials to quantum systems. Traditionally, exploration of the phase diagrams correspondi… ▽ More Statistical physics models ranging from simple lattice to complex quantum Hamiltonians are one of the mainstays of modern physics, that have allowed both decades of scientific discovery and provided a universal framework to understand a broad range of phenomena from alloying to frustrated and phase-separated materials to quantum systems. Traditionally, exploration of the phase diagrams corresponding to multidimensional parameter spaces of Hamiltonians was performed using a combination of basic physical principles, analytical approximations, and extensive numerical modeling. However, exploration of complex multidimensional parameter spaces is subject to the classic dimensionality problem, and the behaviors of interest concentrated on low dimensional manifolds can remain undiscovered. Here, we demonstrate that a combination of exploration and exploration-exploitation with Gaussian process modeling and Bayesian optimization allows effective exploration of the parameter space for lattice Hamiltonians, and effectively maps the regions at which specific macroscopic functionalities or local structures are maximized. We argue that this approach is general and can be further extended well beyond the lattice Hamiltonians to effectively explore parameter space of more complex off-lattice and dynamic models. △ Less

Submitted 14 July, 2020; v1 submitted 9 April, 2020; originally announced April 2020.

Comments: Added GP exploration of a priori unknown Hamiltonian. Updated references

Journal ref: Journal of Applied Physics 128, 164304 (2020)

Reconstruction of effective potential from statistical analysis of dynamic trajectories

Authors: Ali Yousefzadi Nobakht, Ondrej Dyck, David B. Lingerfelt, Feng Bao, Maxim Ziatdinov, Artem Maksov, Bobby G. Sumpter, Richard Archibald, Stephen Jesse, Sergei V. Kalinin, Kody J. H. Law

Abstract: The broad incorporation of microscopic methods is yielding a wealth of information on atomic and mesoscale dynamics of individual atoms, molecules, and particles on surfaces and in open volumes. Analysis of such data necessitates statistical frameworks to convert observed dynamic behaviors to effective properties of materials. Here we develop a method for stochastic reconstruction of effective act… ▽ More The broad incorporation of microscopic methods is yielding a wealth of information on atomic and mesoscale dynamics of individual atoms, molecules, and particles on surfaces and in open volumes. Analysis of such data necessitates statistical frameworks to convert observed dynamic behaviors to effective properties of materials. Here we develop a method for stochastic reconstruction of effective acting potentials from observed trajectories. Using the Silicon vacancy defect in graphene as a model, we develop a statistical framework to reconstruct the free energy landscape from calculated atomic displacements. △ Less

Submitted 27 February, 2020; originally announced February 2020.

Comments: 12 pages, 5 figures. This manuscript is a part of update to previous work (arXiv:1804.03729v1) authors found some of the analysis in the previous work to be not accurate and this manuscript is a partial update to that work

Deep learning of interface structures from the 4D STEM data: cation intermixing vs. roughening

Authors: Mark P. Oxley, Junqi Yin, Nikolay Borodinov, Suhas Somnath, Maxim Ziatdinov, Andrew R. Lupini, Stephen Jesse, Rama K. Vasudevan, Sergei V. Kalinin

Abstract: Interface structures in complex oxides remain one of the active areas of condensed matter physics research, largely enabled by recent advances in scanning transmission electron microscopy (STEM). Yet the nature of the STEM contrast in which the structure is projected along the given direction precludes separation of possible structural models. Here, we utilize deep convolutional neural networks (D… ▽ More Interface structures in complex oxides remain one of the active areas of condensed matter physics research, largely enabled by recent advances in scanning transmission electron microscopy (STEM). Yet the nature of the STEM contrast in which the structure is projected along the given direction precludes separation of possible structural models. Here, we utilize deep convolutional neural networks (DCNN) trained on simulated 4D scanning transmission electron microscopy (STEM) datasets to predict structural descriptors of interfaces. We focus on the widely studied interface between LaAlO3 and SrTiO3, using dynamical diffraction theory and leveraging high performance computing to simulate thousands of possible 4D STEM datasets to train the DCNN to learn properties of the underlying structures on which the simulations are based. We validate the DCNN on simulated data and show that it is possible (with >95% accuracy) to identify a physically rough from a chemically diffuse interface and achieve 85% accuracy in determination of buried step positions within the interface. The method shown here is general and can be applied for any inverse imaging problem where forward models are present. △ Less

Submitted 20 February, 2020; originally announced February 2020.

Comments: 18 pages, 4 figures

Bayesian inference in band excitation Scanning Probe Microscopy for optimal dynamic model selection in imaging

Authors: Rama K. Vasudevan, Kyle P. Kelley, Eugene Eliseev, Stephen Jesse, Hiroshi Funakubo, Anna Morozovska, Sergei V. Kalinin

Abstract: The universal tendency in scanning probe microscopy (SPM) over the last two decades is to transition from simple 2D imaging to complex detection and spectroscopic imaging modes. The emergence of complex SPM engines brings forth the challenge of reliable data interpretation, i.e. conversion from detected signal to descriptors specific to tip-surface interactions and subsequently to materials proper… ▽ More The universal tendency in scanning probe microscopy (SPM) over the last two decades is to transition from simple 2D imaging to complex detection and spectroscopic imaging modes. The emergence of complex SPM engines brings forth the challenge of reliable data interpretation, i.e. conversion from detected signal to descriptors specific to tip-surface interactions and subsequently to materials properties. Here, we implemented a Bayesian inference approach for the analysis of the image formation mechanisms in band excitation (BE) SPM. Compared to the point estimates in classical functional fit approaches, Bayesian inference allows for the incorporation of extant knowledge of materials and probe behavior in the form of corresponding prior distribution and return the information on the material functionality in the form of readily interpretable posterior distributions. We note that in application of Bayesian methods, special care should be made for proper setting on the problem as model selection vs. establishing practical parameter equivalence. We further explore the non-linear mechanical behaviors at topological defects in a classical ferroelectric material, PbTiO3. We observe the non-trivial evolution of Duffing resonance frequency and the nonlinearity of the sample surface, suggesting the presence of the hidden elements of domain structure. These observations suggest that the spectrum of anomalous behaviors at the ferroelectric domain walls can be significantly broader than previously believed and can extend to non-conventional mechanical properties in addition to static and microwave conductance. △ Less

Submitted 19 February, 2020; originally announced February 2020.

Comments: Supplementary materials is located at the end of the manuscript

Robust multi-scale multi-feature deep learning for atomic and defect identification in Scanning Tunneling Microscopy on H-Si(100) 2x1 surface

Authors: Maxim Ziatdinov, Udi Fuchs, James H. G. Owen, John N. Randall, Sergei V. Kalinin

Abstract: The nature of the atomic defects on the hydrogen passivated Si (100) surface is analyzed using deep learning and scanning tunneling microscopy (STM). A robust deep learning framework capable of identifying atomic species, defects, in the presence of non-resolved contaminates, step edges, and noise is developed. The automated workflow, based on the combination of several networks for image assessme… ▽ More The nature of the atomic defects on the hydrogen passivated Si (100) surface is analyzed using deep learning and scanning tunneling microscopy (STM). A robust deep learning framework capable of identifying atomic species, defects, in the presence of non-resolved contaminates, step edges, and noise is developed. The automated workflow, based on the combination of several networks for image assessment, atom-finding and defect finding, is developed to perform the analysis at different levels of description and is deployed on an operational STM platform. This is further extended to unsupervised classification of the extracted defects using the mean-shift clustering algorithm, which utilizes features automatically engineered from the combined output of neural networks. This combined approach allows the identification of localized and extended defects on the topographically non-uniform surfaces or real materials. Our approach is universal in nature and can be applied to other surfaces for building comprehensive libraries of atomic defects in quantum materials. △ Less

Submitted 11 February, 2020; originally announced February 2020.

Super-resolution and signal separation in contact Kelvin probe force microscopy of electrochemically active ferroelectric materials

Authors: Maxim Ziatdinov, Dohyung Kim, Sabine Neumayer, Liam Collins, Mahshid Ahmadi, Rama K. Vasudevan, Stephen Jesse, Myung Hyun Ann, Jong H. Kim, Sergei V. Kalinin

Abstract: Imaging mechanisms in contact Kelvin Probe Force Microscopy (cKPFM) are explored via information theory-based methods. Gaussian Processes are used to achieve super-resolution in the cKPFM signal, effectively extrapolating across the spatial and parameter space. Tensor matrix factorization is applied to reduce the multidimensional signal to the tensor convolution of the scalar functions that show c… ▽ More Imaging mechanisms in contact Kelvin Probe Force Microscopy (cKPFM) are explored via information theory-based methods. Gaussian Processes are used to achieve super-resolution in the cKPFM signal, effectively extrapolating across the spatial and parameter space. Tensor matrix factorization is applied to reduce the multidimensional signal to the tensor convolution of the scalar functions that show clear trending behavior with the imaging parameters. These methods establish a workflow for the analysis of the multidimensional data sets, that can then be related to the relevant physical mechanisms. We also provide an interactive Google Colab notebook (http://bit.ly/39kMtuR) that goes through all the analysis discussed in the paper. △ Less

Submitted 9 August, 2020; v1 submitted 10 February, 2020; originally announced February 2020.

Comments: Update with accepted version

Journal ref: Journal of Applied Physics 128, 055101 (2020)

Reconstruction of the lattice Hamiltonian models from the observations of microscopic degrees of freedom in the presence of competing interactions

Authors: Sai Mani Prudhvi Valleti, Lukas Vlcek, Maxim Ziatdinov, Rama K. Vasudevan, Sergei V. Kalinin

Abstract: The emergence of scanning probe and electron beam imaging techniques have allowed quantitative studies of atomic structure and minute details of electronic and vibrational structure on the level of individual atomic units. These microscopic descriptors in turn can be associated with the local symmetry breaking phenomena, representing stochastic manifestation of underpinning generative physical mod… ▽ More The emergence of scanning probe and electron beam imaging techniques have allowed quantitative studies of atomic structure and minute details of electronic and vibrational structure on the level of individual atomic units. These microscopic descriptors in turn can be associated with the local symmetry breaking phenomena, representing stochastic manifestation of underpinning generative physical model. Here, we explore the reconstruction of exchange integrals in the Hamiltonian for the lattice model with two competing interactions from the observations of the microscopic degrees of freedom and establish the uncertainties and reliability of such analysis in a broad parameter-temperature space. As an ancillary task, we develop a machine learning approach based on histogram clustering to predict phase diagrams efficiently using a reduced descriptor space. We further demonstrate that reconstruction is possible well above the phase transition and in the regions of the parameter space when the macroscopic ground state of the system is poorly defined due to frustrated interactions. This suggests that this approach can be applied to the traditionally complex problems of condensed matter physics such as ferroelectric relaxors and morphotropic phase boundary systems, spin and cluster glasses, quantum systems once the local descriptors linked to the relevant physical behaviors are known. △ Less

Submitted 19 January, 2020; originally announced January 2020.

Comments: 20 pages and 9 figures

Dynamic manipulation in piezoresponse force microscopy: creating non-equilibrium phases with large electromechanical response

Authors: Kyle P. Kelley, Yao Ren, Anna N. Morozovska, Eugene A. Eliseev, Yoshitaka Ehara, Hiroshi Funakubo, Thierry Giamarchi, Nina Balke, Rama K. Vasudevan, Ye Cao, Stephen Jesse, Sergei V. Kalinin

Abstract: Domains walls and topological defects in ferroelectric materials have emerged as a powerful new paradigm for functional electronic devices including memory and logic. Similarly, wall interactions and dynamics underpin a broad range of mesoscale phenomena ranging from giant electromechanical responses to memory effects. Exploring the functionalities of individual domain walls, their interactions, a… ▽ More Domains walls and topological defects in ferroelectric materials have emerged as a powerful new paradigm for functional electronic devices including memory and logic. Similarly, wall interactions and dynamics underpin a broad range of mesoscale phenomena ranging from giant electromechanical responses to memory effects. Exploring the functionalities of individual domain walls, their interactions, and controlled modifications of the domain structures is crucial for applications and fundamental physical studies. However, the dynamic nature of these features severely limits studies of their local physics since application of local biases or pressures in piezoresponse force microscopy induce wall displacement as a primary response. Here, we introduce a fundamentally new approach for the control and modification of domain structures based on automated experimentation whereby real space image-based feedback is used to control the tip bias during ferroelectric switching, allowing for modification routes conditioned on domain states under the tip. This automated experiment approach is demonstrated for the exploration of domain wall dynamics and creation of metastable phases with large electromechanical response. △ Less

Submitted 10 January, 2020; originally announced January 2020.

Direct matter disassembly via electron beam control: Electron-beam-mediated catalytic etching of graphene by nanoparticles

Authors: Ondrej Dyck, David Lingerfelt, Songkil Kim, Stephen Jesse, Sergei V. Kalinin

Abstract: We report electron-beam activated motion of a catalytic nanoparticle along a graphene step edge and associated etching of the edge. This approach enables beam-controlled etching of matter through activated electrocatalytic processes. The applications of electron-beam control as a paradigm for molecular-scale robotics are discussed. We report electron-beam activated motion of a catalytic nanoparticle along a graphene step edge and associated etching of the edge. This approach enables beam-controlled etching of matter through activated electrocatalytic processes. The applications of electron-beam control as a paradigm for molecular-scale robotics are discussed. △ Less

Submitted 16 December, 2019; originally announced December 2019.

Piezoresponse phase as variable in electromechanical characterization

Authors: Sabine M. Neumayer, Sahar Saremi, Lane W. Martin, Liam Collins, Alexander Tselev, Stephen Jesse, Sergei V. Kalinin, Nina Balke

Abstract: Piezoresponse force microscopy (PFM) is a powerful characterization technique to readily image and manipulate ferroelectrics domains. PFM gives insight into the strength of local piezoelectric coupling as well as polarization direction through PFM amplitude and phase, respectively. Converting measured arbitrary units to physical material parameters, however, remains a challenge. While much effort… ▽ More Piezoresponse force microscopy (PFM) is a powerful characterization technique to readily image and manipulate ferroelectrics domains. PFM gives insight into the strength of local piezoelectric coupling as well as polarization direction through PFM amplitude and phase, respectively. Converting measured arbitrary units to physical material parameters, however, remains a challenge. While much effort has been spent on quantifying the PFM amplitude signal, little attention has been given to the PFM phase and it is often arbitrarily adjusted to fit expectations or processed as recorded. This is problematic when investigating materials with unknown or potentially negative sign of the probed effective electrostrictive coefficient or strong frequency dispersion of electromechanical responses since assumptions about the phase cannot be reliably made. The PFM phase can, however, provide important information on the polarization orientation and the sign of the electrostrictive coefficient. Most notably, the orientation of the PFM hysteresis loop is determined by the PFM phase. Moreover, when presenting PFM data as a combined signal, the resulting response can be artificially lowered or asymmetric if the phase data has not been correctly processed. Here, we demonstrate a path to identify the phase offset required to extract correct meaning from PFM phase data. We explore different sources of phase offsets including the experimental setup, instrumental contributions, and data analysis. We discuss the physical working principles of PFM and develop a strategy to extract physical meaning from the PFM phase. The proposed procedures are verified on two materials with positive and negative piezoelectric coefficients. △ Less

Submitted 6 December, 2019; originally announced December 2019.

Comments: 16 pages, 6 figures

Imaging Mechanism for Hyperspectral Scanning Probe Microscopy via Gaussian Process Modelling

Authors: Maxim Ziatdinov, Dohyung Kim, Sabine Neumayer, Rama K. Vasudevan, Liam Collins, Stephen Jesse, Mahshid Ahmadi, Sergei V. Kalinin

Abstract: We investigate the ability to reconstruct and derive spatial structure from sparsely sampled 3D piezoresponse force microcopy data, captured using the band-excitation (BE) technique, via Gaussian Process (GP) methods. Even for weakly informative priors, GP methods allow unambiguous determination of the characteristic length scales of the imaging process both in spatial and frequency domains. We fu… ▽ More We investigate the ability to reconstruct and derive spatial structure from sparsely sampled 3D piezoresponse force microcopy data, captured using the band-excitation (BE) technique, via Gaussian Process (GP) methods. Even for weakly informative priors, GP methods allow unambiguous determination of the characteristic length scales of the imaging process both in spatial and frequency domains. We further show that BE data set tends to be oversampled, with ~30% of the original data set sufficient for high-quality reconstruction, potentially enabling the faster BE imaging. Finally, we discuss how the GP can be used for automated experimentation in SPM, by combining GP regression with non-rectangular scans. The full code for GP regression applied to hyperspectral data is available at https://git.io/JePGr. △ Less

Submitted 26 November, 2019; originally announced November 2019.