Showing 1–35 of 35 results for author: Cherukara, M

Optical Control of Adaptive Nanoscale Domain Networks

Authors: Marc Zajac, Tao Zhou, Tiannan Yang, Sujit Das, Yue Cao, Burak Guzelturk, Vladimir Stoica, Mathew Cherukara, John W. Freeland, Venkatraman Gopalan, Ramamoorthy Ramesh, Lane W. Martin, Long-Qing Chen, Martin Holt, Stephan Hruszkewycz, Haidan Wen

Abstract: Adaptive networks can sense and adjust to dynamic environments to optimize their performance. Understanding their nanoscale responses to external stimuli is essential for applications in nanodevices and neuromorphic computing. However, it is challenging to image such responses on the nanoscale with crystallographic sensitivity. Here, the evolution of nanodomain networks in (PbTiO3)n/(SrTiO3)n supe… ▽ More Adaptive networks can sense and adjust to dynamic environments to optimize their performance. Understanding their nanoscale responses to external stimuli is essential for applications in nanodevices and neuromorphic computing. However, it is challenging to image such responses on the nanoscale with crystallographic sensitivity. Here, the evolution of nanodomain networks in (PbTiO3)n/(SrTiO3)n superlattices was directly visualized in real space as the system adapts to ultrafast repetitive optical excitations that emulate controlled neural inputs. The adaptive response allows the system to explore a wealth of metastable states that were previously inaccessible. Their reconfiguration and competition were quantitatively measured by scanning x-ray nanodiffraction as a function of the number of applied pulses, in which crystallographic characteristics were quantitatively assessed by assorted diffraction patterns using unsupervised machine-learning methods. The corresponding domain boundaries and their connectivity were drastically altered by light, holding promise for light-programmable nanocircuits in analogy to neuroplasticity. Phase-field simulations elucidate that the reconfiguration of the domain networks is a result of the interplay between photocarriers and transient lattice temperature. The demonstrated optical control scheme and the uncovered nanoscopic insights open opportunities for remote control of adaptive nanoscale domain networks. △ Less

Submitted 24 June, 2024; originally announced June 2024.

Deep Learning of Structural Morphology Imaged by Scanning X-ray Diffraction Microscopy

Authors: Aileen Luo, Tao Zhou, Martin V. Holt, Andrej Singer, Mathew J. Cherukara

Abstract: Scanning X-ray nanodiffraction microscopy is a powerful technique for spatially resolving nanoscale structural morphologies by diffraction contrast. One of the critical challenges in experimental nanodiffraction data analysis is posed by the convergence angle of nanoscale focusing optics which creates simultaneous dependency of the far-field scattering data on three independent components of the l… ▽ More Scanning X-ray nanodiffraction microscopy is a powerful technique for spatially resolving nanoscale structural morphologies by diffraction contrast. One of the critical challenges in experimental nanodiffraction data analysis is posed by the convergence angle of nanoscale focusing optics which creates simultaneous dependency of the far-field scattering data on three independent components of the local strain tensor - corresponding to dilation and two potential rigid body rotations of the unit cell. All three components are in principle resolvable through a spatially mapped sample tilt series however traditional data analysis is computationally expensive and prone to artifacts. In this study, we implement NanobeamNN, a convolutional neural network specifically tailored to the analysis of scanning probe X-ray microscopy data. NanobeamNN learns lattice strain and rotation angles from simulated diffraction of a focused X-ray nanobeam by an epitaxial thin film and can directly make reasonable predictions on experimental data without the need for additional fine-tuning. We demonstrate that this approach represents a significant advancement in computational speed over conventional methods, as well as a potential improvement in accuracy over the current standard. △ Less

Submitted 24 June, 2024; v1 submitted 11 June, 2024; originally announced June 2024.

Predicting ptychography probe positions using single-shot phase retrieval neural network

Authors: Ming Du, Tao Zhou, Jun**g Deng, Daniel J. Ching, Steven Henke, Mathew J. Cherukara

Abstract: Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization appro… ▽ More Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization approaches. When the error accumulates along the scan path or when the error magnitude is large, these approaches may not converge with satisfactory result. We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors, where a neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point. The pairwise offsets among these images are then found using a robust image registration method, and the results are combined to yield the complete scan path by constructing and solving a linear equation. We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of $10^2$ pixels, a magnitude that often makes optimization-based algorithms fail to converge. For ptychography instruments without sophisticated position control equipment such as interferometers, our method is of significant practical potential. △ Less

Submitted 31 May, 2024; originally announced May 2024.

MSC Class: 94A08 ACM Class: I.4.0

Three-dimensional Hard X-ray Ptychographic Reflectometry Imaging on Extended Mesoscopic Surface Structures

Authors: Peco Myint, Ashish Tripathi, Michael J. Wojcik, Jun**g Deng, Mathew J. Cherukara, Nicholas Schwarz, Suresh Narayanan, ** Wang, Miaoqi Chu, Zhang Jiang

Abstract: Many nano and quantum devices, with their sizes often spanning from millimeters down to sub-nanometer, have intricate low-dimensional, non-uniform, or hierarchical structures on surfaces and interfaces. Since their functionalities are dependent on these structures, high-resolution surface-sensitive characterization becomes imperative to gain a comprehensive understanding of the function-structure… ▽ More Many nano and quantum devices, with their sizes often spanning from millimeters down to sub-nanometer, have intricate low-dimensional, non-uniform, or hierarchical structures on surfaces and interfaces. Since their functionalities are dependent on these structures, high-resolution surface-sensitive characterization becomes imperative to gain a comprehensive understanding of the function-structure relationship. We thus developed hard X-ray ptychographic reflectometry imaging, a new technique that merges the high-resolution two-dimensional imaging capabilities of hard X-ray ptychography for extended objects, with the high-resolution depth profiling capabilities of X-ray reflectivity for layered structures. The synergy of these two methods fully leverages both amplitude and phase information from ptychography reconstruction to not only reveal surface topography and localized structures such as shapes and electron densities, but also yields statistical details such as interfacial roughness that is not readily accessible through coherent imaging solely. The hard X-ray ptychographic reflectometry imaging is well-suited for three-dimensional imaging of mesoscopic samples, particularly those comprising planar or layered nanostructures on opaque supports, and could also offer a high-resolution surface metrology and defect analysis on semiconductor devices such as integrated nanocircuits and lithographic photomasks for microchip fabrications. △ Less

Submitted 9 February, 2024; originally announced February 2024.

Comments: 43 pages, 11 figures

Opportunities for Retrieval and Tool Augmented Large Language Models in Scientific Facilities

Authors: Michael H. Prince, Henry Chan, Aikaterini Vriza, Tao Zhou, Varuni K. Sastry, Matthew T. Dearing, Ross J. Harder, Rama K. Vasudevan, Mathew J. Cherukara

Abstract: Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scient… ▽ More Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scientific needs, instruments and experiments become more intricate each year. This increased operational complexity makes it ever more challenging for domain scientists to design experiments that effectively leverage the capabilities of and operate on these advanced instruments. Large language models (LLMs) can perform complex information retrieval, assist in knowledge-intensive tasks across applications, and provide guidance on tool usage. Using x-ray light sources, leadership computing, and nanoscience centers as representative examples, we describe preliminary experiments with a Context-Aware Language Model for Science (CALMS) to assist scientists with instrument operations and complex experimentation. With the ability to retrieve relevant information from facility documentation, CALMS can answer simple questions on scientific capabilities and other operational procedures. With the ability to interface with software tools and experimental hardware, CALMS can conversationally operate scientific instruments. By making information more accessible and acting on user needs, LLMs could expand and diversify scientific facilities' users and accelerate scientific output. △ Less

Submitted 3 December, 2023; originally announced December 2023.

Data-driven discovery of dynamics from time-resolved coherent scattering

Authors: Nina Andrejevic, Tao Zhou, Qingteng Zhang, Suresh Narayanan, Mathew J. Cherukara, Maria K. Y. Chan

Abstract: Coherent X-ray scattering (CXS) techniques are capable of interrogating dynamics of nano- to mesoscale materials systems at time scales spanning several orders of magnitude. However, obtaining accurate theoretical descriptions of complex dynamics is often limited by one or more factors -- the ability to visualize dynamics in real space, computational cost of high-fidelity simulations, and effectiv… ▽ More Coherent X-ray scattering (CXS) techniques are capable of interrogating dynamics of nano- to mesoscale materials systems at time scales spanning several orders of magnitude. However, obtaining accurate theoretical descriptions of complex dynamics is often limited by one or more factors -- the ability to visualize dynamics in real space, computational cost of high-fidelity simulations, and effectiveness of approximate or phenomenological models. In this work, we develop a data-driven framework to uncover mechanistic models of dynamics directly from time-resolved CXS measurements without solving the phase reconstruction problem for the entire time series of diffraction patterns. Our approach uses neural differential equations to parameterize unknown real-space dynamics and implements a computational scattering forward model to relate real-space predictions to reciprocal-space observations. This method is shown to recover the dynamics of several computational model systems under various simulated conditions of measurement resolution and noise. Moreover, the trained model enables estimation of long-term dynamics well beyond the maximum observation time, which can be used to inform and refine experimental parameters in practice. Finally, we demonstrate an experimental proof-of-concept by applying our framework to recover the probe trajectory from a ptychographic scan. Our proposed framework bridges the wide existing gap between approximate models and complex data. △ Less

Submitted 30 November, 2023; v1 submitted 23 November, 2023; originally announced November 2023.

Spontaneous supercrystal formation during a strain-engineered metal-insulator transition

Authors: O. Yu. Gorobtsov, L. Miao, Z. Shao, Y. Tan, N. I. Schnitzer, B. H. Goodge, J. Ruf, D. Weinstock, M. Cherukara, M. V. Holt, H. Nair, L. -Q. Chen, L. F. Kourkoutis, D. G. Schlom, K. M. Shen, A. Singer

Abstract: Mott metal-insulator transitions possess electronic, magnetic, and structural degrees of freedom promising next generation energy-efficient electronics. We report a previously unknown, hierarchically ordered state during a Mott transition and demonstrate correlated switching of functional electronic properties. We elucidate in-situ formation of an intrinsic supercrystal in a Ca2RuO4 thin film. Mac… ▽ More Mott metal-insulator transitions possess electronic, magnetic, and structural degrees of freedom promising next generation energy-efficient electronics. We report a previously unknown, hierarchically ordered state during a Mott transition and demonstrate correlated switching of functional electronic properties. We elucidate in-situ formation of an intrinsic supercrystal in a Ca2RuO4 thin film. Machine learning-assisted X-ray nanodiffraction together with electron microscopy reveal multi-scale periodic domain formation at and below the film transition temperature (TFilm ~ 200-250 K) and a separate anisotropic spatial structure at and above TFilm. Local resistivity measurements imply an intrinsic coupling of the supercrystal orientation to the material's anisotropic conductivity. Our findings add an additional degree of complexity to the physical understanding of Mott transitions, opening opportunities for designing materials with tunable electronic properties. △ Less

Submitted 20 November, 2023; originally announced November 2023.

Neural Network Methods for Radiation Detectors and Imaging

Authors: S. Lin, S. Ning, H. Zhu, T. Zhou, C. L. Morris, S. Clayton, M. Cherukara, R. T. Chen, Z. Wang

Abstract: Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed artificial intelligence. We give an overview of data generation at photon sources, deep learning-based methods for image processing tasks, and hardware solutions… ▽ More Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed artificial intelligence. We give an overview of data generation at photon sources, deep learning-based methods for image processing tasks, and hardware solutions for deep learning acceleration. Most existing deep learning approaches are trained offline, typically using large amounts of computational resources. However, once trained, DNNs can achieve fast inference speeds and can be deployed to edge devices. A new trend is edge computing with less energy consumption (hundreds of watts or less) and real-time analysis potential. While popularly used for edge computing, electronic-based hardware accelerators ranging from general purpose processors such as central processing units (CPUs) to application-specific integrated circuits (ASICs) are constantly reaching performance limits in latency, energy consumption, and other physical constraints. These limits give rise to next-generation analog neuromorhpic hardware platforms, such as optical neural networks (ONNs), for high parallel, low latency, and low energy computing to boost deep learning acceleration. △ Less

Submitted 9 November, 2023; originally announced November 2023.

Report number: LA-UR-23-32395

AI-enabled Lorentz microscopy for quantitative imaging of nanoscale magnetic spin textures

Authors: Arthur R. C. McCray, Tao Zhou, Saugat Kandel, Amanda Petford-Long, Mathew J. Cherukara, Charudatta Phatak

Abstract: The manipulation and control of nanoscale magnetic spin textures is of rising interest as they are potential foundational units in next-generation computing paradigms. Achieving this requires a quantitative understanding of the spin texture behavior under external stimuli using in situ experiments. Lorentz transmission electron microscopy (LTEM) enables real-space imaging of spin textures at the n… ▽ More The manipulation and control of nanoscale magnetic spin textures is of rising interest as they are potential foundational units in next-generation computing paradigms. Achieving this requires a quantitative understanding of the spin texture behavior under external stimuli using in situ experiments. Lorentz transmission electron microscopy (LTEM) enables real-space imaging of spin textures at the nanoscale, but quantitative characterization of in situ data is extremely challenging. Here, we present an AI-enabled phase-retrieval method based on integrating a generative deep image prior with an image formation forward model for LTEM. Our approach uses a single out-of-focus image for phase retrieval and achieves significantly higher accuracy and robustness to noise compared to existing methods. Furthermore, our method is capable of isolating sample heterogeneities from magnetic contrast, as shown by application to simulated and experimental data. This approach allows quantitative phase reconstruction of in situ data and can also enable near real-time quantitative magnetic imaging. △ Less

Submitted 18 July, 2023; originally announced July 2023.

AI-assisted Automated Workflow for Real-time X-ray Ptychography Data Analysis via Federated Resources

Authors: Anakha V Babu, Tekin Bicer, Saugat Kandel, Tao Zhou, Daniel J. Ching, Steven Henke, Siniša Veseli, Ryan Chard, Antonino Miceli, Mathew Joseph Cherukara

Abstract: We present an end-to-end automated workflow that uses large-scale remote compute resources and an embedded GPU platform at the edge to enable AI/ML-accelerated real-time analysis of data collected for x-ray ptychography. Ptychography is a lensless method that is being used to image samples through a simultaneous numerical inversion of a large number of diffraction patterns from adjacent overlappin… ▽ More We present an end-to-end automated workflow that uses large-scale remote compute resources and an embedded GPU platform at the edge to enable AI/ML-accelerated real-time analysis of data collected for x-ray ptychography. Ptychography is a lensless method that is being used to image samples through a simultaneous numerical inversion of a large number of diffraction patterns from adjacent overlap** scan positions. This acquisition method can enable nanoscale imaging with x-rays and electrons, but this often requires very large experimental datasets and commensurately high turnaround times, which can limit experimental capabilities such as real-time experimental steering and low-latency monitoring. In this work, we introduce a software system that can automate ptychography data analysis tasks. We accelerate the data analysis pipeline by using a modified version of PtychoNN -- an ML-based approach to solve phase retrieval problem that shows two orders of magnitude speedup compared to traditional iterative methods. Further, our system coordinates and overlaps different data analysis tasks to minimize synchronization overhead between different stages of the workflow. We evaluate our workflow system with real-world experimental workloads from the 26ID beamline at Advanced Photon Source and ThetaGPU cluster at Argonne Leadership Computing Resources. △ Less

Submitted 9 April, 2023; originally announced April 2023.

Comments: 7 pages, 1 figure, to be published in High Performance Computing for Imaging Conference, Electronic Imaging (HPCI 2023)

Demonstration of an AI-driven workflow for autonomous high-resolution scanning microscopy

Authors: Saugat Kandel, Tao Zhou, Anakha V Babu, Zichao Di, Xinxin Li, Xuedan Ma, Martin Holt, Antonino Miceli, Charudatta Phatak, Mathew Cherukara

Abstract: With the continuing advances in scientific instrumentation, scanning microscopes are now able to image physical systems with up to sub-atomic-level spatial resolutions and sub-picosecond time resolutions. Commensurately, they are generating ever-increasing volumes of data, storing and analysis of which is becoming an increasingly difficult prospect. One approach to address this challenge is throug… ▽ More With the continuing advances in scientific instrumentation, scanning microscopes are now able to image physical systems with up to sub-atomic-level spatial resolutions and sub-picosecond time resolutions. Commensurately, they are generating ever-increasing volumes of data, storing and analysis of which is becoming an increasingly difficult prospect. One approach to address this challenge is through self-driving experimentation techniques that can actively analyze the data being collected and use this information to make on-the-fly measurement choices, such that the data collected is sparse but representative of the sample and sufficiently informative. Here, we report the Fast Autonomous Scanning Toolkit (FAST) that combines a trained neural network, a route optimization technique, and efficient hardware control methods to enable a self-driving scanning microscopy experiment. The key features of our method are that: it does not require any prior information about the sample, it has a very low computational cost, and that it uses generic hardware controls with minimal experiment-specific wrap**. We test this toolkit in numerical experiments and a scanning dark-field x-ray microscopy experiment of a $WSe_2$ thin film, where our experiments show that a FAST scan of <25% of the sample is sufficient to produce both a high-fidelity image and a quantitative analysis of the surface distortions in the sample. We show that FAST can autonomously identify all features of interest in the sample while significantly reducing the scan time, the volume of data acquired, and dose on the sample. The FAST toolkit is easy to apply for any scanning microscopy modalities and we anticipate adoption of this technique will empower broader multi-level studies of the evolution of physical phenomena with respect to time, temperature, or other experimental parameters. △ Less

Submitted 12 January, 2023; originally announced January 2023.

Elucidation of Relaxation Dynamics Beyond Equilibrium Through AI-informed X-ray Photon Correlation Spectroscopy

Authors: James P. Horwath, Xiao-Min Lin, Hongrui He, Qingteng Zhang, Eric M. Dufresne, Miaoqi Chu, Subramanian K. R. S. Sankaranarayanan, Wei Chen, Suresh Narayanan, Mathew J. Cherukara

Abstract: Understanding and interpreting dynamics of functional materials \textit{in situ} is a grand challenge in physics and materials science due to the difficulty of experimentally probing materials at varied length and time scales. X-ray photon correlation spectroscopy (XPCS) is uniquely well-suited for characterizing materials dynamics over wide-ranging time scales, however spatial and temporal hetero… ▽ More Understanding and interpreting dynamics of functional materials \textit{in situ} is a grand challenge in physics and materials science due to the difficulty of experimentally probing materials at varied length and time scales. X-ray photon correlation spectroscopy (XPCS) is uniquely well-suited for characterizing materials dynamics over wide-ranging time scales, however spatial and temporal heterogeneity in material behavior can make interpretation of experimental XPCS data difficult. In this work we have developed an unsupervised deep learning (DL) framework for automated classification and interpretation of relaxation dynamics from experimental data without requiring any prior physical knowledge of the system behavior. We demonstrate how this method can be used to rapidly explore large datasets to identify samples of interest, and we apply this approach to directly correlate bulk properties of a model system to microscopic dynamics. Importantly, this DL framework is material and process agnostic, marking a concrete step towards autonomous materials discovery. △ Less

Submitted 7 December, 2022; originally announced December 2022.

Multislice forward modeling of Coherent Surface Scattering Imaging on surface and interfacial structures

Authors: Peco Myint, Miaoqi Chu, Ashish Tripathi, Michael J. Wojcik, Jian Zhou, Mathew J. Cherukara, Suresh Narayanan, ** Wang, Zhang Jiang

Abstract: To study nanostructures on substrates, surface-sensitive reflection-geometry scattering techniques such as grazing incident small angle x-ray scattering are commonly used to yield an averaged statistical structural information of the surface sample. Grazing incidence geometry can probe the absolute three-dimensional structural morphology of the sample if a highly coherent beam is used. Coherent Su… ▽ More To study nanostructures on substrates, surface-sensitive reflection-geometry scattering techniques such as grazing incident small angle x-ray scattering are commonly used to yield an averaged statistical structural information of the surface sample. Grazing incidence geometry can probe the absolute three-dimensional structural morphology of the sample if a highly coherent beam is used. Coherent Surface Scattering Imaging (CSSI) is a powerful yet non-invasive technique similar to Coherent X-ray Diffractive Imaging (CDI) but performed at small angles and grazing-incidence reflection geometry. A challenge with CSSI is that conventional CDI reconstruction techniques cannot be directly applied to CSSI because the Fourier-transform-based forward models cannot reproduce the dynamical scattering phenomenon near the critical angle of total external reflection of the substrate-supported samples. To overcome this challenge, we have developed a multislice forward model which can successfully simulate the dynamical or multi-beam scattering generated from surface structures and the underlying substrate. The forward model is also demonstrated to be able to reconstruct an elongated 3D pattern from a single shot scattering image in the CSSI geometry through fast-performing CUDA-assisted PyTorch optimization with automatic differentiation. △ Less

Submitted 17 November, 2022; originally announced December 2022.

Comments: 12 pages, 4 figures, 1 table

Deep learning at the edge enables real-time streaming ptychographic imaging

Authors: Anakha V Babu, Tao Zhou, Saugat Kandel, Tekin Bicer, Zhengchun Liu, William Judge, Daniel J. Ching, Yi Jiang, Sinisa Veseli, Steven Henke, Ryan Chard, Yudong Yao, Ekaterina Sirazitdinova, Geetika Gupta, Martin V. Holt, Ian T. Foster, Antonino Miceli, Mathew J. Cherukara

Abstract: Coherent microscopy techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent X-ray microscopy methods like ptychography are poised to revolutionize nanoscale materials charact… ▽ More Coherent microscopy techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent X-ray microscopy methods like ptychography are poised to revolutionize nanoscale materials characterization. However, associated significant increases in data and compute needs mean that conventional approaches no longer suffice for recovering sample images in real-time from high-speed coherent imaging experiments. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the sampling constraints imposed by traditional ptychography, allowing low dose imaging using orders of magnitude less data than required by traditional methods. △ Less

Submitted 19 September, 2022; originally announced September 2022.

A lightweight, user-configurable detector ASIC digital architecture with on-chip data compression for MHz X-ray coherent diffraction imaging

Authors: Sebastian Strempfer, Tao Zhou, Kazutomo Yoshii, Mike Hammer, Anakha Babu, Dawid Bycul, John Weizeorick, Mathew J. Cherukara, Antonino Miceli

Abstract: Today, most X-ray pixel detectors used at light sources transmit raw pixel data off the detector ASIC. With the availability of more advanced ASIC technology nodes for scientific application, more digital functionality from the computing domains (e.g., compression) can be integrated directly into a detector ASIC to increase data velocity. In this paper, we describe a lightweight, user-configurable… ▽ More Today, most X-ray pixel detectors used at light sources transmit raw pixel data off the detector ASIC. With the availability of more advanced ASIC technology nodes for scientific application, more digital functionality from the computing domains (e.g., compression) can be integrated directly into a detector ASIC to increase data velocity. In this paper, we describe a lightweight, user-configurable detector ASIC digital architecture with on-chip compression which can be implemented in \SI{130}{\nm} technologies in a reasonable area on the ASIC periphery. In addition, we present a design to efficiently handle the variable data from the stream of parallel compressors. The architecture includes user-selectable lossy and lossless compression blocks. The impact of lossy compression algorithms is evaluated on simulated and experimental X-ray ptychography datasets. This architecture is a practical approach to increase pixel detector frame rates towards the continuous \SI{1}{\MHz} regime for not only coherent imaging techniques such as ptychography, but also for other diffraction techniques at X-ray light sources. △ Less

Submitted 29 July, 2022; originally announced August 2022.

CEGANN: Crystal Edge Graph Attention Neural Network for multiscale classification of materials environment

Authors: Suvo Banik, Debdas Dhabal, Henry Chan, Sukriti Manna, Mathew Cherukara, Valeria Molinero, Subramanian KRS Sankaranarayanan

Abstract: Machine learning models and applications in materials design and discovery typically involve the use of feature representations or "descriptors" followed by a learning algorithm that maps them to a user-desired property of interest. Most popular mathematical formulation-based descriptors are not unique across atomic environments or suffer from transferability issues across different application do… ▽ More Machine learning models and applications in materials design and discovery typically involve the use of feature representations or "descriptors" followed by a learning algorithm that maps them to a user-desired property of interest. Most popular mathematical formulation-based descriptors are not unique across atomic environments or suffer from transferability issues across different application domains and/or material classes. In this work, we introduce the Crystal Edge Graph Attention Neural Network (CEGANN) workflow that uses graph attention-based architecture to learn unique feature representations and perform classification of materials across multiple scales (from atomic to mesoscale) and diverse classes ranging from metals, oxides, non-metals and even hierarchical materials such as zeolites and semi ordered materials such as mesophases. We first demonstrate a case study where the classification is based on a global, structure-level representation such as space group and structural dimensionality (e.g., bulk, 2D, clusters etc.). Using representative materials such as polycrystals and zeolites, we next demonstrate the transferability of our network in successfully performing local atom-level classification tasks, such as grain boundary identification and other heterointerfaces. We also demonstrate classification in (thermal) noisy dynamical environments using a representative example of crystal nucleation and growth of a zeolite polymorph from an amorphous synthesis mixture. Finally, we characterize the formation of a binary mesophase and its phase transitions and the growth of ice, demonstrating the performance of CEGANN in systems with thermal noise and compositional diversity. Overall, our approach is agnostic to the material type and allows for multiscale classification of features ranging from atomic-scale crystal structures to heterointerfaces to microscale grain boundaries. △ Less

Submitted 15 November, 2022; v1 submitted 20 July, 2022; originally announced July 2022.

X-ray Nano-imaging of Defects in Thin Film Catalysts via Cluster Analysis

Authors: Aileen Luo, Oleg Yu. Gorobtsov, Jocienne N. Nelson, Ding-Yuan Kuo, Ziming Shao, Ryan Bouck, Mathew Cherukara, Martin V. Holt, Kyle M. Shen, Darrell G. Schlom, ** Suntivich, Andrej Singer

Abstract: Functional properties of transition-metal oxides strongly depend on crystallographic defects. In transition-metal-oxide electrocatalysts such as SrIrO3 (SIO), crystallographic lattice deviations can affect ionic diffusion and adsorbate binding energies. Scanning x-ray nanodiffraction enables imaging of local structural distortions across an extended spatial region of thin samples. Line defects rem… ▽ More Functional properties of transition-metal oxides strongly depend on crystallographic defects. In transition-metal-oxide electrocatalysts such as SrIrO3 (SIO), crystallographic lattice deviations can affect ionic diffusion and adsorbate binding energies. Scanning x-ray nanodiffraction enables imaging of local structural distortions across an extended spatial region of thin samples. Line defects remain challenging to detect and localize using nanodiffraction, due to their weak diffuse scattering. Here we apply an unsupervised machine learning clustering algorithm to isolate the low-intensity diffuse scattering in as-grown and alkaline-treated thin epitaxially strained SIO films. We pinpoint the defect locations, find additional strain variation in the morphology of electrochemically cycled SIO, and interpret the defect type by analyzing the diffraction profile through clustering. Our findings demonstrate the use of a machine learning clustering algorithm for identifying and characterizing hard-to-find crystallographic defects in thin films of electrocatalysts and highlight the potential to study electrochemical reactions at defect sites in operando experiments. △ Less

Submitted 9 January, 2023; v1 submitted 18 March, 2022; originally announced March 2022.

Comments: 11 pages and 4 figures in main text, supporting information included

Real-time X-ray Phase-contrast Imaging Using SPINNet -- A Speckle-based Phase-contrast Imaging Neural Network

Authors: Zhi Qiao, Xianbo Shi, Yudong Yao, Michael J. Wojcik, Luca Rebuffi, Mathew J. Cherukara, Lahsen Assoufid

Abstract: X-ray phase-contrast imaging has become indispensable for visualizing samples with low absorption contrast. In this regard, speckle-based techniques have shown significant advantages in spatial resolution, phase sensitivity, and implementation flexibility compared with traditional methods. However, their computational cost has hindered their wider adoption. By exploiting the power of deep learning… ▽ More X-ray phase-contrast imaging has become indispensable for visualizing samples with low absorption contrast. In this regard, speckle-based techniques have shown significant advantages in spatial resolution, phase sensitivity, and implementation flexibility compared with traditional methods. However, their computational cost has hindered their wider adoption. By exploiting the power of deep learning, we developed a new speckle-based phase-contrast imaging neural network (SPINNet) that boosts the phase retrieval speed by at least two orders of magnitude compared to existing methods. To achieve this performance, we combined SPINNet with a novel coded-mask-based technique, an enhanced version of the speckle-based method. Using this scheme, we demonstrate a simultaneous reconstruction of absorption and phase images on the order of 100 ms, where a traditional correlation-based analysis would take several minutes even with a cluster. In addition to significant improvement in speed, our experimental results show that the imaging resolution and phase retrieval quality of SPINNet outperform existing single-shot speckle-based methods. Furthermore, we successfully demonstrate its application in 3D X-ray phase-contrast tomography. Our result shows that SPINNet could enable many applications requiring high-resolution and fast data acquisition and processing, such as in-situ and in-operando 2D and 3D phase-contrast imaging and real-time at-wavelength metrology and wavefront sensing. △ Less

Submitted 18 January, 2022; originally announced January 2022.

Comments: 13 pages, 8 figures

High-Performance Ptychographic Reconstruction with Federated Facilities

Authors: Tekin Bicer, Xiaodong Yu, Daniel J. Ching, Ryan Chard, Mathew J. Cherukara, Bogdan Nicolae, Rajkumar Kettimuthu, Ian T. Foster

Abstract: Beamlines at synchrotron light source facilities are powerful scientific instruments used to image samples and observe phenomena at high spatial and temporal resolutions. Typically, these facilities are equipped only with modest compute resources for the analysis of generated experimental datasets. However, high data rate experiments can easily generate data in volumes that take days (or even week… ▽ More Beamlines at synchrotron light source facilities are powerful scientific instruments used to image samples and observe phenomena at high spatial and temporal resolutions. Typically, these facilities are equipped only with modest compute resources for the analysis of generated experimental datasets. However, high data rate experiments can easily generate data in volumes that take days (or even weeks) to process on those local resources. To address this challenge, we present a system that unifies leadership computing and experimental facilities by enabling the automated establishment of data analysis pipelines that extend from edge data acquisition systems at synchrotron beamlines to remote computing facilities; under the covers, our system uses Globus Auth authentication to minimize user interaction, funcX to run user-defined functions on supercomputers, and Globus Flows to define and execute workflows. We describe the application of this system to ptychography, an ultra-high-resolution coherent diffraction imaging technique that can produce 100s of gigabytes to terabytes in a single experiment. When deployed on the DGX A100 ThetaGPU cluster at the Argonne Leadership Computing Facility and a microscopy beamline at the Advanced Photon Source, our system performs analysis as an experiment progresses to provide timely feedback. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: 19 pages, 5 figures, to be published in Smoky Mountains Computational Sciences and Engineering Conference (SMC 2021)

AutoPhaseNN: Unsupervised Physics-aware Deep Learning of 3D Nanoscale Bragg Coherent Diffraction Imaging

Authors: Yudong Yao, Henry Chan, Subramanian Sankaranarayanan, Prasanna Balaprakash, Ross J. Harder, Mathew J. Cherukara

Abstract: The problem of phase retrieval, or the algorithmic recovery of lost phase information from measured intensity alone, underlies various imaging methods from astronomy to nanoscale imaging. Traditional methods of phase retrieval are iterative in nature, and are therefore computationally expensive and time consuming. More recently, deep learning (DL) models have been developed to either provide learn… ▽ More The problem of phase retrieval, or the algorithmic recovery of lost phase information from measured intensity alone, underlies various imaging methods from astronomy to nanoscale imaging. Traditional methods of phase retrieval are iterative in nature, and are therefore computationally expensive and time consuming. More recently, deep learning (DL) models have been developed to either provide learned priors to iterative phase retrieval or in some cases completely replace phase retrieval with networks that learn to recover the lost phase information from measured intensity alone. However, such models require vast amounts of labeled data, which can only be obtained through simulation or performing computationally prohibitive phase retrieval on hundreds of or even thousands of experimental datasets. Using a 3D nanoscale X-ray imaging modality (Bragg Coherent Diffraction Imaging or BCDI) as a representative technique, we demonstrate AutoPhaseNN, a DL-based approach which learns to solve the phase problem without labeled data. By incorporating the physics of the imaging technique into the DL model during training, AutoPhaseNN learns to invert 3D BCDI data from reciprocal space to real space in a single shot without ever being shown real space images. Once trained, AutoPhaseNN is about one hundred times faster than traditional iterative phase retrieval methods while providing comparable image quality. △ Less

Submitted 4 April, 2022; v1 submitted 28 September, 2021; originally announced September 2021.

MSC Class: 68T07; 00A79

Proton distribution visualization in perovskite nickelate devices utilizing nanofocused X-rays

Authors: Ivan A. Zaluzhnyy, Peter O. Sprau, Richard Tran, Qi Wang, Hai-Tian Zhang, Zhen Zhang, Tae Joon Park, Nelson Hua, Boyan Stoychev, Mathew J. Cherukara, Martin V. Holt, Evgeny Nazarertski, Xiao**g Huang, Hanfei Yan, Ajith Pattammattel, Yong S. Chu, Shyue ** Ong, Shriram Ramanathan, Oleg G. Shpyrko, Alex Frano

Abstract: We use a 30-nm x-ray beam to study the spatially resolved properties of a SmNiO$_3$-based nanodevice that is doped with protons. The x-ray absorption spectra supported by density-functional theory (DFT) simulations show partial reduction of nickel valence in the region with high proton concentration, which leads to the insulating behavior. Concurrently, x-ray diffraction reveals only a small latti… ▽ More We use a 30-nm x-ray beam to study the spatially resolved properties of a SmNiO$_3$-based nanodevice that is doped with protons. The x-ray absorption spectra supported by density-functional theory (DFT) simulations show partial reduction of nickel valence in the region with high proton concentration, which leads to the insulating behavior. Concurrently, x-ray diffraction reveals only a small lattice distortion in the doped regions. Together, our results directly show that the knob which proton do** modifies is the electronic valency, and not the crystal lattice. The studies are relevant to on-going efforts to disentangle structural and electronic effects across metal-insulator phase transitions in correlated oxides. △ Less

Submitted 13 August, 2021; originally announced August 2021.

Journal ref: Phys. Rev. Materials 5, 095003 (2021)

Learning with Delayed Rewards -- A case study on inverse defect design in 2D materials

Authors: Suvo Banik, Troy D Loeffler, Rohit Batra, Harpal Singh, Mathew Cherukara, Subramanian KRS Sankaranarayanan

Abstract: Defect dynamics in materials are of central importance to a broad range of technologies from catalysis to energy storage systems to microelectronics. Material functionality depends strongly on the nature and organization of defects, their arrangements often involve intermediate or transient states that present a high barrier for transformation. The lack of knowledge of these intermediate states an… ▽ More Defect dynamics in materials are of central importance to a broad range of technologies from catalysis to energy storage systems to microelectronics. Material functionality depends strongly on the nature and organization of defects, their arrangements often involve intermediate or transient states that present a high barrier for transformation. The lack of knowledge of these intermediate states and the presence of this energy barrier presents a serious challenge for inverse defect design, especially for gradient-based approaches. Here, we present a reinforcement learning (Monte Carlo Tree Search) based on delayed rewards that allow for efficient search of the defect configurational space and allows us to identify optimal defect arrangements in low dimensional materials. Using a representative case of 2D MoS2, we demonstrate that the use of delayed rewards allows us to efficiently sample the defect configurational space and overcome the energy barrier for a wide range of defect concentrations (from 1.5% to 8% S vacancies), the system evolves from an initial randomly distributed S vacancies to one with extended S line defects consistent with previous experimental studies. Detailed analysis in the feature space allows us to identify the optimal pathways for this defect transformation and arrangement. Comparison with other global optimization schemes like genetic algorithms suggests that the MCTS with delayed rewards takes fewer evaluations and arrives at a better quality of the solution. The implications of the various sampled defect configurations on the 2H to 1T phase transitions in MoS2 are discussed. Overall, we introduce a Reinforcement Learning (RL) strategy employing delayed rewards that can accelerate the inverse design of defects in materials for achieving targeted functionality. △ Less

Submitted 19 June, 2021; originally announced June 2021.

Journal ref: ACS Applied Materials & Interfaces,2021

High resolution functional imaging through Lorentz transmission electron microscopy and differentiable programming

Authors: Tao Zhou, Mathew Cherukara, Charudatta Phatak

Abstract: Lorentz transmission electron microscopy is a unique characterization technique that enables the simultaneous imaging of both the microstructure and functional properties of materials at high spatial resolution. The quantitative information such as magnetization and electric potentials is carried by the phase of the electron wave, and is lost during imaging. In order to understand the local intera… ▽ More Lorentz transmission electron microscopy is a unique characterization technique that enables the simultaneous imaging of both the microstructure and functional properties of materials at high spatial resolution. The quantitative information such as magnetization and electric potentials is carried by the phase of the electron wave, and is lost during imaging. In order to understand the local interactions and develop structure-property relationships, it is necessary to retrieve the complete wavefunction of the electron wave, which requires solving for the phase shift of the electrons (phase retrieval). Here we have developed a method based on differentiable programming to solve the inverse problem of phase retrieval, using a series of defocused microscope images. We show that our method is robust and can outperform widely used \textit{transport of intensity equation} in terms of spatial resolution and accuracy of the retrieved phase under same electron dose conditions. Furthermore, our method shares the same basic structure as advanced machine learning algorithms, and is easily adaptable to various other forms of phase retrieval in electron microscopy. △ Less

Submitted 7 December, 2020; originally announced December 2020.

Real-time 3D Nanoscale Coherent Imaging via Physics-aware Deep Learning

Authors: Henry Chan, Youssef S. G. Nashed, Saugat Kandel, Stephan Hruszkewycz, Subramanian Sankaranarayanan, Ross J. Harder, Mathew J. Cherukara

Abstract: Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time-consuming and computationally expensive, precluding real-time imaging. Here, we us… ▽ More Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time-consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programming framework trained to predict 3D structure and strain solely from input 3D X-ray coherent scattering data. Our networks are designed to be "physics-aware" in multiple aspects; in that the physics of x-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods, with negligible loss in accuracy. Our integrated machine learning and differential programming solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas. △ Less

Submitted 16 June, 2020; originally announced June 2020.

Real-time sparse-sampled Ptychographic imaging through deep neural networks

Authors: Mathew J. Cherukara, Tao Zhou, Youssef Nashed, Pablo Enfedaque, Alex Hexemer, Ross J. Harder, Martin V. Holt

Abstract: Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, w… ▽ More Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, which typically precludes real-time imaging due to computational cost involved in solving this inverse problem. In this work we propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. The presented results demonstrate how PtychoNN can effectively be used on experimental data, being able to generate high quality reconstructions of a sample up to hundreds of times faster than state-of-the-art ptychography reconstruction solutions once trained. By surpassing the typical constraints of iterative model-based methods, we can significantly relax the data acquisition sampling conditions and produce equally satisfactory reconstructions. Besides drastically accelerating acquisition and analysis, this capability can enable new imaging scenarios that were not possible before, in cases of dose sensitive, dynamic and extremely voluminous samples. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Screening of Therapeutic Agents for COVID-19 using Machine Learning and Ensemble Docking Simulations

Authors: Rohit Batra, Henry Chan, Ganesh Kamath, Rampi Ramprasad, Mathew J. Cherukara, Subramanian Sankaranarayanan

Abstract: The world has witnessed unprecedented human and economic loss from the COVID-19 disease, caused by the novel coronavirus SARS-CoV-2. Extensive research is being conducted across the globe to identify therapeutic agents against the SARS-CoV-2. Here, we use a powerful and efficient computational strategy by combining machine learning (ML) based models and high-fidelity ensemble docking simulations t… ▽ More The world has witnessed unprecedented human and economic loss from the COVID-19 disease, caused by the novel coronavirus SARS-CoV-2. Extensive research is being conducted across the globe to identify therapeutic agents against the SARS-CoV-2. Here, we use a powerful and efficient computational strategy by combining machine learning (ML) based models and high-fidelity ensemble docking simulations to enable rapid screening of possible therapeutic molecules (or ligands). Our screening is based on the binding affinity to either the isolated SARS-CoV-2 S-protein at its host receptor region or to the Sprotein-human ACE2 interface complex, thereby potentially limiting and/or disrupting the host-virus interactions. We first apply our screening strategy to two drug datasets (CureFFI and DrugCentral) to identify hundreds of ligands that bind strongly to the aforementioned two systems. Candidate ligands were then validated by all atom docking simulations. The validated ML models were subsequently used to screen a large bio-molecule dataset (with nearly a million entries) to provide a rank-ordered list of ~19,000 potentially useful compounds for further validation. Overall, this work not only expands our knowledge of small-molecule treatment against COVID-19, but also provides an efficient pathway to perform high-throughput computational drug screening by combining quick ML surrogate models with expensive high-fidelity simulations, for accelerating the therapeutic cure of diseases. △ Less

Submitted 7 April, 2020; originally announced April 2020.

BLAST: Bridging Length/time scales via Atomistic Simulation Toolkit

Authors: Henry Chan, Badri Narayanan, Mathew Cherukara, Troy D. Loeffler, Michael G. Sternberg, Anthony Avarca, Subramanian K. R. S. Sankaranarayanan

Abstract: The ever-increasing power of supercomputers coupled with highly scalable simulation codes have made molecular dynamics an indispensable tool in applications ranging from predictive modeling of materials to computational design and discovery of new materials for a broad range of applications. Multi-fidelity scale bridging between the various flavors of molecular dynamics i.e. ab-initio, classical a… ▽ More The ever-increasing power of supercomputers coupled with highly scalable simulation codes have made molecular dynamics an indispensable tool in applications ranging from predictive modeling of materials to computational design and discovery of new materials for a broad range of applications. Multi-fidelity scale bridging between the various flavors of molecular dynamics i.e. ab-initio, classical and coarse-grained models has remained a long-standing challenge. Here, we introduce our framework BLAST (Bridging Length/time scales via Atomistic Simulation Toolkit) that leverages machine learning principles to address this challenge. BLAST is a multi-fidelity scale bridging framework that provide users with the capabilities to train and develop their own classical atomistic and coarse-grained interatomic potentials (force fields) for molecular simulations. BLAST is designed to address several long-standing problems in the molecular simulations community, such as unintended misuse of existing force fields due to knowledge gap between developers and users, bottlenecks in traditional force field development approaches, and other issues relating to the accuracy, efficiency, and transferability of force fields. Here, we discuss several important aspects in force field development and highlight features in BLAST that enable its functionalities and ease of use. △ Less

Submitted 21 February, 2020; originally announced February 2020.

A coarse-grained deep neural network model for liquid water

Authors: Tarak K Patra, Troy D. Loeffler, Henry Chan, Mathew J. Cherukara, Badri Narayanan, Subramanian K. R. S. Sankaranarayanan

Abstract: We introduce a coarse-grained deep neural network model (CG-DNN) for liquid water that utilizes 50 rotational and translational invariant coordinates, and is trained exclusively against energies of ~30,000 bulk water configurations. Our CG-DNN potential accurately predicts both the energies and molecular forces of water; within 0.9 meV/molecule and 54 meV/angstrom of a reference (coarse-grained bo… ▽ More We introduce a coarse-grained deep neural network model (CG-DNN) for liquid water that utilizes 50 rotational and translational invariant coordinates, and is trained exclusively against energies of ~30,000 bulk water configurations. Our CG-DNN potential accurately predicts both the energies and molecular forces of water; within 0.9 meV/molecule and 54 meV/angstrom of a reference (coarse-grained bond-order potential) model. The CG-DNN water model also provides good prediction of several structural, thermodynamic, and temperature dependent properties of liquid water, with values close to that obtained from the reference model. More importantly, CG-DNN captures the well-known density anomaly of liquid water observed in experiments. Our work lays the groundwork for a scheme where existing empirical water models can be utilized to develop fully flexible neural network framework that can subsequently be trained against sparse data from high-fidelity albeit expensive beyond-DFT calculations. △ Less

Submitted 14 October, 2019; v1 submitted 1 October, 2019; originally announced October 2019.

Active Learning the Coarse-Grained Energy Landscape For Water Clusters From Sparse Training Data

Authors: Troy D. Loeffler, Tarak K. Patra, Henry Chan, Mathew Cherukara, Subramanian K. R. S. Sankaranarayanan

Abstract: ANNs are currently trained by generating large quantities (On the order of $10^{4}$ or greater) of structural data in hopes that the ANN has adequately sampled the energy landscape both near and far-from-equilibrium. This can, however, be a bit prohibitive when it comes to more accurate levels of quantum theory. As such it is desirable to train a model using the absolute minimal data set possible,… ▽ More ANNs are currently trained by generating large quantities (On the order of $10^{4}$ or greater) of structural data in hopes that the ANN has adequately sampled the energy landscape both near and far-from-equilibrium. This can, however, be a bit prohibitive when it comes to more accurate levels of quantum theory. As such it is desirable to train a model using the absolute minimal data set possible, especially when costs of high-fidelity calculations such as CCSD and QMC are high. Here, we present an Active Learning approach that iteratively trains an ANN model to faithfully replicate the coarse-grained energy surface of water clusters using only 426 total structures in its training data. Our active learning workflow starts with a sparse training dataset which is continually updated via a Monte Carlo scheme that sparsely queries the energy landscape and tests the network performance. Next, the network is retrained with an updated training set that includes failed configurations/energies from previous iteration until convergence is attained. Once trained, we generate an extensive test set of ~100,000 configurations sampled across clusters ranging from 1 to 200 molecules and demonstrate that the trained network adequately reproduces the energies (within mean absolute error (MAE) of ~ 2 meV/molecule) and forces (MAE ~ 40 meV/{Å}) compared to the reference model. More importantly, the trained ANN model also accurately captures both the structure as well as the free energy as a function of the various cluster sizes. Overall, this study reports a new active learning scheme with promising strategy to develop accurate force-fields for molecular simulations using extremely sparse training data sets. △ Less

Submitted 2 November, 2019; v1 submitted 25 September, 2019; originally announced September 2019.

Time-resolved x-ray microscopy for materials science

Authors: Haidan Wen, Mathew J. Cherukara, Martin V. Holt

Abstract: X-ray microscopy has been an indispensable tool to image nanoscale properties for materials research. One of its recent advances is to extend microscopic studies to the time domain for visualizing the dynamics of nanoscale phenomena. Large-scale x-ray facilities have been the powerhouse of time-resolved x-ray microscopy. Their upgrades including a significant reduction of the x-ray emittance at st… ▽ More X-ray microscopy has been an indispensable tool to image nanoscale properties for materials research. One of its recent advances is to extend microscopic studies to the time domain for visualizing the dynamics of nanoscale phenomena. Large-scale x-ray facilities have been the powerhouse of time-resolved x-ray microscopy. Their upgrades including a significant reduction of the x-ray emittance at storage rings and fully coherent ultrashort x-ray pulses at free electron lasers, will lead to new developments in instrumentation and open new scientific opportunities for x-ray imaging of nanoscale dynamics with the simultaneous attainment of unprecedentedly high spatial and temporal resolutions. This review presents recent progress in and the outlook for time-resolved x-ray microscopy in the context of ultrafast nanoscale imaging and its applications to condensed matter physics and materials science. △ Less

Submitted 9 November, 2018; originally announced November 2018.

Real-time coherent diffraction inversion using deep generative networks

Authors: Mathew J. Cherukara, Youssef S. G. Nashed, Ross J. Harder

Abstract: Phase retrieval, or the process of recovering phase information in reciprocal space to reconstruct images from measured intensity alone, is the underlying basis to a variety of imaging applications including coherent diffraction imaging (CDI). Typical phase retrieval algorithms are iterative in nature, and hence, are time-consuming and computationally expensive, precluding real-time imaging. Furth… ▽ More Phase retrieval, or the process of recovering phase information in reciprocal space to reconstruct images from measured intensity alone, is the underlying basis to a variety of imaging applications including coherent diffraction imaging (CDI). Typical phase retrieval algorithms are iterative in nature, and hence, are time-consuming and computationally expensive, precluding real-time imaging. Furthermore, iterative phase retrieval algorithms struggle to converge to the correct solution especially in the presence of strong phase structures. In this work, we demonstrate the training and testing of CDI NN, a pair of deep deconvolutional networks trained to predict structure and phase in real space of a 2D object from its corresponding far-field diffraction intensities alone. Once trained, CDI NN can invert a diffraction pattern to an image within a few milliseconds of compute time on a standard desktop machine, opening the door to real-time imaging. △ Less

Submitted 7 June, 2018; originally announced June 2018.

Journal ref: Scientific Reports (2018) 8:16520

Anisotropic nano-scale resolution in 3D Bragg coherent diffraction imaging

Authors: Mathew J. Cherukara, Wonsuk Cha, Ross J. Harder

Abstract: We demonstrate that the resolution of three-dimensional (3D) real-space images obtained from Bragg x-ray coherent diffraction measurements is direction dependent. We propose and demonstrate the effectiveness of a metric to determine the spatial resolution of images that accounts for the direc- tional dependence. The measured direction dependent resolution of ~ 4-9nm is about 2 times higher than th… ▽ More We demonstrate that the resolution of three-dimensional (3D) real-space images obtained from Bragg x-ray coherent diffraction measurements is direction dependent. We propose and demonstrate the effectiveness of a metric to determine the spatial resolution of images that accounts for the direc- tional dependence. The measured direction dependent resolution of ~ 4-9nm is about 2 times higher than the best previously obtained 3D measurements. Finally, we quantify the relationship between the resolution of recovered real-space images and dosage, and discuss its implications in the light of next generation synchrotrons. △ Less

Submitted 7 June, 2018; originally announced June 2018.

Journal ref: Appl. Phys. Lett. 113, 203101 (2018)

Perovskite Quantum Organismoids

Authors: Fan Zuo, Priyadarshini Panda, Michele Kotiuga, Jiarui Li, Min Gu Kang, Claudio Mazzoli, Hua Zhou, Andi Barbour, Stuart Wilkins, Badri Narayanan, Mathew Cherukara, Zhen Zhang, Subramanian K. R. S. Sankaranarayanan, Riccardo Comin, Karin M. Rabe, Kaushik Roy, Shriram Ramanathan

Abstract: A central characteristic of living beings is the ability to learn from and respond to their environment leading to habit formation and decision making1-3. This behavior, known as habituation, is universal among forms of life with a central nervous system, and interestingly observed even in single cellular organisms that do not possess a brain4-5. Here, we report the discovery of habituation based… ▽ More A central characteristic of living beings is the ability to learn from and respond to their environment leading to habit formation and decision making1-3. This behavior, known as habituation, is universal among forms of life with a central nervous system, and interestingly observed even in single cellular organisms that do not possess a brain4-5. Here, we report the discovery of habituation based plasticity utilizing a perovskite quantum system by dynamical modulation of electron localization via reversible dopant incorporation. Microscopic mechanisms and pathways that enable this organismic collective charge-lattice interaction are elucidated by a combination of first-principles theory, synchrotron investigations, ab-initio dynamical simulations and in-situ environmental breathing studies. We implement a new learning algorithm inspired from the conductance relaxation behavior of perovskites that naturally incorporates habituation and demonstrate "learning to forget": a key feature of animal and human brains6. Most surprisingly, our results show that incorporating this elementary skill in learning dramatically boosts the capability of artificial cognitive systems. △ Less

Submitted 3 March, 2017; originally announced March 2017.

Ice grains grow by dissolution, ripening and grain boundary migration

Authors: Henry Chan, Mathew J Cherukara, Badri Narayanan, Chris J Benmore, Stephen Gray, Subramanian KRS Sankaranarayanan

Abstract: Despite the exponential growth in computing resources and the availability of a myriad of different theoretical water models, an accurate, yet computationally efficient molecular level description of mesoscopic grain growth remains a grand challenge. The underlying phase transitions and dynamical processes in deeply supercooled systems are often rendered inaccessible due to limitations imposed by… ▽ More Despite the exponential growth in computing resources and the availability of a myriad of different theoretical water models, an accurate, yet computationally efficient molecular level description of mesoscopic grain growth remains a grand challenge. The underlying phase transitions and dynamical processes in deeply supercooled systems are often rendered inaccessible due to limitations imposed by system sizes and timescales, which is further compounded by their sluggish kinetics. Here, we introduce a machine-learned, bond-order-based potential model (BOP) that more accurately describes the anomalous behavior, as well as structural and thermodynamical properties of both liquid water and ice, with at least two orders of magnitude cheaper computational cost than existing atomistic water models. In a significant departure from conventional force-field fitting, we use a multilevel evolutionary strategy that trains the BOP model against not just energetics but temperature dependent properties inferred from on-the-fly molecular dynamics simulations as well. We use the BOP model to probe the homogeneous ice nucleation and growth process by performing molecular dynamics on multi-million molecule systems for up to microsecond time scales. These massively parallel, long-time simulations naturally capture the competition between cubic, hexagonal, and stacking disordered ice phases during nucleation and early stages of growth leading to the formation of nanometer sized grains. Subsequently, we elucidate the hitherto elusive mechanism of grain coarsening of the crystallized mixed ice phases, which occur through grain dissolution and Ostwald ripening followed by grain boundary migration. △ Less

Submitted 1 December, 2016; originally announced December 2016.

Evolutionary optimization of a charge transfer ionic potential model for Ta/Ta-oxide hetero-interfaces

Authors: Kiran Sasikumar, Badri Narayanan, Mathew Cherukara, Alper Kinaci, Fatih G. Sen, Stephen K. Gray, Maria K. Y. Chan, Subramanian K. R. S. Sankaranarayanan

Abstract: Tantalum, tantalum oxide and their hetero-interfaces are of tremendous technological interest in several applications spanning electronics, thermal management, catalysis and biochemistry. For example, local oxygen stoichiometry variation in TaOx memristors comprising of metallic (Ta) and insulating oxide (Ta2O5) have been shown to result in fast switching on the sub-nanosecond timescale over a bil… ▽ More Tantalum, tantalum oxide and their hetero-interfaces are of tremendous technological interest in several applications spanning electronics, thermal management, catalysis and biochemistry. For example, local oxygen stoichiometry variation in TaOx memristors comprising of metallic (Ta) and insulating oxide (Ta2O5) have been shown to result in fast switching on the sub-nanosecond timescale over a billion cycles, relevant to neuromorphic computation. Despite its broad importance, an atomistic scale understanding of oxygen stoichiometry variation across Ta/TaOx hetero-interfaces, such as during early stages of oxidation and oxide growth, is not well understood. This is mainly due to the lack of a variable charge interatomic potential model for tantalum oxides that can accurately describe the ionic interactions in the metallic (Ta) and oxide (TaOx) environment as well as at their interfaces. To address this challenge, we introduce a charge transfer ionic potential (CTIP) model for Ta/Ta-oxide system by training against lattice parameters, cohesive energies, equations of state, and elastic properties of various experimentally observed Ta2O5 polymorphs. The best set of CTIP parameters are determined by employing a single-objective global optimization scheme driven by genetic algorithms followed by local Simplex optimization. Our newly developed CTIP potential accurately predicts structure, thermodynamics, energetic ordering of polymorphs, as well as elastic and surface properties of both Ta and Ta2O5, in excellent agreement with DFT calculations and experiments. We employ our newly parameterized CTIP potential to investigate the early stages of oxidation of Ta at different temperatures and atomic/molecular nature of the oxidizing species. △ Less

Submitted 26 April, 2017; v1 submitted 10 November, 2016; originally announced November 2016.

Journal ref: Chemistry of Materials 29 (8), p. 3603 (2017)