-
Robust Ptychographic Reconstruction with an Out-of-Focus Electron Probe
Authors:
Shoucong Ning,
Wenhui Xu,
Pengju Sheng,
Leyi Loh,
Stephen Pennycook,
Fucai Zhang,
Michel Bosman,
Qian He
Abstract:
As a burgeoning technique, out-of-focus electron ptychography offers the potential for rapidly imaging atomic-scale large fields of view (FoV) using a single diffraction dataset. However, achieving robust out-of-focus ptychographic reconstruction poses a significant challenge due to the inherent scan instabilities of electron microscopes, compounded by the presence of unknown aberrations in the pr…
▽ More
As a burgeoning technique, out-of-focus electron ptychography offers the potential for rapidly imaging atomic-scale large fields of view (FoV) using a single diffraction dataset. However, achieving robust out-of-focus ptychographic reconstruction poses a significant challenge due to the inherent scan instabilities of electron microscopes, compounded by the presence of unknown aberrations in the probe-forming lens. In this study, we substantially enhance the robustness of out-of-focus ptychographic reconstruction by extending our previous calibration method (the Fourier method), which was originally developed for the in-focus scenario. This extended Fourier method surpasses existing calibration techniques by providing more reliable and accurate initialization of scan positions and electron probes. Additionally, we comprehensively explore and recommend optimized experimental parameters for robust out-of-focus ptychography, includingaperture size and defocus, through extensive simulations. Lastly, we conduct a comprehensive comparison between ptychographic reconstructions obtained with focused and defocused electron probes, particularly in the context of low-dose and precise phase imaging, utilizing our calibration method as the basis for evaluation.
△ Less
Submitted 22 June, 2024;
originally announced June 2024.
-
A high-performance reconstruction method for partially coherent ptychography
Authors:
Wenhui Xu,
Shoucong Ning,
Pengju Sheng,
Huixiang Lin,
Angus I Kirkland,
Yong Peng,
Fucai Zhang
Abstract:
Ptychography is now integrated as a tool in mainstream microscopy allowing quantitative and high-resolution imaging capabilities over a wide field of view. However, its ultimate performance is inevitably limited by the available coherent flux when implemented using electrons or laboratory X-ray sources. We present a universal reconstruction algorithm with high tolerance to low coherence for both f…
▽ More
Ptychography is now integrated as a tool in mainstream microscopy allowing quantitative and high-resolution imaging capabilities over a wide field of view. However, its ultimate performance is inevitably limited by the available coherent flux when implemented using electrons or laboratory X-ray sources. We present a universal reconstruction algorithm with high tolerance to low coherence for both far-field and near-field ptychography. The approach is practical for partial temporal and spatial coherence and requires no prior knowledge of the source properties. Our initial visible-light and electron data show that the method can dramatically improve the reconstruction quality and accelerate the convergence rate of the reconstruction. The approach also integrates well into existing ptychographic engines. It can also improve mixed-state and numerical monochromatisation methods, requiring a smaller number of coherent modes or lower dimensionality of Krylov subspace while providing more stable and faster convergence. We propose that this approach could have significant impact on ptychography of weakly scattering samples.
△ Less
Submitted 9 June, 2024;
originally announced June 2024.
-
Incubating Advances in Integrated Photonics with Emerging Sensing and Computational Capabilities
Authors:
Sourabh Jain,
May Hlaing,
Kang Chieh Fan,
Jason Midkiff,
Shupeng Ning,
Chenghao Feng,
Po Yu Hsiao,
Patrick Camp,
Ray Chen
Abstract:
As photonic technologies continue to grow in multidimensional aspects, integrated photonics holds a unique position and continuously presents enormous possibilities to research communities. Applications span across data centers, environmental monitoring, medical diagnosis, and highly compact communication components, with further possibilities growing endlessly. Here, we provide a review of state…
▽ More
As photonic technologies continue to grow in multidimensional aspects, integrated photonics holds a unique position and continuously presents enormous possibilities to research communities. Applications span across data centers, environmental monitoring, medical diagnosis, and highly compact communication components, with further possibilities growing endlessly. Here, we provide a review of state of the art integrated photonic sensors operating in near and mid infrared wavelength regions on various material platforms. Among different materials, architectures, and technologies leading the way for on chip sensors, we discuss optical sensing principles commonly applied to biochemical and gas sensing. Our focus is particularly on passive and active optical waveguides, including dispersion engineered metamaterial based structures an essential approach for enhancing the interaction between light and analytes in chip scale sensors. We harness a diverse array of cutting edge sensing technologies, heralding a revolutionary on chip sensing paradigm. Our arsenal includes refractive index based sensing, plasmonic, and spectroscopy, forging an unparalleled foundation for innovation and precision. Furthermore, we include a brief discussion of recent trends and computational concepts incorporating Artificial Intelligence & Machine Learning (AI/ML) and deep learning approaches over the past few years to improve the qualitative and quantitative analysis of sensor measurements.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Photonic-Electronic Integrated Circuits for High-Performance Computing and AI Accelerator
Authors:
Shupeng Ning,
Hanqing Zhu,
Chenghao Feng,
Jiaqi Gu,
Zhixing Jiang,
Zhoufeng Ying,
Jason Midkiff,
Sourabh Jain,
May H. Hlaing,
David Z. Pan,
Ray T. Chen
Abstract:
In recent decades, the demand for computational power has surged, particularly with the rapid expansion of artificial intelligence (AI). As we navigate the post-Moore's law era, the limitations of traditional electrical digital computing, including process bottlenecks and power consumption issue, are propelling the search for alternative computing paradigms. Among various emerging technologies, in…
▽ More
In recent decades, the demand for computational power has surged, particularly with the rapid expansion of artificial intelligence (AI). As we navigate the post-Moore's law era, the limitations of traditional electrical digital computing, including process bottlenecks and power consumption issue, are propelling the search for alternative computing paradigms. Among various emerging technologies, integrated photonics stands out as a promising solution for the next generation of high-performance computing due to the inherent advantages of light, such as low latency, high bandwidth, and unique multiplexing techniques. Furthermore, the progress in photonic integrated circuits (PICs), which are equipped with abundant photoelectronic components, positions photonic-electronic integrated circuits as a viable solution for high-performance computing and as hardware AI accelerators. In this review, we survey recent advancements in both PIC-based digital and analog computing for AI, exploring the principal benefits and obstacles of implementation. Additionally, we propose a comprehensive analysis of photonic AI from the perspectives of hardware implementation, accelerator architecture, and software-hardware co-design. In the end, acknowledging the existing challenges, we underscore potential strategies for overcoming these issues and offer insights into the future drivers for optical computing.
△ Less
Submitted 21 March, 2024;
originally announced March 2024.
-
Neural Network Methods for Radiation Detectors and Imaging
Authors:
S. Lin,
S. Ning,
H. Zhu,
T. Zhou,
C. L. Morris,
S. Clayton,
M. Cherukara,
R. T. Chen,
Z. Wang
Abstract:
Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed artificial intelligence. We give an overview of data generation at photon sources, deep learning-based methods for image processing tasks, and hardware solutions…
▽ More
Recent advances in image data processing through machine learning and especially deep neural networks (DNNs) allow for new optimization and performance-enhancement schemes for radiation detectors and imaging hardware through data-endowed artificial intelligence. We give an overview of data generation at photon sources, deep learning-based methods for image processing tasks, and hardware solutions for deep learning acceleration. Most existing deep learning approaches are trained offline, typically using large amounts of computational resources. However, once trained, DNNs can achieve fast inference speeds and can be deployed to edge devices. A new trend is edge computing with less energy consumption (hundreds of watts or less) and real-time analysis potential. While popularly used for edge computing, electronic-based hardware accelerators ranging from general purpose processors such as central processing units (CPUs) to application-specific integrated circuits (ASICs) are constantly reaching performance limits in latency, energy consumption, and other physical constraints. These limits give rise to next-generation analog neuromorhpic hardware platforms, such as optical neural networks (ONNs), for high parallel, low latency, and low energy computing to boost deep learning acceleration.
△ Less
Submitted 9 November, 2023;
originally announced November 2023.
-
Integrated multi-operand optical neurons for scalable and hardware-efficient deep learning
Authors:
Chenghao Feng,
Jiaqi Gu,
Hanqing Zhu,
Rongxing Tang,
Shupeng Ning,
May Hlaing,
Jason Midkiff,
Sourabh Jain,
David Z. Pan,
Ray T. Chen
Abstract:
The optical neural network (ONN) is a promising hardware platform for next-generation neuromorphic computing due to its high parallelism, low latency, and low energy consumption. However, previous integrated photonic tensor cores (PTCs) consume numerous single-operand optical modulators for signal and weight encoding, leading to large area costs and high propagation loss to implement large tensor…
▽ More
The optical neural network (ONN) is a promising hardware platform for next-generation neuromorphic computing due to its high parallelism, low latency, and low energy consumption. However, previous integrated photonic tensor cores (PTCs) consume numerous single-operand optical modulators for signal and weight encoding, leading to large area costs and high propagation loss to implement large tensor operations. This work proposes a scalable and efficient optical dot-product engine based on customized multi-operand photonic devices, namely multi-operand optical neurons (MOON). We experimentally demonstrate the utility of a MOON using a multi-operand-Mach-Zehnder-interferometer (MOMZI) in image recognition tasks. Specifically, our MOMZI-based ONN achieves a measured accuracy of 85.89% in the street view house number (SVHN) recognition dataset with 4-bit voltage control precision. Furthermore, our performance analysis reveals that a 128x128 MOMZI-based PTCs outperform their counterparts based on single-operand MZIs by one to two order-of-magnitudes in propagation loss, optical delay, and total device footprint, with comparable matrix expressivity.
△ Less
Submitted 31 May, 2023;
originally announced May 2023.
-
Gauge Field Induced Chiral Zero Mode in Five-dimensional Yang Monopole Metamaterials
Authors:
Shaojie Ma,
Hongwei Jia,
Yangang Bi,
Shangqiang Ning,
Fuxin Guan,
Hongchao Liu,
Chenjie Wang,
Shuang Zhang
Abstract:
Owing to the chirality of Weyl nodes characterized by the first Chern number, a Weyl system supports one-way chiral zero modes under a magnetic field, which underlies the celebrated chiral anomaly. As a generalization of Weyl nodes from three-dimensional to five-dimensional physical systems, Yang monopoles are topological singularities carrying nonzero second-order Chern numbers c2 = +1 or -1. Her…
▽ More
Owing to the chirality of Weyl nodes characterized by the first Chern number, a Weyl system supports one-way chiral zero modes under a magnetic field, which underlies the celebrated chiral anomaly. As a generalization of Weyl nodes from three-dimensional to five-dimensional physical systems, Yang monopoles are topological singularities carrying nonzero second-order Chern numbers c2 = +1 or -1. Here, we couple a Yang monopole with an external gauge field using an inhomogeneous Yang monopole metamaterial, and experimentally demonstrate the existence of a gapless chiral zero mode, where the judiciously designed metallic helical structures and the corresponding effective antisymmetric bianisotropic terms provide the means for controlling gauge fields in a synthetic five-dimensional space. This zeroth mode is found to originate from the coupling between the second Chern singularity and a generalized 4-form gauge field - the wedge product of the magnetic field with itself. This generalization reveals intrinsic connections between physical systems of different dimensions, while a higher dimensional system exhibits much richer supersymmetric structures in Landau level degeneracy due to the internal degrees of freedom. Our study offers the possibility of controlling electromagnetic waves by leveraging the concept of higher-order and higher-dimensional topological phenomena.
△ Less
Submitted 22 May, 2023;
originally announced May 2023.
-
A Point-of-Care Biosensor for Rapid Detection and Differentiation of COVID-19 Virus (SARS-CoV-2) and Influenza Virus Using Subwavelength Grating Micro-ring Resonator
Authors:
Shupeng Ning,
Hao-Chen Chang,
Kang-Chieh Fan,
Po-yu Hsiao,
Chenghao Feng,
Devan Shoemaker,
Ray T. Chen
Abstract:
In the context of continued spread of coronavirus disease 2019 (COVID-19) caused by SARS-CoV-2 and the emergence of new variants, the demand for rapid, accurate, and frequent detection is increasing. Besides, the new predominant strain, Omicron variant, manifests more similar clinical features to those of other common respiratory infections. The concurrent detection of multiple potential pathogens…
▽ More
In the context of continued spread of coronavirus disease 2019 (COVID-19) caused by SARS-CoV-2 and the emergence of new variants, the demand for rapid, accurate, and frequent detection is increasing. Besides, the new predominant strain, Omicron variant, manifests more similar clinical features to those of other common respiratory infections. The concurrent detection of multiple potential pathogens helps distinguish SARS-CoV-2 infection from other diseases with overlap** symptoms, which is significant for patients to receive tailored treatment and containing the outbreak. Here, we report a lab-on-a-chip biosensing platform for SARS-CoV-2 detection based on subwavelength grating micro-ring resonator. The sensing surface is functionalized by specific antibody against SARS-CoV-2 spike protein, which could produce redshifts of resonant peaks by antigen-antibody combination, thus achieving quantitative detection. Additionally, the sensor chip is integrated with a microfluidic chip with an anti-backflow Y-shaped structure that enables the concurrent detection of two analytes. In this study, we realized the detection and differentiation of COVID-19 and influenza A H1N1. Experimental results show that the limit of detection of our device reaches 100 fg/mL (1.31 fM) within 15 min detecting time, and cross-reactivity tests manifest the specificity of the optical diagnostic assay. Further, the integrated packaging and streamlined workflow facilitate its use for clinical applications. Thus, the biosensing platform offers a promising solution to achieve ultrasensitive, selective, multiplexed, and quantitative point-of-care detection of COVID-19.
△ Less
Submitted 11 January, 2023;
originally announced January 2023.
-
Learning Motifs and their Hierarchies in Atomic Resolution Microscopy
Authors:
Jiadong Dan,
Xiaoxu Zhao,
Shoucong Ning,
Jiong Lu,
Kian ** Loh,
N. Duane Loh,
Stephen J. Pennycook
Abstract:
Progress in functional materials discovery has been accelerated by advances in high throughput materials synthesis and by the development of high-throughput computation. However, a complementary robust and high throughput structural characterization framework is still lacking. New methods and tools in the field of machine learning suggest that a highly automated high-throughput structural characte…
▽ More
Progress in functional materials discovery has been accelerated by advances in high throughput materials synthesis and by the development of high-throughput computation. However, a complementary robust and high throughput structural characterization framework is still lacking. New methods and tools in the field of machine learning suggest that a highly automated high-throughput structural characterization framework based on atomic-level imaging can establish the crucial statistical link between structure and macroscopic properties. Here we develop a machine learning framework towards this goal. Our framework captures local structural features in images with Zernike polynomials, which is demonstrably noise-robust, flexible, and accurate. These features are then classified into readily interpretable structural motifs with a hierarchical active learning scheme powered by a novel unsupervised two-stage relaxed clustering scheme. We have successfully demonstrated the accuracy and efficiency of the proposed methodology by map** a full spectrum of structural defects, including point defects, line defects, and planar defects in scanning transmission electron microscopy (STEM) images of various 2D materials, with greatly improved separability over existing methods. Our techniques can be easily and flexibly applied to other types of microscopy data with complex features, providing a solid foundation for automatic, multiscale feature analysis with high veracity.
△ Less
Submitted 29 November, 2021; v1 submitted 23 May, 2020;
originally announced May 2020.
-
Spin-orbit coupling in photonic graphene
Authors:
Zhaoyang Zhang,
Shun Liang,
Feng Li,
Shaohuan Ning,
Yiming Li,
G. Malpuech,
Yanpeng Zhang,
Min Xiao,
D. Solnyshkov
Abstract:
We generate experimentally a honeycomb refractive index pattern in an atomic vapor cell using electromagnetically-induced transparency. We study experimentally and theoretically the propagation of polarized light beams in such "photonic graphene". We demonstrate that an effective spin-orbit coupling appears as a correction to the paraxial beam equations because of the strong spatial gradients of t…
▽ More
We generate experimentally a honeycomb refractive index pattern in an atomic vapor cell using electromagnetically-induced transparency. We study experimentally and theoretically the propagation of polarized light beams in such "photonic graphene". We demonstrate that an effective spin-orbit coupling appears as a correction to the paraxial beam equations because of the strong spatial gradients of the permittivity. It leads to the coupling of spin and angular momentum at the Dirac points of the graphene lattice. Our results suggest that the polarization degree plays an important role in many configurations where it has been previously neglected.
△ Less
Submitted 12 February, 2020;
originally announced February 2020.