-
Augmenting x-ray single particle imaging reconstruction with self-supervised machine learning
Authors:
Zhantao Chen,
Cong Wang,
Mingye Gao,
Chun Hong Yoon,
Jana B. Thayer,
Joshua J. Turner
Abstract:
The development of X-ray Free Electron Lasers (XFELs) has opened numerous opportunities to probe atomic structure and ultrafast dynamics of various materials. Single Particle Imaging (SPI) with XFELs enables the investigation of biological particles in their natural physiological states with unparalleled temporal resolution, while circumventing the need for cryogenic conditions or crystallization.…
▽ More
The development of X-ray Free Electron Lasers (XFELs) has opened numerous opportunities to probe atomic structure and ultrafast dynamics of various materials. Single Particle Imaging (SPI) with XFELs enables the investigation of biological particles in their natural physiological states with unparalleled temporal resolution, while circumventing the need for cryogenic conditions or crystallization. However, reconstructing real-space structures from reciprocal-space x-ray diffraction data is highly challenging due to the absence of phase and orientation information, which is further complicated by weak scattering signals and considerable fluctuations in the number of photons per pulse. In this work, we present an end-to-end, self-supervised machine learning approach to recover particle orientations and estimate reciprocal space intensities from diffraction images only. Our method demonstrates great robustness under demanding experimental conditions with significantly enhanced reconstruction capabilities compared with conventional algorithms, and signifies a paradigm shift in SPI as currently practiced at XFELs.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
-
PeakNet: An Autonomous Bragg Peak Finder with Deep Neural Networks
Authors:
Cong Wang,
Po-Nan Li,
Jana Thayer,
Chun Hong Yoon
Abstract:
Serial crystallography at X-ray free electron laser (XFEL) and synchrotron facilities has experienced tremendous progress in recent times enabling novel scientific investigations into macromolecular structures and molecular processes. However, these experiments generate a significant amount of data posing computational challenges in data reduction and real-time feedback. Bragg peak finding algorit…
▽ More
Serial crystallography at X-ray free electron laser (XFEL) and synchrotron facilities has experienced tremendous progress in recent times enabling novel scientific investigations into macromolecular structures and molecular processes. However, these experiments generate a significant amount of data posing computational challenges in data reduction and real-time feedback. Bragg peak finding algorithm is used to identify useful images and also provide real-time feedback about hit-rate and resolution. Shot-to-shot intensity fluctuations and strong background scattering from buffer solution, injection nozzle and other shielding materials make this a time-consuming optimization problem. Here, we present PeakNet, an autonomous Bragg peak finder that utilizes deep neural networks. The development of this system 1) eliminates the need for manual algorithm parameter tuning, 2) reduces false-positive peaks by adjusting to shot-to-shot variations in strong background scattering in real-time, 3) eliminates the laborious task of manually creating bad pixel masks and the need to store these masks per event since these can be regenerated on demand. PeakNet also exhibits exceptional runtime efficiency, processing a 1920-by-1920 pixel image around 90 ms on an NVIDIA 1080 Ti GPU, with the potential for further enhancements through parallelized analysis or GPU stream processing. PeakNet is well-suited for expert-level real-time serial crystallography data analysis at high data rates.
△ Less
Submitted 29 June, 2023; v1 submitted 24 March, 2023;
originally announced March 2023.
-
Testing the data framework for an AI algorithm in preparation for high data rate X-ray facilities
Authors:
Hongwei Chen,
Sathya R. Chitturi,
Rajan Plumley,
Lingjia Shen,
Nathan C. Drucker,
Nicolas Burdet,
Cheng Peng,
Sougata Mardanya,
Daniel Ratner,
Aashwin Mishra,
Chun Hong Yoon,
Sanghoon Song,
Matthieu Chollet,
Gilberto Fabbris,
Mike Dunne,
Silke Nelson,
Mingda Li,
Aaron Lindenberg,
Chun**g Jia,
Youssef Nashed,
Arun Bansil,
Sugata Chowdhury,
Adrian E. Feiguin,
Joshua J. Turner,
Jana B. Thayer
Abstract:
The advent of next-generation X-ray free electron lasers will be capable of delivering X-rays at a repetition rate approaching 1 MHz continuously. This will require the development of data systems to handle experiments at these type of facilities, especially for high throughput applications, such as femtosecond X-ray crystallography and X-ray photon fluctuation spectroscopy. Here, we demonstrate a…
▽ More
The advent of next-generation X-ray free electron lasers will be capable of delivering X-rays at a repetition rate approaching 1 MHz continuously. This will require the development of data systems to handle experiments at these type of facilities, especially for high throughput applications, such as femtosecond X-ray crystallography and X-ray photon fluctuation spectroscopy. Here, we demonstrate a framework which captures single shot X-ray data at the LCLS and implements a machine-learning algorithm to automatically extract the contrast parameter from the collected data. We measure the time required to return the results and assess the feasibility of using this framework at high data volume. We use this experiment to determine the feasibility of solutions for `live' data analysis at the MHz repetition rate.
△ Less
Submitted 18 October, 2022;
originally announced October 2022.
-
Optimal pulse processing, pile-up decomposition and applications of silicon drift detectors at LCLS
Authors:
G. Blaj,
C. J. Kenney,
A. Dragone,
G. Carini,
S. Herrmann,
P. Hart,
A. Tomada,
J. Koglin,
G. Haller,
S. Boutet,
M. Messerschmidt,
G. Williams,
M. Chollet,
G. Dakovski,
S. Nelson,
J. Pines,
S. Song,
J. Thayer
Abstract:
Silicon drift detectors (SDDs) revolutionized spectroscopy in fields as diverse as geology and dentistry. For a subset of experiments at ultra-fast, x-ray free-electron lasers (FELs), SDDs can make substantial contributions. Often the unknown spectrum is interesting, carrying science data, or the background measurement is useful to identify unexpected signals. Many measurements involve only severa…
▽ More
Silicon drift detectors (SDDs) revolutionized spectroscopy in fields as diverse as geology and dentistry. For a subset of experiments at ultra-fast, x-ray free-electron lasers (FELs), SDDs can make substantial contributions. Often the unknown spectrum is interesting, carrying science data, or the background measurement is useful to identify unexpected signals. Many measurements involve only several discrete photon energies known a priori, allowing single event decomposition of pile-up and spectroscopic photon counting. We designed a pulse function and demonstrated that the signal amplitude and rise time are obtained for each pulse by fitting, thus removing the need for pulse sha**. By avoiding pulse sha**, rise times of tens of nanoseconds resulted in reduced pulse pile-up and allowed decomposition of remaining pulse pile-up at photon separation times down to hundreds of nanoseconds while yielding time-of-arrival information with precision of 10 nanoseconds. Waveform fitting yields simultaneously high energy resolution and high counting rates (2 orders of magnitude higher than current digital pulse processors). We showed that pile-up spectrum fitting is relatively simple and preferable to pile-up spectrum deconvolution. We developed a photon pile-up statistical model for constant intensity sources, extended it to variable intensity sources (typical for FELs) and used it to fit a complex pile-up spectrum. We subsequently developed a Bayesian pile-up decomposition method that allows decomposing pile-up of single events with up to 6 photons from 6 monochromatic lines with 99% accuracy. The usefulness of SDDs will continue into the x-ray FEL era of science. Their successors, the ePixS hybrid pixel detectors, already offer hundreds of pixels, each with similar performance to an SDD, in a compact, robust and affordable package
△ Less
Submitted 19 March, 2019; v1 submitted 5 June, 2017;
originally announced June 2017.
-
Ionized Plasma and Neutral Gas Coupling in the Sun's Chromosphere and Earth's Ionosphere/Thermosphere
Authors:
J. E. Leake,
C. R. DeVore,
J. P. Thayer,
A. G. Burns,
G. Crowley,
H. R. Gilbert,
J. D Huba,
J. Krall,
M. G. Linton,
V. S. Lukin,
W. Wang
Abstract:
We review our understanding of ionized plasma and neutral gas coupling in the weakly ionized, stratified, electromagnetically-permeated regions of the Sun's chromosphere and Earth's ionosphere/thermosphere. Using representative models for each environment we derive fundamental descriptions of the coupling of the constituent parts to each other and to the electric and magnetic fields, and we examin…
▽ More
We review our understanding of ionized plasma and neutral gas coupling in the weakly ionized, stratified, electromagnetically-permeated regions of the Sun's chromosphere and Earth's ionosphere/thermosphere. Using representative models for each environment we derive fundamental descriptions of the coupling of the constituent parts to each other and to the electric and magnetic fields, and we examine the variation in magnetization of the ionized component. Using these descriptions we compare related phenomena in the two environments, and discuss electric currents, energy transfer and dissipation. We present a coupled theoretical and numerical study of plasma instabilities in the two environments that serves as an example of how the chromospheric and ionospheric communities can further collaborate. We also suggest future collaborative studies that will help improve our understanding of these two different atmospheres which share many similarities, but have large disparities in key quantities.
△ Less
Submitted 29 August, 2016; v1 submitted 1 October, 2013;
originally announced October 2013.
-
Impact of CIR Storms on Thermosphere Density Variability during the Solar Minimum of 2008
Authors:
Jiuhou Lei,
Jeffrey P. Thayer,
Wenbin Wang,
Robert L. McPherron
Abstract:
The solar minimum of 2008 was exceptionally quiet, with sunspot numbers at their lowest in 75 years. During this unique solar minimum epoch, however, solar wind high - speed streams emanating from near-equatorial coronal holes occurred frequently and were the primary contributor to the recurrent geomagnetic activity at Earth. These conditions enabled the isolation of forcing by geomagnetic activit…
▽ More
The solar minimum of 2008 was exceptionally quiet, with sunspot numbers at their lowest in 75 years. During this unique solar minimum epoch, however, solar wind high - speed streams emanating from near-equatorial coronal holes occurred frequently and were the primary contributor to the recurrent geomagnetic activity at Earth. These conditions enabled the isolation of forcing by geomagnetic activity on the preconditioned solar minimum state of the upper atmosphere caused by Corotating Interaction Regions (CIRs). Thermosphere density observations around 400 km from the CHAMP satellite are used to study the thermosphere density response to solar wind high - speed streams/CIRs. Superposed epoch results show that thermosphere density responds to high - speed streams globally, and the density at 400 km changes by 75% on average. The relative changes of neutral density are comparable at different latitudes, although its variability is largest at high latitudes. In addition, the response of thermosphere density to high - speed streams is larger at night than in daytime, indicating the preconditioning effect of the thermosphere response to storms. Finally, the thermosphere density variations at the periods of 9 and 13.5 days associated with CIRs are linked to the spatial distribution of low - middle latitude coronal holes on the basis of the EUVI observations from the STEREO.
△ Less
Submitted 26 April, 2010;
originally announced April 2010.
