-
Self-Supervised Deep Learning for Model Correction in the Computational Crystallography Toolbox
Authors:
Vidya Ganapati,
Daniel Tchon,
Aaron S. Brewster,
Nicholas K. Sauter
Abstract:
The Computational Crystallography Toolbox (CCTBX) is open-source software that allows for processing of crystallographic data, including from serial femtosecond crystallography (SFX), for macromolecular structure determination. We aim to use the modules in CCTBX to determine the oxidation state of individual metal atoms in a macromolecule. Changes in oxidation state are reflected in small shifts o…
▽ More
The Computational Crystallography Toolbox (CCTBX) is open-source software that allows for processing of crystallographic data, including from serial femtosecond crystallography (SFX), for macromolecular structure determination. We aim to use the modules in CCTBX to determine the oxidation state of individual metal atoms in a macromolecule. Changes in oxidation state are reflected in small shifts of the atom's X-ray absorption edge. These energy shifts can be extracted from the diffraction images recorded in serial femtosecond crystallography, given knowledge of a forward physics model. However, as the diffraction changes only slightly due to the absorption edge shift, inaccuracies in the forward physics model make it extremely challenging to observe the oxidation state. In this work, we describe the potential impact of using self-supervised deep learning to correct the scientific model in CCTBX and provide uncertainty quantification. We provide code for forward model simulation and data analysis, built from CCTBX modules, at https://github.com/gigantocypris/SPREAD , which can be integrated with machine learning. We describe open questions in algorithm development to help spur advances through dialog between crystallographers and machine learning researchers. New methods could help elucidate charge transfer processes in many reactions, including key events in photosynthesis.
△ Less
Submitted 4 July, 2023;
originally announced July 2023.
-
A Self-Supervised Approach to Reconstruction in Sparse X-Ray Computed Tomography
Authors:
Rey Mendoza,
Minh Nguyen,
Judith Weng Zhu,
Vincent Dumont,
Talita Perciano,
Juliane Mueller,
Vidya Ganapati
Abstract:
Computed tomography has propelled scientific advances in fields from biology to materials science. This technology allows for the elucidation of 3-dimensional internal structure by the attenuation of x-rays through an object at different rotations relative to the beam. By imaging 2-dimensional projections, a 3-dimensional object can be reconstructed through a computational algorithm. Imaging at a…
▽ More
Computed tomography has propelled scientific advances in fields from biology to materials science. This technology allows for the elucidation of 3-dimensional internal structure by the attenuation of x-rays through an object at different rotations relative to the beam. By imaging 2-dimensional projections, a 3-dimensional object can be reconstructed through a computational algorithm. Imaging at a greater number of rotation angles allows for improved reconstruction. However, taking more measurements increases the x-ray dose and may cause sample damage. Deep neural networks have been used to transform sparse 2-D projection measurements to a 3-D reconstruction by training on a dataset of known similar objects. However, obtaining high-quality object reconstructions for the training dataset requires high x-ray dose measurements that can destroy or alter the specimen before imaging is complete. This becomes a chicken-and-egg problem: high-quality reconstructions cannot be generated without deep learning, and the deep neural network cannot be learned without the reconstructions. This work develops and validates a self-supervised probabilistic deep learning technique, the physics-informed variational autoencoder, to solve this problem. A dataset consisting solely of sparse projection measurements from each object is used to jointly reconstruct all objects of the set. This approach has the potential to allow visualization of fragile samples with x-ray computed tomography. We release our code for reproducing our results at: https://github.com/vganapati/CT_PVAE .
△ Less
Submitted 29 October, 2022;
originally announced November 2022.
-
Data-Driven Computational Imaging for Scientific Discovery
Authors:
Andrew Olsen,
Yolanda Hu,
Vidya Ganapati
Abstract:
In computational imaging, hardware for signal sampling and software for object reconstruction are designed in tandem for improved capability. Examples of such systems include computed tomography (CT), magnetic resonance imaging (MRI), and superresolution microscopy. In contrast to more traditional cameras, in these devices, indirect measurements are taken and computational algorithms are used for…
▽ More
In computational imaging, hardware for signal sampling and software for object reconstruction are designed in tandem for improved capability. Examples of such systems include computed tomography (CT), magnetic resonance imaging (MRI), and superresolution microscopy. In contrast to more traditional cameras, in these devices, indirect measurements are taken and computational algorithms are used for reconstruction. This allows for advanced capabilities such as super-resolution or 3-dimensional imaging, pushing forward the frontier of scientific discovery. However, these techniques generally require a large number of measurements, causing low throughput, motion artifacts, and/or radiation damage, limiting applications. Data-driven approaches to reducing the number of measurements needed have been proposed, but they predominately require a ground truth or reference dataset, which may be impossible to collect. This work outlines a self-supervised approach and explores the future work that is necessary to make such a technique usable for real applications. Light-emitting diode (LED) array microscopy, a modality that allows visualization of transparent objects in two and three dimensions with high resolution and field-of-view, is used as an illustrative example. We release our code at https://github.com/vganapati/LED_PVAE and our experimental data at https://doi.org/10.6084/m9.figshare.21232088 .
△ Less
Submitted 29 October, 2022;
originally announced October 2022.
-
Deep Learned Optical Multiplexing for Multi-Focal Plane Microscopy
Authors:
Yi Fei Cheng,
Ziad Sabry,
Megan Strachan,
Skyler Cornell,
Jake Chanenson,
Eva-Maria S. Collins,
Vidya Ganapati
Abstract:
To obtain microscope images at multiple focal planes, the distance between the objective and sample can be mechanically adjusted. Images are acquired sequentially at each axial distance. Digital refocusing with a light-emitting diode (LED) array microscope allows elimination of this mechanical movement. In an LED array microscope, the light source of a conventional widefield microscope is replaced…
▽ More
To obtain microscope images at multiple focal planes, the distance between the objective and sample can be mechanically adjusted. Images are acquired sequentially at each axial distance. Digital refocusing with a light-emitting diode (LED) array microscope allows elimination of this mechanical movement. In an LED array microscope, the light source of a conventional widefield microscope is replaced with a 2-dimensional LED matrix. A stack of images is acquired from the LED array microscope by sequentially illuminating each LED and capturing an image. Previous work has shown that we can achieve digital refocusing by post-processing this LED image stack. Though mechanical scanning is eliminated, digital refocusing with an LED array microscope has low temporal resolution due to the acquisition of multiple images. In this work, we propose a new paradigm for multi-focal plane microscopy for live imaging, utilizing an LED array microscope and deep learning. In our deep learning approach, we look for a single LED illumination pattern that allows the information from multiple focal planes to be multiplexed into a single image. We jointly optimize this LED illumination pattern with the parameters of a post-processing deep neural network, using a training set of LED image stacks from fixed, not live, Dugesia japonica planarians. Once training is complete, we obtain multiple focal planes by inputting a single multiplexed LED image into the trained post-processing deep neural network. We demonstrate live imaging of a D. japonica planarian at 5 focal planes with our method.
△ Less
Submitted 2 July, 2019;
originally announced July 2019.
-
Ultra-Efficient Thermophotovoltaics Exploiting Spectral Filtering by the Photovoltaic Band-Edge
Authors:
Vidya Ganapati,
T. Patrick Xiao,
Eli Yablonovitch
Abstract:
Thermophotovotaics convert thermal radiation from local heat sources to electricity. A new breakthrough in creating highly efficient thin-film solar cells can potentially enable thermophotovoltaic systems with unprecedented high efficiency. The current 28.8% single-junction solar efficiency record, by Alta Devices, was achieved by recognizing that a good solar cell needs to reflect infrared band-e…
▽ More
Thermophotovotaics convert thermal radiation from local heat sources to electricity. A new breakthrough in creating highly efficient thin-film solar cells can potentially enable thermophotovoltaic systems with unprecedented high efficiency. The current 28.8% single-junction solar efficiency record, by Alta Devices, was achieved by recognizing that a good solar cell needs to reflect infrared band-edge radiation at the back surface, to effectively recycle infrared luminescent photons. The effort to reflect band-edge luminescence in solar cells has serendipitously created the technology to reflect all infrared wavelengths, which can revolutionize thermophotovoltaics. We have never before had such high back reflectivity for sub-bandgap radiation, permitting step-function spectral control for the first time. Thus, contemporary efficiency advances in solar photovoltaic cells create the possibility of realizing a $>50\%$ efficient thermophotovoltaic system.
△ Less
Submitted 7 February, 2018; v1 submitted 10 November, 2016;
originally announced November 2016.
-
Intermediate Mirrors to Reach Theoretical Efficiency Limits of Multi-Bandgap Solar Cells
Authors:
Vidya Ganapati,
Chi-Sing Ho,
Eli Yablonovitch
Abstract:
Creating a single bandgap solar cell that approaches the Shockley-Queisser limit requires a highly reflective rear mirror. This mirror enhances the voltage of the solar cell by providing photons with multiple opportunities for esca** out the front surface. Efficient external luminescence is a pre-requisite for high voltage. Intermediate mirrors in a multijunction solar cell can enhance the volta…
▽ More
Creating a single bandgap solar cell that approaches the Shockley-Queisser limit requires a highly reflective rear mirror. This mirror enhances the voltage of the solar cell by providing photons with multiple opportunities for esca** out the front surface. Efficient external luminescence is a pre-requisite for high voltage. Intermediate mirrors in a multijunction solar cell can enhance the voltage for each cell in the stack. These intermediate mirrors need to have the added function of transmitting the below bandgap photons to the next cell in the stack. In this work, we quantitatively establish the efficiency increase possible with the use of intermediate selective reflectors between cells in a tandem stack. The absolute efficiency increase can be up to ~6% in dual bandgap cells with optimal intermediate and rear mirrors. A practical implementation of an intermediate selective mirror is an air gap sandwiched by antireflection coatings. The air gap provides perfect reflection for angles outside the escape cone, and the antireflection coating transmits angles inside the escape cone. As the incoming sunlight is within the escape cone, it is transmitted on to the next cell, while most of the internally trapped luminescence is reflected.
△ Less
Submitted 12 June, 2014;
originally announced June 2014.
-
Light Trap** Textures Designed by Electromagnetic Optimization for Sub-Wavelength Thick Solar Cells
Authors:
Vidya Ganapati,
Owen D. Miller,
Eli Yablonovitch
Abstract:
Light trap** in solar cells allows for increased current and voltage, as well as reduced materials cost. It is known that in geometrical optics, a maximum 4n^2 absorption enhancement factor can be achieved by randomly texturing the surface of the solar cell, where n is the material refractive index. This ray-optics absorption enhancement limit only holds when the thickness of the solar cell is m…
▽ More
Light trap** in solar cells allows for increased current and voltage, as well as reduced materials cost. It is known that in geometrical optics, a maximum 4n^2 absorption enhancement factor can be achieved by randomly texturing the surface of the solar cell, where n is the material refractive index. This ray-optics absorption enhancement limit only holds when the thickness of the solar cell is much greater than the optical wavelength. In sub-wavelength thin films, the fundamental questions remain unanswered: (1) what is the sub-wavelength absorption enhancement limit and (2) what surface texture realizes this optimal absorption enhancement? We turn to computational electromagnetic optimization in order to design nanoscale textures for light trap** in sub-wavelength thin films. For high-index thin films, in the weakly absorbing limit, our optimized surface textures yield an angle- and frequency-averaged enhancement factor ~39. They perform roughly 30% better than randomly textured structures, but they fall short of the ray optics enhancement limit of 4n^2 ~ 50.
△ Less
Submitted 20 July, 2013;
originally announced July 2013.
