-
Optimizing Coded-Apertures for Depth-Resolved Diffraction
Authors:
Doğa Gürsoy,
Dina Sheyfer,
Michael Wojcik,
Wenjun Liu,
Jonathan Tischler
Abstract:
Coded apertures, traditionally employed in x-ray astronomy for imaging celestial objects, are now being adapted for micro-scale applications, particularly in studying microscopic specimens with synchrotron light diffraction. In this paper, we focus on micro-coded aperture imaging and its capacity to accomplish depth-resolved micro-diffraction analysis within crystalline specimens. We study apertur…
▽ More
Coded apertures, traditionally employed in x-ray astronomy for imaging celestial objects, are now being adapted for micro-scale applications, particularly in studying microscopic specimens with synchrotron light diffraction. In this paper, we focus on micro-coded aperture imaging and its capacity to accomplish depth-resolved micro-diffraction analysis within crystalline specimens. We study aperture specifications and scanning parameters by assessing characteristics like size, thickness, and patterns. Numerical experiments assist in assessing their impact on reconstruction quality. Empirical data from a Laue diffraction microscope at a synchrotron undulator beamline supports our findings. Overall, our results offer key insights for optimizing aperture design in advancing micro-scale diffraction imaging at synchrotrons. This study contributes insights to this expanding field and suggests significant advancements, especially when coupled with the enhanced flux anticipated from the global upgrades of synchrotron sources.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Dark-Field X-Ray Microscopy with Structured Illumination for Three-Dimensional Imaging
Authors:
Doğa Gürsoy,
Kaan Alp Yay,
Elliot Kisiel,
Michael Wojcik,
Dina Sheyfer,
Matthew Highland,
Ian Randal Fisher,
Stephan Hruszkewycz,
Zahir Islam
Abstract:
We introduce a structured illumination technique for dark-field x-ray microscopy optimized for three-dimensional imaging of ordered materials at sub-micrometer length scales. Our method utilizes a coded aperture to spatially modulate the incident x-ray beam on the sample, enabling the reconstruction of the sample's 3D structure from images captured at various aperture positions. Unlike common volu…
▽ More
We introduce a structured illumination technique for dark-field x-ray microscopy optimized for three-dimensional imaging of ordered materials at sub-micrometer length scales. Our method utilizes a coded aperture to spatially modulate the incident x-ray beam on the sample, enabling the reconstruction of the sample's 3D structure from images captured at various aperture positions. Unlike common volumetric imaging techniques such as tomography, our approach casts a scanning x-ray silhouette of a coded aperture for depth resolution along the axis of diffraction, eliminating any need for sample rotation or rastering, leading to a highly stable imaging modality. This modification provides robustness against geometric uncertainties during data acquisition, particularly for achieving sub-micrometer resolutions where geometric uncertainties typically limit resolution. We introduce the image reconstruction model and validate our results with experimental data on an isolated twin domain within a bulk single crystal of an iron pnictide obtained using a dark-field x-ray microscope. This timely advancement aligns with the enhanced brightness upgrade of the world's synchrotron radiation facilities, opening unprecedented opportunities in imaging.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Digital autofocusing of a coded-aperture Laue diffraction microscope
Authors:
Doga Gursoy,
Dina Sheyfer,
Michael Wojcik,
Wenjun Liu,
Jonathan Tischler
Abstract:
To provide optimal depth resolution with a coded-aperture Laue diffraction microscope, an accurate position of the coded-aperture and its scanning geometry need to be known. However, finding the geometry by trial and error is a time-consuming and often challenging process because of the large number of parameters involved. In this paper, we propose an optimization approach to automate the focusing…
▽ More
To provide optimal depth resolution with a coded-aperture Laue diffraction microscope, an accurate position of the coded-aperture and its scanning geometry need to be known. However, finding the geometry by trial and error is a time-consuming and often challenging process because of the large number of parameters involved. In this paper, we propose an optimization approach to automate the focusing process after data is collected. We demonstrate the robustness and efficiency of the proposed approach with experimental data taken at a synchrotron facility.
△ Less
Submitted 1 February, 2023; v1 submitted 15 August, 2022;
originally announced August 2022.
-
A Deep Generative Approach to Oversampling in Ptychography
Authors:
Semih Barutcu,
Aggelos K. Katsaggelos,
Doğa Gürsoy
Abstract:
Ptychography is a well-studied phase imaging method that makes non-invasive imaging possible at a nanometer scale. It has developed into a mainstream technique with various applications across a range of areas such as material science or the defense industry. One major drawback of ptychography is the long data acquisition time due to the high overlap requirement between adjacent illumination areas…
▽ More
Ptychography is a well-studied phase imaging method that makes non-invasive imaging possible at a nanometer scale. It has developed into a mainstream technique with various applications across a range of areas such as material science or the defense industry. One major drawback of ptychography is the long data acquisition time due to the high overlap requirement between adjacent illumination areas to achieve a reasonable reconstruction. Traditional approaches with reduced overlap between scanning areas result in reconstructions with artifacts. In this paper, we propose complementing sparsely acquired or undersampled data with data sampled from a deep generative network to satisfy the oversampling requirement in ptychography. Because the deep generative network is pre-trained and its output can be computed as we collect data, the experimental data and the time to acquire the data can be reduced. We validate the method by presenting the reconstruction quality compared to the previously proposed and traditional approaches and comment on the strengths and drawbacks of the proposed approach.
△ Less
Submitted 28 July, 2022;
originally announced July 2022.
-
Compressive Ptychography using Deep Image and Generative Priors
Authors:
Semih Barutcu,
Doğa Gürsoy,
Aggelos K. Katsaggelos
Abstract:
Ptychography is a well-established coherent diffraction imaging technique that enables non-invasive imaging of samples at a nanometer scale. It has been extensively used in various areas such as the defense industry or materials science. One major limitation of ptychography is the long data acquisition time due to mechanical scanning of the sample; therefore, approaches to reduce the scan points a…
▽ More
Ptychography is a well-established coherent diffraction imaging technique that enables non-invasive imaging of samples at a nanometer scale. It has been extensively used in various areas such as the defense industry or materials science. One major limitation of ptychography is the long data acquisition time due to mechanical scanning of the sample; therefore, approaches to reduce the scan points are highly desired. However, reconstructions with less number of scan points lead to imaging artifacts and significant distortions, hindering a quantitative evaluation of the results. To address this bottleneck, we propose a generative model combining deep image priors with deep generative priors. The self-training approach optimizes the deep generative neural network to create a solution for a given dataset. We complement our approach with a prior acquired from a previously trained discriminator network to avoid a possible divergence from the desired output caused by the noise in the measurements. We also suggest using the total variation as a complementary before combat artifacts due to measurement noise. We analyze our approach with numerical experiments through different probe overlap percentages and varying noise levels. We also demonstrate improved reconstruction accuracy compared to the state-of-the-art method and discuss the advantages and disadvantages of our approach.
△ Less
Submitted 23 May, 2022; v1 submitted 4 May, 2022;
originally announced May 2022.
-
Depth-resolved Laue microdiffraction with coded-apertures
Authors:
Doga Gursoy,
Dina Sheyfer,
Michael Wojcik,
Wenjun Liu,
Jonathan Z. Tischler
Abstract:
We introduce a rapid data acquisition and reconstruction method to image the crystalline structure of materials and associated strain and orientations at micrometer resolution using Laue diffraction. Our method relies on scanning a coded-aperture across the diffracted x-ray beams from a broadband illumination, and a reconstruction algorithm to resolve Laue microdiffraction patterns as a function o…
▽ More
We introduce a rapid data acquisition and reconstruction method to image the crystalline structure of materials and associated strain and orientations at micrometer resolution using Laue diffraction. Our method relies on scanning a coded-aperture across the diffracted x-ray beams from a broadband illumination, and a reconstruction algorithm to resolve Laue microdiffraction patterns as a function of depth along the incident illumination path. This method provides a rapid access to full diffraction information at sub-micrometer volume elements in bulk materials. Here we present the theory as well as the experimental validation of this imaging approach.
△ Less
Submitted 13 September, 2022; v1 submitted 3 March, 2022;
originally announced March 2022.
-
CodEx: A Modular Framework for Joint Temporal De-blurring and Tomographic Reconstruction
Authors:
Soumendu Majee,
Selin Aslan,
Doga Gursoy,
Charles A. Bouman
Abstract:
In many computed tomography (CT) imaging applications, it is important to rapidly collect data from an object that is moving or changing with time. Tomographic acquisition is generally assumed to be step-and-shoot, where the object is rotated to each desired angle, and a view is taken. However, step-and-shoot acquisition is slow and can waste photons, so in practice fly-scanning is done where the…
▽ More
In many computed tomography (CT) imaging applications, it is important to rapidly collect data from an object that is moving or changing with time. Tomographic acquisition is generally assumed to be step-and-shoot, where the object is rotated to each desired angle, and a view is taken. However, step-and-shoot acquisition is slow and can waste photons, so in practice fly-scanning is done where the object is continuously rotated while collecting data. However, this can result in motion-blurred views and consequently reconstructions with severe motion artifacts.
In this paper, we introduce CodEx, a modular framework for joint de-blurring and tomographic reconstruction that can effectively invert the motion blur introduced in sparse view fly-scanning. The method is a synergistic combination of a novel acquisition method with a novel non-convex Bayesian reconstruction algorithm. CodEx works by encoding the acquisition with a known binary code that the reconstruction algorithm then inverts. Using a well chosen binary code to encode the measurements can improve the accuracy of the inversion process. The CodEx reconstruction method uses the alternating direction method of multipliers (ADMM) to split the inverse problem into iterative deblurring and reconstruction sub-problems, making reconstruction practical to implement. We present reconstruction results on both simulated and binned experimental data to demonstrate the effectiveness of our method.
△ Less
Submitted 30 July, 2022; v1 submitted 11 November, 2021;
originally announced November 2021.
-
Scalable and accurate multi-GPU based image reconstruction of large-scale ptychography data
Authors:
Xiaodong Yu,
Viktor Nikitin,
Daniel J. Ching,
Selin Aslan,
Doga Gursoy,
Tekin Bicer
Abstract:
While the advances in synchrotron light sources, together with the development of focusing optics and detectors, allow nanoscale ptychographic imaging of materials and biological specimens, the corresponding experiments can yield terabyte-scale large volumes of data that can impose a heavy burden on the computing platform. While Graphical Processing Units (GPUs) provide high performance for such l…
▽ More
While the advances in synchrotron light sources, together with the development of focusing optics and detectors, allow nanoscale ptychographic imaging of materials and biological specimens, the corresponding experiments can yield terabyte-scale large volumes of data that can impose a heavy burden on the computing platform. While Graphical Processing Units (GPUs) provide high performance for such large-scale ptychography datasets, a single GPU is typically insufficient for analysis and reconstruction. Several existing works have considered leveraging multiple GPUs to accelerate the ptychographic reconstruction. However, they utilize only Message Passing Interface (MPI) to handle the communications between GPUs. It poses inefficiency for the configuration that has multiple GPUs in a single node, especially while processing a single large projection, since it provides no optimizations to handle the heterogeneous GPU interconnections containing both low-speed links, e.g., PCIe, and high-speed links, e.g., NVLink. In this paper, we provide a multi-GPU implementation that can effectively solve large-scale ptychographic reconstruction problem with optimized performance on intra-node multi-GPU. We focus on the conventional maximum-likelihood reconstruction problem using conjugate-gradient (CG) for the solution and propose a novel hybrid parallelization model to address the performance bottlenecks in CG solver. Accordingly, we develop a tool called PtyGer (Ptychographic GPU(multiple)-based reconstruction), implementing our hybrid parallelization model design. The comprehensive evaluation verifies that PtyGer can fully preserve the original algorithm's accuracy while achieving outstanding intra-node GPU scalability.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
-
Improving reproducibility in synchrotron tomography using implementation-adapted filters
Authors:
Poulami Somanya Ganguly,
Daniël M. Pelt,
Doga Gürsoy,
Francesco de Carlo,
K. Joost Batenburg
Abstract:
For reconstructing large tomographic datasets fast, filtered backprojection-type or Fourier-based algorithms are still the method of choice, as they have been for decades. These robust and computationally efficient algorithms have been integrated in a broad range of software packages. The continuous mathematical formulas used for image reconstruction in such algorithms are unambiguous. However, va…
▽ More
For reconstructing large tomographic datasets fast, filtered backprojection-type or Fourier-based algorithms are still the method of choice, as they have been for decades. These robust and computationally efficient algorithms have been integrated in a broad range of software packages. The continuous mathematical formulas used for image reconstruction in such algorithms are unambiguous. However, variations in discretisation and interpolation result in quantitative differences between reconstructed images, and corresponding segmentations, obtained from different software. This hinders reproducibility of experimental results, making it difficult to ensure that results and conclusions from experiments can be reproduced at different facilities or using different software.
In this paper, we propose a way to reduce such differences by optimising the filter used in analytical algorithms. These filters can be computed using a wrapper routine around a black-box implementation of a reconstruction algorithm, and lead to quantitatively similar reconstructions. We demonstrate use cases for our approach by computing implementation-adapted filters for several open-source implementations and applying it to simulated phantoms and real-world data acquired at the synchrotron. Our contribution to a reproducible reconstruction step forms a building block towards a fully reproducible synchrotron tomography data processing pipeline.
△ Less
Submitted 30 August, 2021; v1 submitted 15 March, 2021;
originally announced March 2021.
-
Joint ptycho-tomography with deep generative priors
Authors:
Selin Aslan,
Zhengchun Liu,
Viktor Nikitin,
Tekin Bicer,
Sven Leyffer,
Doga Gursoy
Abstract:
Joint ptycho-tomography is a powerful computational imaging framework to recover the refractive properties of a 3D object while relaxing the requirements for probe overlap that is common in conventional phase retrieval. We use an augmented Lagrangian scheme for formulating the constrained optimization problem and employ an alternating direction method of multipliers (ADMM) for the joint solution.…
▽ More
Joint ptycho-tomography is a powerful computational imaging framework to recover the refractive properties of a 3D object while relaxing the requirements for probe overlap that is common in conventional phase retrieval. We use an augmented Lagrangian scheme for formulating the constrained optimization problem and employ an alternating direction method of multipliers (ADMM) for the joint solution. ADMM allows the problem to be split into smaller and computationally more efficient subproblems: ptychographic phase retrieval, tomographic reconstruction, and regularization of the solution. We extend our ADMM framework with plug-and-play (PnP) denoisers by replacing the regularization subproblem with a general denoising operator based on machine learning. While the PnP framework enables integrating such learned priors as denoising operators, tuning of the denoiser prior remains challenging. To overcome this challenge, we propose a denoiser parameter to control the effect of the denoiser and to accelerate the solution. In our simulations, we demonstrate that our proposed framework with parameter tuning and learned priors generates high-quality reconstructions under limited and noisy measurement data.
△ Less
Submitted 27 August, 2021; v1 submitted 20 September, 2020;
originally announced September 2020.
-
Distributed optimization for nonrigid nano-tomography
Authors:
Viktor Nikitin,
Vincent De Andrade,
Azat Slyamov,
Benjamin J. Gould,
Yuepeng Zhang,
Vandana Sampathkumar,
Narayanan Kasthuri,
Doga Gursoy,
Francesco De Carlo
Abstract:
Resolution level and reconstruction quality in nano-computed tomography (nano-CT) are in part limited by the stability of microscopes, because the magnitude of mechanical vibrations during scanning becomes comparable to the imaging resolution, and the ability of the samples to resist beam damage during data acquisition. In such cases, there is no incentive in recovering the sample state at differe…
▽ More
Resolution level and reconstruction quality in nano-computed tomography (nano-CT) are in part limited by the stability of microscopes, because the magnitude of mechanical vibrations during scanning becomes comparable to the imaging resolution, and the ability of the samples to resist beam damage during data acquisition. In such cases, there is no incentive in recovering the sample state at different time steps like in time-resolved reconstruction methods, but instead the goal is to retrieve a single reconstruction at the highest possible spatial resolution and without any imaging artifacts. Here we propose a joint solver for imaging samples at the nanoscale with projection alignment, unwar** and regularization. Projection data consistency is regulated by dense optical flow estimated by Farneback's algorithm, leading to sharp sample reconstructions with less artifacts. Synthetic data tests show robustness of the method to Poisson and low-frequency background noise. Applicability of the method is demonstrated on two large-scale nano-imaging experimental data sets.
△ Less
Submitted 28 February, 2021; v1 submitted 11 July, 2020;
originally announced August 2020.
-
Evaluation of modified uniformly redundant arrays as structured illuminations for ptychography
Authors:
Daniel J. Ching,
Selin Aslan,
Viktor Nikitin,
Michael J. Wojcik,
Doga Gursoy
Abstract:
Previous studies have shown that the frequency content of an illumination affects the convergence rate and reconstruction quality of ptychographic reconstructions. In this numerical study, we demonstrate that structuring a large illumination as a modified uniformly redundant array (MURA) can yield higher resolution and faster convergence for ptychography by improving the signal-to-noise ratio of h…
▽ More
Previous studies have shown that the frequency content of an illumination affects the convergence rate and reconstruction quality of ptychographic reconstructions. In this numerical study, we demonstrate that structuring a large illumination as a modified uniformly redundant array (MURA) can yield higher resolution and faster convergence for ptychography by improving the signal-to-noise ratio of high spatial frequencies in the far-field diffraction pattern.
△ Less
Submitted 3 April, 2020;
originally announced April 2020.
-
Fast Tomographic Alignment for Joint Ptychography and Tomography
Authors:
Azat M. Slyamov,
Viktor Nikitin,
Doğa Gürsoy,
Rajmund Mokso,
Jens W. Andreasen
Abstract:
Joint ptychography and tomography (JPT) is a recently developed framework that enables high-resolution reconstruction of 3D volumes with significantly relaxed constraints on probe overlap at adjacent scan positions. In ptychographic X-ray computed tomography (PXCT) experiment scanning translations are controlled with high-precision piezo-stages, while run-out errors of rotational stages are correc…
▽ More
Joint ptychography and tomography (JPT) is a recently developed framework that enables high-resolution reconstruction of 3D volumes with significantly relaxed constraints on probe overlap at adjacent scan positions. In ptychographic X-ray computed tomography (PXCT) experiment scanning translations are controlled with high-precision piezo-stages, while run-out errors of rotational stages are corrected by aligning phase-retrieved projections. However, such projections are by definition not available for JPT and would thus require precise knowledge of the angular positioning of the sample, which is prohibitively limited by hardware precision. Here, we present a method for correcting the misalignment of ptychographic tomography data with respect to the rotation axis without having to retrieve individual phase projections. This will facilitate development and application of JPT in providing fast data-efficient nanotomography experiments.
△ Less
Submitted 18 February, 2020; v1 submitted 31 January, 2020;
originally announced February 2020.
-
Near, far, wherever you are: simulations on the dose efficiency of holographic and ptychographic coherent imaging
Authors:
Ming Du,
Doga Gursoy,
Chris Jacobsen
Abstract:
Different studies in x-ray microscopy have arrived at conflicting conclusions about the dose efficiency of imaging modes involving the recording of intensity distributions in the near (Fresnel regime) or far (Fraunhofer regime) field downstream of a specimen. We present here a numerical study on the dose efficiency of near-field holography (NFH), near-field ptychography (NFP), and far-field ptycho…
▽ More
Different studies in x-ray microscopy have arrived at conflicting conclusions about the dose efficiency of imaging modes involving the recording of intensity distributions in the near (Fresnel regime) or far (Fraunhofer regime) field downstream of a specimen. We present here a numerical study on the dose efficiency of near-field holography (NFH), near-field ptychography (NFP), and far-field ptychography (FFP), where ptychography involves multiple overlap** finite-sized illumination positions. Unlike what has been reported for coherent diffraction imaging (CDI), which involves recording a single far-field diffraction pattern, we find that all three methods offer similar image quality when using the same fluence on the specimen, with far-field ptychography offering slightly better spatial resolution and lower mean error. These results support the concept that (if the experiment and image reconstruction are done properly) the sample can be near, or far; wherever you are, photon fluence on the specimen sets one limit to spatial resolution.
△ Less
Submitted 11 March, 2020; v1 submitted 16 August, 2019;
originally announced August 2019.
-
Three dimensions, two microscopes, one code: automatic differentiation for x-ray nanotomography beyond the depth of focus limit
Authors:
Ming Du,
Youssef S. G. Nashed,
Saugat Kandel,
Doga Gursoy,
Chris Jacobsen
Abstract:
Conventional tomographic reconstruction algorithms assume that one has obtained pure projection images, involving no within-specimen diffraction effects nor multiple scattering. Advances in x-ray nanotomography are leading towards the violation of these assumptions, by combining the high penetration power of x-rays which enables thick specimens to be imaged, with improved spatial resolution which…
▽ More
Conventional tomographic reconstruction algorithms assume that one has obtained pure projection images, involving no within-specimen diffraction effects nor multiple scattering. Advances in x-ray nanotomography are leading towards the violation of these assumptions, by combining the high penetration power of x-rays which enables thick specimens to be imaged, with improved spatial resolution which decreases the depth of focus of the imaging system. We describe a reconstruction method where multiple scattering and diffraction effects in thick samples are modeled by multislice propagation, and the 3D object function is retrieved through iterative optimization. We show that the same proposed method works for both full-field microscopy, and for coherent scanning techniques like ptychography. Our implementation utilizes the optimization toolbox and the automatic differentiation capability of the open-source deep learning package TensorFlow, which demonstrates a much straightforward way to solve optimization problems in computational imaging, and endows our program great flexibility and portability.
△ Less
Submitted 24 May, 2019;
originally announced May 2019.
-
X-ray tomography of extended objects: a comparison of data acquisition approaches
Authors:
Ming Du,
Rafael Vescovi,
Kamel Fezzaa,
Chris Jacobsen,
Doga Gursoy
Abstract:
The penetration power of x-rays allows one to image large objects. For example, centimeter-sized specimens can be imaged with micron-level resolution using synchrotron sources. In this case, however, the limited beam diameter and detector size preclude the acquisition of the full sample in a single take, necessitating strategies for combining data from multiple regions. Object stitching involves t…
▽ More
The penetration power of x-rays allows one to image large objects. For example, centimeter-sized specimens can be imaged with micron-level resolution using synchrotron sources. In this case, however, the limited beam diameter and detector size preclude the acquisition of the full sample in a single take, necessitating strategies for combining data from multiple regions. Object stitching involves the combination of local tomography data from overlap** regions, while projection stitching involves the collection of projections at multiple offset positions from the rotation axis followed by data merging and reconstruction. We compare these two approaches in terms of radiation dose applied to the specimen, and reconstructed image quality. Object stitching involves an easier data alignment problem, and immediate viewing of subregions before the entire dataset has been acquired. Projection stitching is more dose-efficient, and avoids certain artifacts of local tomography; however, it also involves a more difficult data assembly and alignment procedure, in that it is more sensitive to accumulative registration error.
△ Less
Submitted 11 July, 2018; v1 submitted 24 May, 2018;
originally announced May 2018.
-
From sample to knowledge: Towards an integrated approach for neuroscience discovery
Authors:
William Gray Roncal,
Eva L Dyer,
Doga Gürsoy,
Konrad Kording,
Narayanan Kasthuri
Abstract:
Imaging methods used in modern neuroscience experiments are quickly producing large amounts of data capable of providing increasing amounts of knowledge about neuroanatomy and function. A great deal of information in these datasets is relatively unexplored and untapped. One of the bottlenecks in knowledge extraction is that often there is no feedback loop between the knowledge produced (e.g., grap…
▽ More
Imaging methods used in modern neuroscience experiments are quickly producing large amounts of data capable of providing increasing amounts of knowledge about neuroanatomy and function. A great deal of information in these datasets is relatively unexplored and untapped. One of the bottlenecks in knowledge extraction is that often there is no feedback loop between the knowledge produced (e.g., graph, density estimate, or other statistic) and the earlier stages of the pipeline (e.g., acquisition). We thus advocate for the development of sample-to-knowledge discovery pipelines that one can use to optimize acquisition and processing steps with a particular end goal (i.e., piece of knowledge) in mind. We therefore propose that optimization takes place not just within each processing stage but also between adjacent (and non-adjacent) steps of the pipeline. Furthermore, we explore the existing categories of knowledge representation and models to motivate the types of experiments and analysis needed to achieve the ultimate goal. To illustrate this approach, we provide an experimental paradigm to answer questions about large-scale synaptic distributions through a multimodal approach combining X-ray microtomography and electron microscopy.
△ Less
Submitted 23 January, 2017; v1 submitted 11 April, 2016;
originally announced April 2016.
