-
Bayesian multi-exposure image fusion for robust high dynamic range ptychography
Authors:
Shantanu Kodgirwar,
Lars Loetgering,
Chang Liu,
Aleena Joseph,
Leona Licht,
Daniel S. Penagos Molina,
Wilhelm Eschen,
Jan Rothhardt,
Michael Habeck
Abstract:
The limited dynamic range of the detector can impede coherent diffractive imaging (CDI) schemes from achieving diffraction-limited resolution. To overcome this limitation, a straightforward approach is to utilize high dynamic range (HDR) imaging through multi-exposure image fusion (MEF). This method involves capturing measurements at different exposure times, spanning from under to overexposure an…
▽ More
The limited dynamic range of the detector can impede coherent diffractive imaging (CDI) schemes from achieving diffraction-limited resolution. To overcome this limitation, a straightforward approach is to utilize high dynamic range (HDR) imaging through multi-exposure image fusion (MEF). This method involves capturing measurements at different exposure times, spanning from under to overexposure and fusing them into a single HDR image. The conventional MEF technique in ptychography typically involves subtracting the background noise, ignoring the saturated pixels and then merging the acquisitions. However, this approach is inadequate under conditions of low signal-to-noise ratio (SNR). Additionally, variations in illumination intensity significantly affect the phase retrieval process. To address these issues, we propose a Bayesian MEF modeling approach based on a modified Poisson distribution that takes the background and saturation into account. To infer the model parameters, the expectation-maximization (EM) algorithm is employed. As demonstrated with synthetic and experimental data, our approach outperforms the conventional MEF method, offering superior phase retrieval under challenging experimental conditions. This work underscores the significance of robust multi-exposure image fusion for ptychography, particularly in imaging shot-noise-dominated weakly scattering specimens or in cases where access to HDR detectors with high SNR is limited. Furthermore, the applicability of the Bayesian MEF approach extends beyond CDI to any imaging scheme that requires HDR treatment. Given this versatility, we provide the implementation of our algorithm as a Python package.
△ Less
Submitted 10 June, 2024; v1 submitted 17 March, 2024;
originally announced March 2024.
-
Ptycho-endoscopy on a lensless ultrathin fiber bundle tip
Authors:
Pengming Song,
Ruihai Wang,
Lars Loetgering,
Jia Liu,
Peter Vouras,
Yu** Lee,
Shaowei Jiang,
Bin Feng,
Andrew Maiden,
Changhuei Yang,
Guoan Zheng
Abstract:
Synthetic aperture radar (SAR) utilizes an aircraft-carried antenna to emit electromagnetic pulses and detect the returning echoes. As the aircraft travels across a designated area, it synthesizes a large virtual aperture to improve image resolution. Inspired by SAR, we introduce synthetic aperture ptycho-endoscopy (SAPE) for micro-endoscopic imaging beyond the diffraction limit. SAPE operates by…
▽ More
Synthetic aperture radar (SAR) utilizes an aircraft-carried antenna to emit electromagnetic pulses and detect the returning echoes. As the aircraft travels across a designated area, it synthesizes a large virtual aperture to improve image resolution. Inspired by SAR, we introduce synthetic aperture ptycho-endoscopy (SAPE) for micro-endoscopic imaging beyond the diffraction limit. SAPE operates by hand-holding a lensless fiber bundle tip to record coherent diffraction patterns from specimens. The fiber cores at the distal tip modulate the diffracted wavefield within a confined area, emulating the role of the 'airborne antenna' in SAR. The handheld operation introduces positional shifts to the tip, analogous to the aircraft's movement. These shifts facilitate the acquisition of a ptychogram and synthesize a large virtual aperture extending beyond the bundle's physical limit. We mitigate the influences of hand motion and fiber bending through a low-rank spatiotemporal decomposition of the bundle's modulation profile. Our tests demonstrate the ability to resolve a 548-nm linewidth on a resolution target. The achieved space-bandwidth product is ~1.1 million effective pixels, representing a 36-fold increase compared to that of the original fiber bundle. Furthermore, SAPE's refocusing capability enables imaging over an extended depth of field exceeding 2 cm. The aperture synthesizing process in SAPE surpasses the diffraction limit set by the probe's maximum collection angle, opening new opportunities for both fiber-based and distal-chip endoscopy in applications such as medical diagnostics and industrial inspection.
△ Less
Submitted 6 July, 2024; v1 submitted 30 January, 2024;
originally announced January 2024.
-
Broadband ptychography using curved wavefront illumination
Authors:
Daniel S. Penagos Molina,
Lars Loetgering,
Wilhelm Eschen,
Jens Limpert,
Jan Rothhardt
Abstract:
We examine the interplay between spectral bandwidth and illumination curvature in ptychography. By tailoring the divergence of the illumination, broader spectral bandwidths can be tolerated without requiring algorithmic modifications to the forward model. In particular, a strong wavefront curvature transitions a far-field diffreaction geometry to an effectively near-field one, which is lees affect…
▽ More
We examine the interplay between spectral bandwidth and illumination curvature in ptychography. By tailoring the divergence of the illumination, broader spectral bandwidths can be tolerated without requiring algorithmic modifications to the forward model. In particular, a strong wavefront curvature transitions a far-field diffreaction geometry to an effectively near-field one, which is lees affected by temporal coherence effects. The relaxed temporal coherence requirements allow for leveraging wider spectral bandwidths and larger illumination spots. Our findings open up new avenues towards utilizing pink and broadband beams for increased flux and throughput at both synchrotron facilities and lab-scale beamlines.
△ Less
Submitted 15 May, 2023;
originally announced May 2023.
-
PtyLab.m/py/jl: a cross-platform, open-source inverse modeling toolbox for conventional and Fourier ptychography
Authors:
Lars Loetgering,
Mengqi Du,
Dirk Boonzajer Flaes,
Tomas Aidukas,
Felix Wechsler,
Daniel S. Penagos Molina,
Max Rose,
Antonios Pelekanidis,
Wilhelm Eschen,
Jürgen Hess,
Thomas Wilhein,
Rainer Heintzmann,
Jan Rothhardt,
Stefan Witte
Abstract:
Conventional (CP) and Fourier (FP) ptychography have emerged as versatile quantitative phase imaging techniques. While the main application cases for each technique are different, namely lens-less short wavelength imaging for CP and lens-based visible light imaging for FP, both methods share a common algorithmic ground. CP and FP have in part independently evolved to include experimentally robust…
▽ More
Conventional (CP) and Fourier (FP) ptychography have emerged as versatile quantitative phase imaging techniques. While the main application cases for each technique are different, namely lens-less short wavelength imaging for CP and lens-based visible light imaging for FP, both methods share a common algorithmic ground. CP and FP have in part independently evolved to include experimentally robust forward models and inversion techniques. This separation has resulted in a plethora of algorithmic extensions, some of which have not crossed the boundary from one modality to the other. Here, we present an open source, cross-platform software, called PtyLab, enabling both CP and FP data analysis in a unified framework. With this framework, we aim to facilitate and accelerate cross-pollination between the two techniques. Moreover, the availability in Matlab, Python, and Julia will set a low barrier to enter each field.
△ Less
Submitted 16 January, 2023;
originally announced January 2023.
-
Visualizing the ultra-structure of microorganisms using table-top extreme ultraviolet imaging
Authors:
Chang Liu,
Wilhelm Eschen,
Lars Loetgering,
Daniel S. Molina,
Robert Klas,
Alexander Iliou,
Michael Steinert,
Sebastian Herkersdorf,
Alexander Kirsche,
Thomas Pertsch,
Falk Hillmann,
Jens Limpert,
Jan Rothhardt
Abstract:
Table-top extreme ultraviolet (EUV) microscopy offers unique opportunities for label-free investigation of biological samples. Here, we demonstrate ptychographic EUV imaging of two dried, unstained model specimens: germlings of a fungus (Aspergillus nidulans), and bacteria (Escherichia coli) cells at 13.5 nm wavelength. We find that the EUV spectral region, which to date has not received much atte…
▽ More
Table-top extreme ultraviolet (EUV) microscopy offers unique opportunities for label-free investigation of biological samples. Here, we demonstrate ptychographic EUV imaging of two dried, unstained model specimens: germlings of a fungus (Aspergillus nidulans), and bacteria (Escherichia coli) cells at 13.5 nm wavelength. We find that the EUV spectral region, which to date has not received much attention for biological imaging, offers sufficient penetration depths for the identification of intracellular features. By implementing a position-correlated ptychography approach, we demonstrate a millimeter-squared field of view enabled by infrared illumination combined with sub-60 nm spatial resolution achieved with EUV illumination on selected regions of interest. The strong element contrast at 13.5 nm wavelength enables the identification of the nanoscale material composition inside the specimens. Our work will advance and facilitate EUV imaging applications and enable further possibilities in life science.
△ Less
Submitted 8 November, 2022;
originally announced November 2022.
-
Mode purity and structural analysis of x-ray vortices generated by spiral zone plates
Authors:
M. Baluktsian,
L. Loetgering,
G. Dogan,
U. Sanli,
M. Weigand,
M. Rose,
I. Bykova,
G. Schuetz,
K. Keskinbora
Abstract:
In the visible spectrum vortex beams have found various applications, ranging from optical tweezers to super-resolution imaging. Recently, these beams have been demonstrated using X-rays and electron beams. However, so far, no in-depth discussion has been carried out on the vortex quality, which could become essential for a variety of vortex applications. Here, we investigate the mode conversion e…
▽ More
In the visible spectrum vortex beams have found various applications, ranging from optical tweezers to super-resolution imaging. Recently, these beams have been demonstrated using X-rays and electron beams. However, so far, no in-depth discussion has been carried out on the vortex quality, which could become essential for a variety of vortex applications. Here, we investigate the mode conversion efficiency (MCE), vortex structure and stability (in terms of vortex splitting) of the vortex fields generated by spiral zone plates (SZP). We have designed and fabricated SZPs with varying topological charge of both binary and kinoform profile. Kinoforms are known for their 100 % diffraction efficiency in the ideal case. In this work, both types are contrasted with regard to the vortex quality. Utilizing ptychographic coherent diffraction imaging and by comparing to simulations the wavefront of the generated fields is characterized. It was found, that the MCE and vortex structure exhibit the same dependencies on material and ZP properties as the diffraction efficiency (DE) and that the kinoform profile in this sense also improves the vortex quality. With growing SZP charge the MCE decreases. The results link the parameters of optics to the properties of the vortices and help to maximize the performance of ZP based vortex generators for future applications.
△ Less
Submitted 9 September, 2022; v1 submitted 5 August, 2022;
originally announced August 2022.
-
Material-specific high-resolution table-top extreme ultraviolet microscopy
Authors:
Wilhelm Eschen,
Lars Loetgering,
Vittoria Schuster,
Robert Klas,
Alexander Kirsche,
Lutz Berthold,
Michael Steinert,
Thomas Pertsch,
Herbert Gross,
Michael Krause,
Jens Limpert,
Jan Rothhardt
Abstract:
Microscopy with extreme ultraviolet (EUV) radiation holds promise for high-resolution imaging with excellent material contrast, due to the short wavelength and numerous element-specific absorption edges available in this spectral range. At the same time, EUV radiation has significantly larger penetration depths than electrons. It thus enables a nano-scale view into complex three-dimensional struct…
▽ More
Microscopy with extreme ultraviolet (EUV) radiation holds promise for high-resolution imaging with excellent material contrast, due to the short wavelength and numerous element-specific absorption edges available in this spectral range. At the same time, EUV radiation has significantly larger penetration depths than electrons. It thus enables a nano-scale view into complex three-dimensional structures that are important for material science, semiconductor metrology, and next-generation nano-devices. Here, we present high-resolution and material-specific microscopy at 13.5 nm wavelength. We combine a highly stable, high photon-flux, table-top EUV source with an interferometrically stabilized ptychography setup. By utilizing structured EUV illumination, we overcome the limitations of conventional EUV focusing optics and demonstrate high-resolution microscopy at a half-pitch lateral resolution of 16 nm. Moreover, we propose mixed-state orthogonal probe relaxation ptychography, enabling robust phase-contrast imaging over wide fields of view and long acquisition times. In this way, the complex transmission of an integrated circuit is precisely reconstructed, allowing for the classification of the material composition of mesoscopic semiconductor systems.
△ Less
Submitted 24 December, 2021;
originally announced December 2021.
-
Addressing phase-curvature in Fourier ptychography
Authors:
Tomas Aidukas,
Lars Loetgering,
Andrew Robert Harvey
Abstract:
In Fourier ptychography, multiple low resolution images are captured and subsequently combined computationally into a high-resolution, large-field of view micrograph. A theoretical image-formation model based on the assumption of plane-wave illumination from various directions is commonly used, to stitch together the captured information into a high synthetic aperture. The underlying far-field (Fr…
▽ More
In Fourier ptychography, multiple low resolution images are captured and subsequently combined computationally into a high-resolution, large-field of view micrograph. A theoretical image-formation model based on the assumption of plane-wave illumination from various directions is commonly used, to stitch together the captured information into a high synthetic aperture. The underlying far-field (Fraunhofer) diffraction assumption connects the source, sample, and pupil planes by Fourier transforms. While computationally simple, this assumption neglects phase-curvature due to non-planar illumination from point sources as well as phase-curvature from finite-conjugate microscopes (e.g., using a single-lens for image-formation). We describe a simple, efficient, and accurate extension of Fourier ptychography by embedding the effect of phase-curvature into the underlying forward model. With the improved forward model proposed here, quantitative phase reconstruction is possible even for wide fields-of-views and without the need of image segmentation. Lastly, the proposed method is computationally efficient, requiring only two multiplications: prior and following the reconstruction.
△ Less
Submitted 15 March, 2022; v1 submitted 11 November, 2021;
originally announced November 2021.
-
Spatial coherence control and analysis via micromirror-based mixed-state ptychography
Authors:
Ruslan Röhrich,
Femius Koenderink,
Stefan Witte,
Lars Loetgering
Abstract:
Flexible and fast control of the phase and amplitude of coherent light, enabled by digital micromirror devices (DMDs) and spatial light modulators (SLMs), has been a driving force for recent advances in optical tweezers, nonlinear microscopy, and wavefront sha**. In contrast, engineering spatially partially coherent light remains widely elusive due to the lack of tools enabling a joint analysis…
▽ More
Flexible and fast control of the phase and amplitude of coherent light, enabled by digital micromirror devices (DMDs) and spatial light modulators (SLMs), has been a driving force for recent advances in optical tweezers, nonlinear microscopy, and wavefront sha**. In contrast, engineering spatially partially coherent light remains widely elusive due to the lack of tools enabling a joint analysis and control sequence. Here, we report an approach to coherence engineering that combines a quasi-monochromatic, thermal source and a DMD together with a ptychographic scanning microscope. The reported method opens up new routes to low-cost coherence control, with applications in micromanipulation, nanophotonics, and quantitative phase contrast imaging.
△ Less
Submitted 19 January, 2021;
originally announced January 2021.
-
Efficient and flexible approach to ptychography using an optimization framework based on automatic differentiation
Authors:
Jacob Seifert,
Dorian Bouchet,
Lars Loetgering,
Allard P. Mosk
Abstract:
Ptychography is a lensless imaging method that allows for wavefront sensing and phase-sensitive microscopy from a set of diffraction patterns. Recently, it has been shown that the optimization task in ptychography can be achieved via automatic differentiation (AD). Here, we propose an open-access AD-based framework implemented with TensorFlow, a popular machine learning library. Using simulations,…
▽ More
Ptychography is a lensless imaging method that allows for wavefront sensing and phase-sensitive microscopy from a set of diffraction patterns. Recently, it has been shown that the optimization task in ptychography can be achieved via automatic differentiation (AD). Here, we propose an open-access AD-based framework implemented with TensorFlow, a popular machine learning library. Using simulations, we show that our AD-based framework performs comparably to a state-of-the-art implementation of the momentum-accelerated ptychographic iterative engine (mPIE) in terms of reconstruction speed and quality. AD-based approaches provide great flexibility, as we demonstrate by setting the reconstruction distance as a trainable parameter. Lastly, we experimentally demonstrate that our framework faithfully reconstructs a biological specimen.
△ Less
Submitted 12 January, 2021; v1 submitted 5 October, 2020;
originally announced October 2020.
-
Thin Film Substrates from the Raman spectroscopy point of view
Authors:
L. Gasparov,
T. Jegorel,
L. Loetgering,
S. Middey,
J. Chakhalian
Abstract:
We have investigated ten standard single crystal substrates of complex oxides on the account of their applicability in the Raman spectroscopy based thin film research. In this study we suggest a spectra normalization procedure that utilizes a comparison of the substrate Raman spectra to those of well-established Raman reference materials. We demonstrate that MgO, LaGaO3, (LaAlO3)_0.3(Sr2AlTaO6)_0.…
▽ More
We have investigated ten standard single crystal substrates of complex oxides on the account of their applicability in the Raman spectroscopy based thin film research. In this study we suggest a spectra normalization procedure that utilizes a comparison of the substrate Raman spectra to those of well-established Raman reference materials. We demonstrate that MgO, LaGaO3, (LaAlO3)_0.3(Sr2AlTaO6)_0.7 (LSAT), DyScO3, YAlO3, and LaAlO3 can be of potential use for a Raman based thin film research. At the same time TiO2 (rutile), NdGaO3, SrLaAlO4, and SrTiO3 single crystals exhibit multiple phonon modes accompanied by strong Raman background that substantially hinder the Raman based thin film experiments.
△ Less
Submitted 29 October, 2013;
originally announced October 2013.