Showing 1–13 of 13 results for author: Heintzmann, R

Structured illumination microscopy with extreme ultraviolet pulses

Authors: R. Mincigrucci, E. Paltanin, J. -S. Pelli-Cresi, F. Gala, E. Pontecorvo, L. Foglia, D. De Angelis, D. Fainozzi, A. Gessini, D. S. P. Molina, O. Stranik, F. Wechsler, R. Heintzmann, G. Ruocco, F. Bencivenga, C. Masciovecchio

Abstract: The relentless pursuit of understanding matter at ever-finer scales has pushed optical microscopy to surpass the diffraction limit and produced the super-resolution microscopy which enables visualizing structures shorter than the wavelength of light. In the present work, we harnessed extreme ultraviolet beams to create a sub-μm grating structure, which was revealed by extreme ultraviolet structure… ▽ More The relentless pursuit of understanding matter at ever-finer scales has pushed optical microscopy to surpass the diffraction limit and produced the super-resolution microscopy which enables visualizing structures shorter than the wavelength of light. In the present work, we harnessed extreme ultraviolet beams to create a sub-μm grating structure, which was revealed by extreme ultraviolet structured illumination microscopy. This achievement marks the first step toward extending such a super-resolution technique into the X-ray regime, where achieving atomic-scale resolution becomes a charming possibility. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Calculating Point Spread Functions: Methods, Pitfalls and Solutions

Authors: Ratsimandresy Holinirina Dina Miora, Erich Rohwer, Martin Kielhorn, Colin J. R. Sheppard, Gurthwin Bosman, R. Heintzmann

Abstract: The knowledge of the exact structure of the optical system PSF enables a high-quality image reconstruction in fluorescence microscopy. Accurate PSF models account for the vector nature of light and the phase and amplitude modifications. Most existing real-space-based PSF models fall into a sampling pitfall near the centre position, yielding to the violation of the energy conservation. In this work… ▽ More The knowledge of the exact structure of the optical system PSF enables a high-quality image reconstruction in fluorescence microscopy. Accurate PSF models account for the vector nature of light and the phase and amplitude modifications. Most existing real-space-based PSF models fall into a sampling pitfall near the centre position, yielding to the violation of the energy conservation. In this work, we present novel, to the best of our knowledge, Fourier-based techniques for computing vector PSF and compare them to the state-of-the-art. Our methods are shown to satisfy the physical condition of the imaging process. They are reproducible, computationally efficient, and easy to implement and easy to modify to represent various imaging modalities. △ Less

Submitted 10 March, 2024; v1 submitted 31 January, 2023; originally announced January 2023.

PtyLab.m/py/jl: a cross-platform, open-source inverse modeling toolbox for conventional and Fourier ptychography

Authors: Lars Loetgering, Mengqi Du, Dirk Boonzajer Flaes, Tomas Aidukas, Felix Wechsler, Daniel S. Penagos Molina, Max Rose, Antonios Pelekanidis, Wilhelm Eschen, Jürgen Hess, Thomas Wilhein, Rainer Heintzmann, Jan Rothhardt, Stefan Witte

Abstract: Conventional (CP) and Fourier (FP) ptychography have emerged as versatile quantitative phase imaging techniques. While the main application cases for each technique are different, namely lens-less short wavelength imaging for CP and lens-based visible light imaging for FP, both methods share a common algorithmic ground. CP and FP have in part independently evolved to include experimentally robust… ▽ More Conventional (CP) and Fourier (FP) ptychography have emerged as versatile quantitative phase imaging techniques. While the main application cases for each technique are different, namely lens-less short wavelength imaging for CP and lens-based visible light imaging for FP, both methods share a common algorithmic ground. CP and FP have in part independently evolved to include experimentally robust forward models and inversion techniques. This separation has resulted in a plethora of algorithmic extensions, some of which have not crossed the boundary from one modality to the other. Here, we present an open source, cross-platform software, called PtyLab, enabling both CP and FP data analysis in a unified framework. With this framework, we aim to facilitate and accelerate cross-pollination between the two techniques. Moreover, the availability in Matlab, Python, and Julia will set a low barrier to enter each field. △ Less

Submitted 16 January, 2023; originally announced January 2023.

Quality Control of Image Sensors using Gaseous Tritium Light Sources

Authors: David McFadden, Brad Amos, Rainer Heintzmann

Abstract: We propose a practical method for radiometrically calibrating cameras using widely available gaseous tritium light sources (betalights). Along with the gain(conversion factor) and read noise level, the predictable photon flux of the source allows us to gauge the quantum effciency. The design is easily reproducible with a 3D printer and three inexpensive parts. Suitable for common image sensors, we… ▽ More We propose a practical method for radiometrically calibrating cameras using widely available gaseous tritium light sources (betalights). Along with the gain(conversion factor) and read noise level, the predictable photon flux of the source allows us to gauge the quantum effciency. The design is easily reproducible with a 3D printer and three inexpensive parts. Suitable for common image sensors, we believe that the method has the potential to be a useful tool in microscopy facilities and optical labs alike. △ Less

Submitted 23 June, 2022; originally announced June 2022.

Comments: 17 pages, 6 figures, 2 tables. Supplementary material is available at https://doi.org/10.6084/m9.figshare.c.5768142 . 3D files for the printed parts of the calibration source, as well as assembly instructions, are available at: https://github.com/mcfaddendavid/betalight-calibration

Journal ref: Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 380, 20210130 (2022)

Super-resolution structured illumination microscopy: past, present and future

Authors: Kirti Prakash, Benedict Diederich, Stefanie Reichelt, Rainer Heintzmann, Lothar Schermelleh

Abstract: Structured illumination microscopy (SIM) has emerged as an essential technique for 3D and live-cell super-resolution imaging. However, to date, there has not been a dedicated workshop or journal issue covering the various aspects of SIM, from bespoke hardware and software development and the use of commercial instruments to biological applications. This special issue aims to recap recent developme… ▽ More Structured illumination microscopy (SIM) has emerged as an essential technique for 3D and live-cell super-resolution imaging. However, to date, there has not been a dedicated workshop or journal issue covering the various aspects of SIM, from bespoke hardware and software development and the use of commercial instruments to biological applications. This special issue aims to recap recent developments as well as outline future trends. In addition to SIM, we cover related topics such as complementary super-resolution microscopy techniques, computational imaging, visualisation and image processing methods. △ Less

Submitted 26 February, 2021; originally announced February 2021.

Chiral Structured Illumination Microscopy

Authors: Shiang-Yu Huang, Jiwei Zhang, Christian Karras, Ronny Förster, Rainer Heintzmann, Jer-Shing Huang

Abstract: We propose a chiral imaging modality based on optical chirality engineering, fluorescence-detected circular dichroism and structured illumination microscopy. In this method, the optical chirality of the illumination is structured and the circular dichroism dependent fluorescence is detected. With image reconstruction, the spatial distribution of chiral domains can be obtained at sub-diffraction li… ▽ More We propose a chiral imaging modality based on optical chirality engineering, fluorescence-detected circular dichroism and structured illumination microscopy. In this method, the optical chirality of the illumination is structured and the circular dichroism dependent fluorescence is detected. With image reconstruction, the spatial distribution of chiral domains can be obtained at sub-diffraction limited resolution. We theoretically demonstrate this method and discuss the feasibility using an optical chirality engineering approach based on far-field optics. △ Less

Submitted 25 August, 2019; originally announced August 2019.

Comments: 5 pages, 3 Figures

Better than a lens -- Increasing the signal-to-noise ratio through pupil splitting

Authors: Jan Becker, Takahiro Deguchi, Alexander Jügler, Ronny Förster, Uwe Hübner, Jonas Ries, Rainer Heintzmann

Abstract: Lenses are designed to fulfill Fermats principle such that all light interferes constructively in its focus, guaranteeing its maximum concentration. It can be shown that imaging via an unmodified full pupil yields the maximum transfer strength for all spatial frequencies transferable by the system. Seemingly also the signal-to-noise ratio (SNR) is optimal. The achievable SNR at a given photon budg… ▽ More Lenses are designed to fulfill Fermats principle such that all light interferes constructively in its focus, guaranteeing its maximum concentration. It can be shown that imaging via an unmodified full pupil yields the maximum transfer strength for all spatial frequencies transferable by the system. Seemingly also the signal-to-noise ratio (SNR) is optimal. The achievable SNR at a given photon budget is critical especially if that budget is strictly limited as in the case of fluorescence microscopy. In this work we propose a general method which achieves a better SNR for high spatial frequency information of an optical imaging system, without the need to capture more photons. This is achieved by splitting the pupil of an incoherent imaging system such that two (or more) sub-images are simultaneously acquired and computationally recombined. We compare the theoretical performance of split pupil imaging to the non-split scenario and implement the splitting using a tilted elliptical mirror placed at the back-focal-plane (BFP) of a fluorescence widefield microscope. △ Less

Submitted 5 September, 2022; v1 submitted 20 November, 2018; originally announced November 2018.

cellSTORM - Cost-effective Super-Resolution on a Cellphone using dSTORM

Authors: Benedict Diederich, Patrick Then, Alexander Jügler, Ronny Förster, Rainer Heintzmann

Abstract: Expensive scientific camera hardware is amongst the main cost factors in modern, high-performance microscopes. Recent technological advantages have, however, yielded consumer-grade camera devices that can provide surprisingly good performance. The camera sensors of smartphones in particular have benefited of this development. Combined with computing power and due to their ubiquity, smartphones pro… ▽ More Expensive scientific camera hardware is amongst the main cost factors in modern, high-performance microscopes. Recent technological advantages have, however, yielded consumer-grade camera devices that can provide surprisingly good performance. The camera sensors of smartphones in particular have benefited of this development. Combined with computing power and due to their ubiquity, smartphones provide a fantastic opportunity for "imaging on a budget". Here we show that a consumer cellphone is capable even of optical super-resolution imaging by (direct) Stochastic Optical Reconstruction Microscopy (dSTORM), achieving optical resolution better than 80 nm. In addition to the use of standard reconstruction algorithms, we investigated an approach by a trained image-to-image generative adversarial network (GAN). This not only serves as a versatile technique to reconstruct video sequences under conditions where traditional algorithms provide sub-optimal localization performance, but also allows processing directly on the smartphone. We believe that "cellSTORM" paves the way for affordable super-resolution microscopy suitable for research and education, expanding access to cutting edge research to a large community. △ Less

Submitted 22 August, 2018; v1 submitted 16 April, 2018; originally announced April 2018.

Using Machine-Learning to Optimize phase contrast in a Low-Cost Cellphone Microscope

Authors: Benedict Diederich, Rolf Wartmann, Harald Schadwinkel, Rainer Heintzmann

Abstract: Cellphones equipped with high-quality cameras and powerful CPUs as well as GPUs are widespread. This opens new prospects to use such existing computational and imaging resources to perform medical diagnosis in develo** countries at a very low cost. Many relevant samples, like biological cells or waterborn parasites, are almost fully transparent. As they do not exhibit absorption, but alter the… ▽ More Cellphones equipped with high-quality cameras and powerful CPUs as well as GPUs are widespread. This opens new prospects to use such existing computational and imaging resources to perform medical diagnosis in develo** countries at a very low cost. Many relevant samples, like biological cells or waterborn parasites, are almost fully transparent. As they do not exhibit absorption, but alter the light's phase only, they are almost invisible in brightfield microscopy. Expensive equipment and procedures for microscopic contrasting or sample staining often are not available. By applying machine-learning techniques, such as a convolutional neural network (CNN), it is possible to learn a relationship between samples to be examined and its optimal light source shapes, in order to increase e.g. phase contrast, from a given dataset to enable real-time applications. For the experimental setup, we developed a 3D-printed smartphone microscope for less than 100 \$ using off-the-shelf components only such as a low-cost video projector. The fully automated system assures true Koehler illumination with an LCD as the condenser aperture and a reversed smartphone lens as the microscope objective. We show that the effect of a varied light source shape, using the pre-trained CNN, does not only improve the phase contrast, but also the impression of an improvement in optical resolution without adding any special optics, as demonstrated by measurements. △ Less

Submitted 19 December, 2017; originally announced December 2017.

The 2015 super-resolution microscopy roadmap

Authors: Stefan Hell, Steffen Sahl, Mark Bates, Xiaowei Zhuang, Rainer Heintzmann, Martin J Booth, Joerg Bewersdorf, Gleb Shtengel, Harald Hess, Philipp Tinnefeld, Alf Honigmann, Stefan Jakobs, Ilaria Testa, Laurent Cognet, Brahim Lounis, Helge Ewers, Simon J Davis, Christian Eggeling, David Klenerman, Katrin Willig, Giuseppe Vicidomini, Marco Castello, Alberto Diaspro, Thorben Cordes, Steffen J Sahl , et al. (3 additional authors not shown)

Abstract: Far-field optical microscopy using focused light is an important tool in a number of scientific disciplines including chemical, (bio)physical and biomedical research, particularly with respect to the study of living cells and organisms. Unfortunately, the applicability of the optical microscope is limited, since the diffraction of light imposes limitations on the spatial resolution of the image. C… ▽ More Far-field optical microscopy using focused light is an important tool in a number of scientific disciplines including chemical, (bio)physical and biomedical research, particularly with respect to the study of living cells and organisms. Unfortunately, the applicability of the optical microscope is limited, since the diffraction of light imposes limitations on the spatial resolution of the image. Consequently the details of, for example, cellular protein distributions, can be visualized only to a certain extent. Fortunately, recent years have witnessed the development of 'super-resolution' far-field optical microscopy (nanoscopy) techniques such as stimulated emission depletion (STED), ground state depletion (GSD), reversible saturated optical (fluorescence) transitions (RESOLFT), photoactivation localization microscopy (PALM), stochastic optical reconstruction microscopy (STORM), structured illumination microscopy (SIM) or saturated structured illumination microscopy (SSIM), all in one way or another addressing the problem of the limited spatial resolution of far-field optical microscopy. While SIM achieves a two-fold improvement in spatial resolution compared to conventional optical microscopy, STED, RESOLFT, PALM/STORM, or SSIM have all gone beyond, pushing the limits of optical image resolution to the nanometer scale. Consequently, all super-resolution techniques open new avenues of biomedical research. Because the field is so young, the potential capabilities of different super-resolution microscopy approaches have yet to be fully explored, and uncertainties remain when considering the best choice of methodology. Thus, even for experts, the road to the future is sometimes shrouded in mist. The super-resolution optical microscopy roadmap of Journal of Physics D: Applied Physics addresses this need for clarity. It provides guidance to the outstanding questions through a collection of short review articles from experts in the field, giving a thorough discussion on the concepts underlying super-resolution optical microscopy, the potential of different approaches, the importance of label optimization (such as reversible photoswitchable proteins) and applications in which these methods will have a significant impact. △ Less

Submitted 14 November, 2017; originally announced November 2017.

Journal ref: Journal of Physics D: Applied Physics, IOP Publishing, 2015, 48 (44), pp.443001

Calibrating photon counts from a single image

Authors: Rainer Heintzmann, Peter K. Relich, Robert P. J. Nieuwenhuizen, Keith A. Lidke, Bernd Rieger

Abstract: Current methods for detector gain calibration require acquisition of tens of special calibration images. Here we propose a method that obtains the gain from the actual image for which the photon count is desired by quantifying out-of-band information. We show on simulation and experimental data that our much simpler procedure, which can be retroactively applied to any image, is comparable in preci… ▽ More Current methods for detector gain calibration require acquisition of tens of special calibration images. Here we propose a method that obtains the gain from the actual image for which the photon count is desired by quantifying out-of-band information. We show on simulation and experimental data that our much simpler procedure, which can be retroactively applied to any image, is comparable in precision to traditional gain calibration procedures. △ Less

Submitted 13 March, 2018; v1 submitted 17 November, 2016; originally announced November 2016.

Simple structured illumination microscope setup with high acquisition speed by using a spatial light modulator

Authors: Ronny Förster, Hui-Wen Lu-Walther, Aurélie Jost, Martin Kielhorn, Kai Wicker, Rainer Heintzmann

Abstract: We describe a two-beam interference structured illumination fluorescence microscope. The novelty of the presented system lies in its simplicity. A programmable electro-optical spatial light modulator in an intermediate image plane enables precise and rapid control of the excitation pattern in the specimen. The contrast of the projected light pattern is strongly influenced by the polarization state… ▽ More We describe a two-beam interference structured illumination fluorescence microscope. The novelty of the presented system lies in its simplicity. A programmable electro-optical spatial light modulator in an intermediate image plane enables precise and rapid control of the excitation pattern in the specimen. The contrast of the projected light pattern is strongly influenced by the polarization state of the light entering the high NA objective. To achieve high contrast, we use a segmented polarizer. Furthermore, a mask with six holes blocks unwanted components in the spatial frequency spectrum of the illumination grating. Both these passive components serve their purpose in a simpler and almost as efficient way as active components. We demonstrate a lateral resolution of 114.2 +- 9.5 nm at a frame rate of 7.6 fps per reconstructed 2D slice. △ Less

Submitted 12 June, 2014; v1 submitted 6 June, 2014; originally announced June 2014.

Optical Photon Reassignment Microscopy (OPRA)

Authors: Stephan Roth, Colin J. R. Sheppard, Kai Wicker, Rainer Heintzmann

Abstract: To enhance the resolution of a confocal laser scanning microscope the additional information of a pinhole plane image taken at every excitation scan position can be used [C. J. R. Sheppard, Super-resolution in confocal imaging, Optik 80, 5354 (1988)]. This photon reassignment principle is based on the fact that the most probable position of an emitter is at half way between the nominal focus of th… ▽ More To enhance the resolution of a confocal laser scanning microscope the additional information of a pinhole plane image taken at every excitation scan position can be used [C. J. R. Sheppard, Super-resolution in confocal imaging, Optik 80, 5354 (1988)]. This photon reassignment principle is based on the fact that the most probable position of an emitter is at half way between the nominal focus of the excitation laser and the position corresponding to the (off centre) detection position. Therefore, by reassigning the detected photons to this place, an image with enhanced detection efficiency and resolution is obtained. Here we present optical photon reassignment microscopy (OPRA) which realises this concept in an all-optical way obviating the need for image-processing. With the help of an additional intermediate optical beam expansion between descanning and a further rescanning of the detected light, an image with the advantages of photon reassignment can be acquired. Due to its simplicity and flexibility this method has the potential to enhance the performance of nearly every laser scanning microscope and is therefore expected to play an important role in future systems. △ Less

Submitted 26 June, 2013; originally announced June 2013.

Comments: 8 pages, 3 figures