EventLFM: Event Camera integrated Fourier Light Field Microscopy for Ultrafast 3D imaging
Authors:
Ruipeng Guo,
Qianwan Yang,
Andrew S. Chang,
Guorong Hu,
Joseph Greene,
Christopher V. Gabel,
Sixian You,
Lei Tian
Abstract:
Ultrafast 3D imaging is indispensable for visualizing complex and dynamic biological processes. Conventional scanning-based techniques necessitate an inherent trade-off between acquisition speed and space-bandwidth product (SBP). Emerging single-shot 3D wide-field techniques offer a promising alternative but are bottlenecked by the synchronous readout constraints of conventional CMOS systems, thus…
▽ More
Ultrafast 3D imaging is indispensable for visualizing complex and dynamic biological processes. Conventional scanning-based techniques necessitate an inherent trade-off between acquisition speed and space-bandwidth product (SBP). Emerging single-shot 3D wide-field techniques offer a promising alternative but are bottlenecked by the synchronous readout constraints of conventional CMOS systems, thus restricting data throughput to maintain high SBP at limited frame rates. To address this, we introduce EventLFM, a straightforward and cost-effective system that overcomes these challenges by integrating an event camera with Fourier light field microscopy (LFM), a state-of-the-art single-shot 3D wide-field imaging technique. The event camera operates on a novel asynchronous readout architecture, thereby bypassing the frame rate limitations inherent to conventional CMOS systems. We further develop a simple and robust event-driven LFM reconstruction algorithm that can reliably reconstruct 3D dynamics from the unique spatiotemporal measurements captured by EventLFM. Experimental results demonstrate that EventLFM can robustly reconstruct fast-moving and rapidly blinking 3D fluorescent samples at kHz frame rates. Furthermore, we highlight EventLFM's capability for imaging of blinking neuronal signals in scattering mouse brain tissues and 3D tracking of GFP-labeled neurons in freely moving C. elegans. We believe that the combined ultrafast speed and large 3D SBP offered by EventLFM may open up new possibilities across many biomedical applications.
△ Less
Submitted 3 April, 2024; v1 submitted 1 October, 2023;
originally announced October 2023.
Video-rate large-scale imaging with Multi-Z confocal microscopy
Authors:
Amaury Badon,
Seth Bensussen,
Howard J. Gritton,
Mehraj R. Awal,
Christopher V. Gabel,
Xue Han,
Jerome Mertz
Abstract:
Fast, volumetric imaging over large scales has been a long-standing goal in biological microscopy. Scanning techniques such as fluorescence confocal microscopy can acquire 2D images at high resolution and high speed, but extending the acquisition to multiple planes at different depths requires an axial scanning mechanism that drastically reduces the acquisition speed. To address this challenge, we…
▽ More
Fast, volumetric imaging over large scales has been a long-standing goal in biological microscopy. Scanning techniques such as fluorescence confocal microscopy can acquire 2D images at high resolution and high speed, but extending the acquisition to multiple planes at different depths requires an axial scanning mechanism that drastically reduces the acquisition speed. To address this challenge, we report an augmented variant of confocal microscopy where the key innovation consists to use a series of reflecting pinholes axially distributed in the detection plane, each one probing a different depth within the sample. As no axial scanning mechanism is involved, our technique provides simultaneous multiplane imaging over fields of view larger than a millimeter at video-rate. We demonstrate the general applicability of our technique to neuronal imaging of both Caenorhabditis elegans and mouse brains in-vivo.
△ Less
Submitted 16 November, 2018;
originally announced November 2018.
