Showing 1–18 of 18 results for author: Cossairt, O

3D Imaging of Complex Specular Surfaces by Fusing Polarimetric and Deflectometric Information

Authors: Jiazhang Wang, Oliver Cossairt, Florian Willomitzer

Abstract: Accurate and fast 3D imaging of specular surfaces still poses major challenges for state-of-the-art optical measurement principles. Frequently used methods, such as phase-measuring deflectometry (PMD) or shape-from-polarization (SfP), rely on strong assumptions about the measured objects, limiting their generalizability in broader application areas like medical imaging, industrial inspection, virt… ▽ More Accurate and fast 3D imaging of specular surfaces still poses major challenges for state-of-the-art optical measurement principles. Frequently used methods, such as phase-measuring deflectometry (PMD) or shape-from-polarization (SfP), rely on strong assumptions about the measured objects, limiting their generalizability in broader application areas like medical imaging, industrial inspection, virtual reality, or cultural heritage analysis. In this paper, we introduce a measurement principle that utilizes a novel technique to effectively encode and decode the information contained in a light field reflected off a specular surface. We combine polarization cues from SfP with geometric information obtained from PMD to resolve all arising ambiguities in the 3D measurement. Moreover, our approach removes the unrealistic orthographic imaging assumption for SfP, which significantly improves the respective results. We showcase our new technique by demonstrating single-shot and multi-shot measurements on complex-shaped specular surfaces, displaying an evaluated accuracy of surface normals below $0.6^\circ$. △ Less

Submitted 4 June, 2024; originally announced June 2024.

Multisource Holography

Authors: Grace Kuo, Florian Schiffers, Douglas Lanman, Oliver Cossairt, Nathan Matsuda

Abstract: Holographic displays promise several benefits including high quality 3D imagery, accurate accommodation cues, and compact form-factors. However, holography relies on coherent illumination which can create undesirable speckle noise in the final image. Although smooth phase holograms can be speckle-free, their non-uniform eyebox makes them impractical, and speckle mitigation with partially coherent… ▽ More Holographic displays promise several benefits including high quality 3D imagery, accurate accommodation cues, and compact form-factors. However, holography relies on coherent illumination which can create undesirable speckle noise in the final image. Although smooth phase holograms can be speckle-free, their non-uniform eyebox makes them impractical, and speckle mitigation with partially coherent sources also reduces resolution. Averaging sequential frames for speckle reduction requires high speed modulators and consumes temporal bandwidth that may be needed elsewhere in the system. In this work, we propose multisource holography, a novel architecture that uses an array of sources to suppress speckle in a single frame without sacrificing resolution. By using two spatial light modulators, arranged sequentially, each source in the array can be controlled almost independently to create a version of the target content with different speckle. Speckle is then suppressed when the contributions from the multiple sources are averaged at the image plane. We introduce an algorithm to calculate multisource holograms, analyze the design space, and demonstrate up to a 10 dB increase in peak signal-to-noise ratio compared to an equivalent single source system. Finally, we validate the concept with a benchtop experimental prototype by producing both 2D images and focal stacks with natural defocus cues. △ Less

Submitted 19 September, 2023; originally announced September 2023.

Comments: 14 pages, 9 figures, to be published in SIGGRAPH Asia 2023

Accurate Eye Tracking from Dense 3D Surface Reconstructions using Single-Shot Deflectometry

Authors: Jiazhang Wang, Tianfu Wang, Bingjie Xu, Oliver Cossairt, Florian Willomitzer

Abstract: Eye-tracking plays a crucial role in the development of virtual reality devices, neuroscience research, and psychology. Despite its significance in numerous applications, achieving an accurate, robust, and fast eye-tracking solution remains a considerable challenge for current state-of-the-art methods. While existing reflection-based techniques (e.g., "glint tracking") are considered the most accu… ▽ More Eye-tracking plays a crucial role in the development of virtual reality devices, neuroscience research, and psychology. Despite its significance in numerous applications, achieving an accurate, robust, and fast eye-tracking solution remains a considerable challenge for current state-of-the-art methods. While existing reflection-based techniques (e.g., "glint tracking") are considered the most accurate, their performance is limited by their reliance on sparse 3D surface data acquired solely from the cornea surface. In this paper, we rethink the way how specular reflections can be used for eye tracking: We propose a novel method for accurate and fast evaluation of the gaze direction that exploits teachings from single-shot phase-measuring-deflectometry (PMD). In contrast to state-of-the-art reflection-based methods, our method acquires dense 3D surface information of both cornea and sclera within only one single camera frame (single-shot). Improvements in acquired reflection surface points("glints") of factors $>3300 \times$ are easily achievable. We show the feasibility of our approach with experimentally evaluated gaze errors of only $\leq 0.25^\circ$ demonstrating a significant improvement over the current state-of-the-art. △ Less

Submitted 15 August, 2023; v1 submitted 14 August, 2023; originally announced August 2023.

Stochastic Light Field Holography

Authors: Florian Schiffers, Praneeth Chakravarthula, Nathan Matsuda, Grace Kuo, Ethan Tseng, Douglas Lanman, Felix Heide, Oliver Cossairt

Abstract: The Visual Turing Test is the ultimate goal to evaluate the realism of holographic displays. Previous studies have focused on addressing challenges such as limited étendue and image quality over a large focal volume, but they have not investigated the effect of pupil sampling on the viewing experience in full 3D holograms. In this work, we tackle this problem with a novel hologram generation algor… ▽ More The Visual Turing Test is the ultimate goal to evaluate the realism of holographic displays. Previous studies have focused on addressing challenges such as limited étendue and image quality over a large focal volume, but they have not investigated the effect of pupil sampling on the viewing experience in full 3D holograms. In this work, we tackle this problem with a novel hologram generation algorithm motivated by matching the projection operators of incoherent Light Field and coherent Wigner Function light transport. To this end, we supervise hologram computation using synthesized photographs, which are rendered on-the-fly using Light Field refocusing from stochastically sampled pupil states during optimization. The proposed method produces holograms with correct parallax and focus cues, which are important for passing the Visual Turing Test. We validate that our approach compares favorably to state-of-the-art CGH algorithms that use Light Field and Focal Stack supervision. Our experiments demonstrate that our algorithm significantly improves the realism of the viewing experience for a variety of different pupil states. △ Less

Submitted 12 July, 2023; originally announced July 2023.

Simultaneous Color Computer Generated Holography

Authors: Eric Markley, Nathan Matsuda, Florian Schiffers, Oliver Cossairt, Grace Kuo

Abstract: Computer generated holography has long been touted as the future of augmented and virtual reality (AR/VR) displays, but has yet to be realized in practice. Previous high-quality, color holographic displays have made either a 3$\times$ sacrifice on frame rate by using a sequential color illumination scheme or used more than one spatial light modulator (SLM) and/or bulky, complex optical setups. The… ▽ More Computer generated holography has long been touted as the future of augmented and virtual reality (AR/VR) displays, but has yet to be realized in practice. Previous high-quality, color holographic displays have made either a 3$\times$ sacrifice on frame rate by using a sequential color illumination scheme or used more than one spatial light modulator (SLM) and/or bulky, complex optical setups. The reduced frame rate of sequential color introduces distracting judder and color fringing in the presence of head motion while the form factor of current simultaneous color systems is incompatible with a head-mounted display. In this work, we propose a framework for simultaneous color holography that allows the use of the full SLM frame rate while maintaining a compact and simple optical setup. Simultaneous color holograms are optimized through the use of a perceptual loss function, a physics-based neural network wavefront propagator, and a camera-calibrated forward model. We measurably improve hologram quality compared to other simultaneous color methods and move one step closer to the realization of color holographic displays for AR/VR. △ Less

Submitted 9 December, 2023; v1 submitted 20 March, 2023; originally announced March 2023.

Characterizing the Immaterial. Noninvasive Imaging and Analysis of Stephen Benton's Hologram Engine no. 9

Authors: Marc Walton, Pengxiao Hao, Marc Vermeulen, Florian Willomitzer, Oliver Cossairt

Abstract: Invented in 1962, holography is a unique merging of art and technology. It persisted at the scientific cutting edge through the 1990s, when digital imaging emerged and supplanted film. Today, holography is experiencing new interest as analog holograms enter major museum collections as bona fide works of art. In this essay, we articulate our initial steps at Northwestern's Center for Scientific Stu… ▽ More Invented in 1962, holography is a unique merging of art and technology. It persisted at the scientific cutting edge through the 1990s, when digital imaging emerged and supplanted film. Today, holography is experiencing new interest as analog holograms enter major museum collections as bona fide works of art. In this essay, we articulate our initial steps at Northwestern's Center for Scientific Studies in the Arts to describe the technological challenges on the conservation of holograms, emphasizing their nature as an active material. A holographic image requires user interaction to be viewed, and the materials are delicate and prone to deterioration. Specifically, we outline our methods for creating digital preservation copies of holographic artworks by documenting the wavefront of propagating light. In so doing, we demonstrate why it remains challenging to faithfully capture their high spatial resolution, the full parallax, and deep depths of field without terabytes of data. In addition, we use noninvasive analytical techniques such as spectral imaging, X-ray fluorescence, and optical coherence tomography, to provide insights on hologram material properties. Through these studies we hope to address current concerns about the long term preservation of holograms while translating this artform into a digital format to entice new audiences. △ Less

Submitted 12 October, 2021; originally announced October 2021.

Disassemblable Fieldwork CT Scanner Using a 3D-printed Calibration Phantom

Authors: Florian Schiffers, Thomas Bochynek, Andre Aichert, Tobias Würfl, Michael Rubenstein, Oliver Cossairt

Abstract: The use of computed tomography (CT) imaging has become of increasing interest to academic areas outside of the field of medical imaging and industrial inspection, e.g., to biology and cultural heritage research. The pecularities of these fields, however, sometimes require that objects need to be imaged on-site, e.g., in field-work conditions or in museum collections. Under these circumstances, it… ▽ More The use of computed tomography (CT) imaging has become of increasing interest to academic areas outside of the field of medical imaging and industrial inspection, e.g., to biology and cultural heritage research. The pecularities of these fields, however, sometimes require that objects need to be imaged on-site, e.g., in field-work conditions or in museum collections. Under these circumstances, it is often not possible to use a commercial device and a custom solution is the only viable option. In order to achieve high image quality under adverse conditions, reliable calibration and trajectory reproduction are usually key requirements for any custom CT scanning system. Here, we introduce the construction of a low-cost disassemblable CT scanner that allows calibration even when trajectory reproduction is not possible due to the limitations imposed by the project conditions. Using 3D-printed in-image calibration phantoms, we compute a projection matrix directly from each captured X-ray projection. We describe our method in detail and show successful tomographic reconstructions of several specimen as proof of concept. △ Less

Submitted 12 November, 2020; originally announced November 2020.

Comments: This paper was originally published at the 6th International Conference on Image Formation in X-Ray Computed Tomography (CTmeeting 2020)

Journal ref: CT Meeting 2020

Exploiting wavelength diversity for high resolution time-of-flight 3D imaging

Authors: Fengqiang Li, Florian Willomitzer, Prasanna Rangarajan, Oliver Cossairt

Abstract: State-of-the-art time-of-flight (ToF) based 3D sensors suffer from poor lateral and depth resolutions. In this work, we introduce a novel sensor concept that provides ToF-based 3D measurements of real world objects with depth precisions up to 35 micrometers and point cloud densities at the native sensor-resolutions of state-of-the-art CMOS/CCD cameras (up to several megapixels). Unlike other conti… ▽ More State-of-the-art time-of-flight (ToF) based 3D sensors suffer from poor lateral and depth resolutions. In this work, we introduce a novel sensor concept that provides ToF-based 3D measurements of real world objects with depth precisions up to 35 micrometers and point cloud densities at the native sensor-resolutions of state-of-the-art CMOS/CCD cameras (up to several megapixels). Unlike other continuous-wave amplitude-modulated ToF principles, our approach exploits wavelength diversity for an interferometric surface measurement of macroscopic objects with rough or specular surfaces. Based on this principle, we introduce three different embodiments of prototype sensors, exploiting three different sensor architectures. △ Less

Submitted 13 October, 2020; originally announced October 2020.

Comments: The first two authors contribute equally

Intensity interferometry-based 3D imaging

Authors: Fabian Wagner, Florian Schiffers, Florian Willomitzer, Oliver Cossairt, Andreas Velten

Abstract: The development of single-photon counting detectors and arrays has made tremendous steps in recent years, not the least because of various new applications in, e.g., LIDAR devices. In this work, a 3D imaging device based on real thermal light intensity interferometry is presented. By using gated SPAD technology, a basic 3D scene is imaged in reasonable measurement time. Compared to conventional ap… ▽ More The development of single-photon counting detectors and arrays has made tremendous steps in recent years, not the least because of various new applications in, e.g., LIDAR devices. In this work, a 3D imaging device based on real thermal light intensity interferometry is presented. By using gated SPAD technology, a basic 3D scene is imaged in reasonable measurement time. Compared to conventional approaches, the proposed synchronized photon counting allows using more light modes to enhance 3D ranging performance. Advantages like robustness to atmospheric scattering or autonomy by exploiting external light sources can make this ranging approach interesting for future applications. △ Less

Submitted 8 October, 2020; originally announced October 2020.

Journal ref: Opt.Express 29 (2021) 4733-4745

Improved Spectral Imaging Microscopy for Cultural Heritage through Oblique Illumination

Authors: Lindsay Oakley, Stephanie Zaleski, Billie Males, Ollie Cossairt, Marc Walton

Abstract: This work presents the development of a flexible microscopic chemical imaging platform for cultural heritage that utilizes wavelength-tunable oblique illumination from a point source to obtain per-pixel reflectance spectra in the VIS-NIR range. The microscope light source can be adjusted on two axes allowing for a hemisphere of possible illumination directions. The synthesis of multiple illuminati… ▽ More This work presents the development of a flexible microscopic chemical imaging platform for cultural heritage that utilizes wavelength-tunable oblique illumination from a point source to obtain per-pixel reflectance spectra in the VIS-NIR range. The microscope light source can be adjusted on two axes allowing for a hemisphere of possible illumination directions. The synthesis of multiple illumination angles allows for the calculation of surface normal vectors, similar to phase gradients, and axial optical sectioning. The extraction of spectral reflectance images with high spatial resolutions from these data is demonstrated through the analysis of a replica cross-section, created from known painting reference materials, as well as a sample extracted from a painting by Pablo Picasso entitled La Miséreuse accroupie (1902). These case studies show the rich microscale molecular information that may be obtained using this microscope and how the instrument overcomes challenges for spectral analysis commonly encountered on works of art with complex matrices composed of both inorganic minerals and organic lakes. △ Less

Submitted 1 January, 2020; originally announced January 2020.

Synthetic Wavelength Holography: An Extension of Gabor's Holographic Principle to Imaging with Scattered Wavefronts

Authors: Florian Willomitzer, Prasanna V. Rangarajan, Fengqiang Li, Muralidhar M. Balaji, Marc P. Christensen, Oliver Cossairt

Abstract: The presence of a scattering medium in the imaging path between an object and an observer is known to severely limit the visual acuity of the imaging system. We present an approach to circumvent the deleterious effects of scattering, by exploiting spectral correlations in scattered wavefronts. Our method draws inspiration from Gabor's attempts to improve the resolving power of electron microscopes… ▽ More The presence of a scattering medium in the imaging path between an object and an observer is known to severely limit the visual acuity of the imaging system. We present an approach to circumvent the deleterious effects of scattering, by exploiting spectral correlations in scattered wavefronts. Our method draws inspiration from Gabor's attempts to improve the resolving power of electron microscopes by recording aberrated wavefronts at electron wavelengths, followed by aberration correction and playback at optical wavelengths. We extend the notion to scattered wavefronts, by interpreting the scattering of light as a source of randomized aberration. We compensate for these aberrations by mixing speckle fields recorded at two closely spaced optical wavelengths, and replaying the computationally assembled wavefront at a 'Synthetic Wavelength'. An attractive feature of our method is that it accommodates a wide variety of scattering mechanisms and operates at the physical limits of imaging in the presence of scatter. Moreover, our findings are applicable to other wave phenomena, opening up new avenues for imaging with scattered wavefronts. △ Less

Submitted 23 November, 2020; v1 submitted 24 December, 2019; originally announced December 2019.

Comments: This version (V3) is identical to version V2 (uploaded Sat, 29 Feb 2020 00:21:33 UTC). The only difference to V2 is that the main manuscript and supplementary material can now be downloaded as two separate files

Computational multifocal microscopy

Authors: Kuan He, Zihao Wang, Xiang Huang, Xiaolei Wang, Seunghwan Yoo, Pablo Ruiz, Itay Gdor, Alan Selewa, Nicola J. Ferrier, Norbert Scherer, Mark Hereld, Aggelos K. Katsaggelos, Oliver Cossairt

Abstract: Despite recent advances, high performance single-shot 3D microscopy remains an elusive task. By introducing designed diffractive optical elements (DOEs), one is capable of converting a microscope into a 3D "kaleidoscope", in which case the snapshot image consists of an array of tiles and each tile focuses on different depths. However, the acquired multifocal microscopic (MFM) image suffers from mu… ▽ More Despite recent advances, high performance single-shot 3D microscopy remains an elusive task. By introducing designed diffractive optical elements (DOEs), one is capable of converting a microscope into a 3D "kaleidoscope", in which case the snapshot image consists of an array of tiles and each tile focuses on different depths. However, the acquired multifocal microscopic (MFM) image suffers from multiple sources of degradation, which prevents MFM from further applications. We propose a unifying computational framework which simplifies the imaging system and achieves 3D reconstruction via computation. Our optical configuration omits chromatic correction grating and redesigns the multifocal grating to enlarge the tracking area. Our proposed setup features only one single grating in addition to a regular microscope. The aberration correction, along with Poisson and background denoising, are incorporated in our deconvolution-based fully-automated algorithm, which requires no empirical parameter-tuning. In experiments, we achieve the spatial resolutions of $0.35$um (lateral) and $0.5$um (axial), which are comparable to the resolution that can be achieved with confocal deconvolution microscopy. We demonstrate a 3D video of moving bacteria recorded at $25$ frames per second using our proposed computational multifocal microscopy technique. △ Less

Submitted 4 September, 2018; originally announced September 2018.

Comments: first appearance on Arxiv, submitted to OSA BOE

Stretchcam: Zooming Using Thin, Elastic Optics

Authors: Daniel C. Sims, Oliver Cossairt, Yonghao Yu, Shree K. Nayar

Abstract: Stretchcam is a thin camera with a lens capable of zooming with small actuations. In our design, an elastic lens array is placed on top of a sparse, rigid array of pixels. This lens array is then stretched using a small mechanical motion in order to change the field of view of the system. We present in this paper the characterization of such a system and simulations which demonstrate the capabilit… ▽ More Stretchcam is a thin camera with a lens capable of zooming with small actuations. In our design, an elastic lens array is placed on top of a sparse, rigid array of pixels. This lens array is then stretched using a small mechanical motion in order to change the field of view of the system. We present in this paper the characterization of such a system and simulations which demonstrate the capabilities of stretchcam. We follow this with the presentation of images captured from a prototype device of the proposed design. Our prototype system is able to achieve 1.5 times zoom when the scene is only 300 mm away with only a 3% change of the lens array's original length. △ Less

Submitted 19 April, 2018; originally announced April 2018.

Comments: 12 pages, 8 figures

3D Snapshot Microscopy of Extended Objects

Authors: Xiang Huang, Alan Selewa, Xiaolei Wang, Matthew K. Daddysman, Itay Gdor, Rosemarie Wilton, Kenneth M. Kemner, Seunghwan Yoo, Aggelos K. Katsaggelos, Kuan He, Oliver Cossairt, Nicola J. Ferrier, Mark Hereld, Norbert F. Scherer

Abstract: Volumetric biological imaging often involves compromising high temporal resolution at the expense of high spatial resolution when popular scanning methods are used to capture 3D information. We introduce an integrated experimental and image reconstruction method for capturing dynamic 3D fluorescent extended objects as a series of synchronously measured 3D snapshots taken at the frame rate of the i… ▽ More Volumetric biological imaging often involves compromising high temporal resolution at the expense of high spatial resolution when popular scanning methods are used to capture 3D information. We introduce an integrated experimental and image reconstruction method for capturing dynamic 3D fluorescent extended objects as a series of synchronously measured 3D snapshots taken at the frame rate of the imaging camera. We employ multifocal microscopy (MFM) to simultaneously image at 25 focal planes and process this depth-encoded image to recover the 3D structure of extended objects, such as bacteria, using a sparsity-based reconstruction approach. The combined experimental and computational method produces image quality similar to confocal microscopy in a fraction of the acquisition time. In addition, our computational image reconstruction approach allows a simplified MFM optical design by correcting aberrations using the measured response to point sources. This "compressive" MFM acquisition and reconstruction method, where an image volume with roughly 8 million voxels is recovered from a single 1-megapixel captured image, enables straightforward study of dynamic processes in 3D, and as a simultaneous snapshot advances the state of the art in dynamic 3D microscopy. △ Less

Submitted 22 May, 2018; v1 submitted 5 February, 2018; originally announced February 2018.

Comments: 14 pages, 7 figures, 1 movie, for submission to Scientific Reports; added author and updated contributions

Photometric Stereo by UV-Induced Fluorescence to Detect Protrusions on Georgia O'Keeffe's Paintings

Authors: Johanna Salvant, Marc Walton, Dale Kronkright, Chia-Kai Yeh, Fengqiang Li, Oliver Cossairt, Aggelos K. Katsaggelos

Abstract: A significant number of oil paintings produced by Georgia O'Keeffe (1887-1986) show surface protrusions of varying width, up to several hundreds of microns. These protrusions are similar to those described in the art conservation literature as metallic soaps. Since the presence of these protrusions raises questions about the state of conservation and long-term prospects for deterioration of these… ▽ More A significant number of oil paintings produced by Georgia O'Keeffe (1887-1986) show surface protrusions of varying width, up to several hundreds of microns. These protrusions are similar to those described in the art conservation literature as metallic soaps. Since the presence of these protrusions raises questions about the state of conservation and long-term prospects for deterioration of these artworks, a 3D-imaging technique, photometric stereo using ultraviolet illumination, was developed for the long-term monitoring of the surface-shape of the protrusions and the surrounding paint. Because the UV fluorescence response of painting materials is isotropic, errors typically caused by non-Lambertian (anisotropic) specularities when using visible reflected light can be avoided providing a more accurate estimation of shape. As an added benefit, fluorescence provides additional contrast information contributing to materials characterization. The developed methodology aims to detect, characterize, and quantify the distribution of micro-protrusions and their development over the surface of entire artworks. Combined with a set of analytical in-situ techniques, and computational tools, this approach constitutes a novel methodology to investigate the selective distribution of protrusions in correlation with the composition of painting materials at the macro-scale. While focused on O'Keeffe's paintings as a case study, we expect the proposed approach to have broader significance by providing a non-invasive protocol to the conservation community to probe topological changes for any relatively flat painted surface of an artwork, and more specifically to monitor the dynamic formation of protrusions, in relation to paint composition and modifications of environmental conditions, loans, exhibitions and storage over the long-term. △ Less

Submitted 21 November, 2017; originally announced November 2017.

Comments: Accepted for publication in the Springer Nature book: Metal Soaps in Art-Conservation & Research

Subsampled Phase Retrieval for On-chip Lensless Holographic Video

Authors: Donghun Ryu, Zihao Wang, Kuan He, Roarke Horstmeyer, Oliver Cossairt

Abstract: On-chip holographic video is a convenient way to monitor biological samples simultaneously at high spatial resolution and over a wide field-of-view. However, due to the limited readout rate of digital detector arrays, one often faces a tradeoff between the per-frame pixel count and frame rate of the captured video. In this report, we propose a subsampled phase retrieval (SPR) algorithm to overcome… ▽ More On-chip holographic video is a convenient way to monitor biological samples simultaneously at high spatial resolution and over a wide field-of-view. However, due to the limited readout rate of digital detector arrays, one often faces a tradeoff between the per-frame pixel count and frame rate of the captured video. In this report, we propose a subsampled phase retrieval (SPR) algorithm to overcome the spatial-temporal trade-off in holographic video. Compared to traditional phase retrieval approaches, our SPR algorithm uses over an order of magnitude less pixel measurements while maintaining suitable reconstruction quality. We use an on-chip holographic video setup with pixel sub-sampling to experimentally demonstrate a factor of 5.5 increase in sensor frame rate while monitoring the in vivo movement of Peranema microorganisms. △ Less

Submitted 7 December, 2016; originally announced December 2016.

Compressive Holographic Video

Authors: Zihao Wang, Leonidas Spinoulas, Kuan He, Huai** Chen, Lei Tian, Aggelos K. Katsaggelos, Oliver Cossairt

Abstract: Compressed sensing has been discussed separately in spatial and temporal domains. Compressive holography has been introduced as a method that allows 3D tomographic reconstruction at different depths from a single 2D image. Coded exposure is a temporal compressed sensing method for high speed video acquisition. In this work, we combine compressive holography and coded exposure techniques and extend… ▽ More Compressed sensing has been discussed separately in spatial and temporal domains. Compressive holography has been introduced as a method that allows 3D tomographic reconstruction at different depths from a single 2D image. Coded exposure is a temporal compressed sensing method for high speed video acquisition. In this work, we combine compressive holography and coded exposure techniques and extend the discussion to 4D reconstruction in space and time from one coded captured image. In our prototype, digital in-line holography was used for imaging macroscopic, fast moving objects. The pixel-wise temporal modulation was implemented by a digital micromirror device. In this paper we demonstrate $10\times$ temporal super resolution with multiple depths recovery from a single image. Two examples are presented for the purpose of recording subtle vibrations and tracking small particles within 5 ms. △ Less

Submitted 27 October, 2016; originally announced October 2016.

Comments: 12 pages, 6 figures

Toward Long Distance, Sub-diffraction Imaging Using Coherent Camera Arrays

Authors: Jason Holloway, M. Salman Asif, Manoj Kumar Sharma, Nathan Matsuda, Roarke Horstmeyer, Oliver Cossairt, Ashok Veeraraghavan

Abstract: In this work, we propose using camera arrays coupled with coherent illumination as an effective method of improving spatial resolution in long distance images by a factor of ten and beyond. Recent advances in ptychography have demonstrated that one can image beyond the diffraction limit of the objective lens in a microscope. We demonstrate a similar imaging system to image beyond the diffraction l… ▽ More In this work, we propose using camera arrays coupled with coherent illumination as an effective method of improving spatial resolution in long distance images by a factor of ten and beyond. Recent advances in ptychography have demonstrated that one can image beyond the diffraction limit of the objective lens in a microscope. We demonstrate a similar imaging system to image beyond the diffraction limit in long range imaging. We emulate a camera array with a single camera attached to an X-Y translation stage. We show that an appropriate phase retrieval based reconstruction algorithm can be used to effectively recover the lost high resolution details from the multiple low resolution acquired images. We analyze the effects of noise, required degree of image overlap, and the effect of increasing synthetic aperture size on the reconstructed image quality. We show that coherent camera arrays have the potential to greatly improve imaging performance. Our simulations show resolution gains of 10x and more are achievable. Furthermore, experimental results from our proof-of-concept systems show resolution gains of 4x-7x for real scenes. Finally, we introduce and analyze in simulation a new strategy to capture macroscopic Fourier Ptychography images in a single snapshot, albeit using a camera array. △ Less

Submitted 28 October, 2015; originally announced October 2015.

Comments: 13 pages, 16 figures, submitted to IEEE Transactions on Computational Imaging