-
Beating bandwidth limits for large aperture broadband nano-optics
Authors:
Johannes E. Fröch,
Praneeth K. Chakravarthula,
Jipeng Sun,
Ethan Tseng,
Shane Colburn,
Alan Zhan,
Forrest Miller,
Anna Wirth-Singh,
Quentin A. A. Tanguy,
Zheyi Han,
Karl F. Böhringer,
Felix Heide,
Arka Majumdar
Abstract:
Flat optics have been proposed as an attractive approach for the implementation of new imaging and sensing modalities to replace and augment refractive optics. However, chromatic aberrations impose fundamental limitations on diffractive flat optics. As such, true broadband high-quality imaging has thus far been out of reach for low f-number, large aperture, flat optics. In this work, we overcome t…
▽ More
Flat optics have been proposed as an attractive approach for the implementation of new imaging and sensing modalities to replace and augment refractive optics. However, chromatic aberrations impose fundamental limitations on diffractive flat optics. As such, true broadband high-quality imaging has thus far been out of reach for low f-number, large aperture, flat optics. In this work, we overcome these intrinsic fundamental limitations, achieving broadband imaging in the visible wavelength range with a flat meta-optic, co-designed with computational reconstruction. We derive the necessary conditions for a broadband, 1 cm aperture, f/2 flat optic, with a diagonal field of view of 30° and an average system MTF contrast of 30% or larger for a spatial frequency of 100 lp/mm in the visible band (> 50 % for 70 lp/mm and below). Finally, we use a coaxial, dual-aperture system to train the broadband imaging meta-optic with a learned reconstruction method operating on pair-wise captured imaging data. Fundamentally, our work challenges the entrenched belief of the inability of capturing high-quality, full-color images using a single large aperture meta-optic.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
Stochastic Light Field Holography
Authors:
Florian Schiffers,
Praneeth Chakravarthula,
Nathan Matsuda,
Grace Kuo,
Ethan Tseng,
Douglas Lanman,
Felix Heide,
Oliver Cossairt
Abstract:
The Visual Turing Test is the ultimate goal to evaluate the realism of holographic displays. Previous studies have focused on addressing challenges such as limited étendue and image quality over a large focal volume, but they have not investigated the effect of pupil sampling on the viewing experience in full 3D holograms. In this work, we tackle this problem with a novel hologram generation algor…
▽ More
The Visual Turing Test is the ultimate goal to evaluate the realism of holographic displays. Previous studies have focused on addressing challenges such as limited étendue and image quality over a large focal volume, but they have not investigated the effect of pupil sampling on the viewing experience in full 3D holograms. In this work, we tackle this problem with a novel hologram generation algorithm motivated by matching the projection operators of incoherent Light Field and coherent Wigner Function light transport. To this end, we supervise hologram computation using synthesized photographs, which are rendered on-the-fly using Light Field refocusing from stochastically sampled pupil states during optimization. The proposed method produces holograms with correct parallax and focus cues, which are important for passing the Visual Turing Test. We validate that our approach compares favorably to state-of-the-art CGH algorithms that use Light Field and Focal Stack supervision. Our experiments demonstrate that our algorithm significantly improves the realism of the viewing experience for a variety of different pupil states.
△ Less
Submitted 12 July, 2023;
originally announced July 2023.
-
Neural Étendue Expander for Ultra-Wide-Angle High-Fidelity Holographic Display
Authors:
Ethan Tseng,
Grace Kuo,
Seung-Hwan Baek,
Nathan Matsuda,
Andrew Maimone,
Florian Schiffers,
Praneeth Chakravarthula,
Qiang Fu,
Wolfgang Heidrich,
Douglas Lanman,
Felix Heide
Abstract:
Holographic displays can generate light fields by dynamically modulating the wavefront of a coherent beam of light using a spatial light modulator, promising rich virtual and augmented reality applications. However, the limited spatial resolution of existing dynamic spatial light modulators imposes a tight bound on the diffraction angle. As a result, modern holographic displays possess low étendue…
▽ More
Holographic displays can generate light fields by dynamically modulating the wavefront of a coherent beam of light using a spatial light modulator, promising rich virtual and augmented reality applications. However, the limited spatial resolution of existing dynamic spatial light modulators imposes a tight bound on the diffraction angle. As a result, modern holographic displays possess low étendue, which is the product of the display area and the maximum solid angle of diffracted light. The low étendue forces a sacrifice of either the field-of-view (FOV) or the display size. In this work, we lift this limitation by presenting neural étendue expanders. This new breed of optical elements, which is learned from a natural image dataset, enables higher diffraction angles for ultra-wide FOV while maintaining both a compact form factor and the fidelity of displayed contents to human viewers. With neural étendue expanders, we experimentally achieve 64$\times$ étendue expansion of natural images in full color, expanding the FOV by an order of magnitude horizontally and vertically, with high-fidelity reconstruction quality (measured in PSNR) over 29 dB on retinal-resolution images.
△ Less
Submitted 26 April, 2024; v1 submitted 16 September, 2021;
originally announced September 2021.
-
Neural Nano-Optics for High-quality Thin Lens Imaging
Authors:
Ethan Tseng,
Shane Colburn,
James Whitehead,
Luocheng Huang,
Seung-Hwan Baek,
Arka Majumdar,
Felix Heide
Abstract:
Nano-optic imagers that modulate light at sub-wavelength scales could unlock unprecedented applications in diverse domains ranging from robotics to medicine. Although metasurface optics offer a path to such ultra-small imagers, existing methods have achieved image quality far worse than bulky refractive alternatives, fundamentally limited by aberrations at large apertures and low f-numbers. In thi…
▽ More
Nano-optic imagers that modulate light at sub-wavelength scales could unlock unprecedented applications in diverse domains ranging from robotics to medicine. Although metasurface optics offer a path to such ultra-small imagers, existing methods have achieved image quality far worse than bulky refractive alternatives, fundamentally limited by aberrations at large apertures and low f-numbers. In this work, we close this performance gap by presenting the first neural nano-optics. We devise a fully differentiable learning method that learns a metasurface physical structure in conjunction with a novel, neural feature-based image reconstruction algorithm. Experimentally validating the proposed method, we achieve an order of magnitude lower reconstruction error. As such, we present the first high-quality, nano-optic imager that combines the widest field of view for full-color metasurface operation while simultaneously achieving the largest demonstrated 0.5 mm, f/2 aperture.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Can Copper Nanostructures Sustain High-Quality Plasmons?
Authors:
Vahagn Mkhitaryan,
Katia March,
Eric Tseng,
Xiaoyan Li,
Leonardo Scarabelli,
Luis M. Liz-Marzán,
Shih-Yun Chen,
Luiz H. G. Tizei,
Odile Stéphan,
Jenn-Ming Song,
Mathieu Kociak,
F. Javier García de Abajo,
Alexandre Gloter
Abstract:
Silver is considered to be the king among plasmonic materials because it features low inelastic absorption in the visible and infrared (vis-IR) spectral regions compared to other metals. In contrast, copper is commonly regarded as being too lossy for plasmonic applications. Here, we experimentally demonstrate vis-IR plasmons in long copper nanowires (NWs) with quality factors that exceed a value o…
▽ More
Silver is considered to be the king among plasmonic materials because it features low inelastic absorption in the visible and infrared (vis-IR) spectral regions compared to other metals. In contrast, copper is commonly regarded as being too lossy for plasmonic applications. Here, we experimentally demonstrate vis-IR plasmons in long copper nanowires (NWs) with quality factors that exceed a value of 60, as determined by spatially resolved, high-resolution electron energy-loss spectroscopy (EELS) measurements. We explain this counterintuitive result by the fact that plasmons in these metal wires have most of their electromagnetic energy outside the metal, and thus, they are less sensitive to inelastic losses in the material. We present an extensive set of data acquired on long silver and copper NWs of varying diameters supporting this conclusion and further allowing us to understand the relative roles played by radiative and nonradiative losses in plasmons that span a wide range of energies down to $<20\,$meV. At such small plasmon energies, thermal population of these modes becomes significant enough to enable the observation of electron energy gains associated with plasmon absorption events. Our results support the use of copper as an attractive cheap and abundant material platform for high quality plasmons in elongated nanostructures.
△ Less
Submitted 26 November, 2020;
originally announced November 2020.
