-
Ray-transfer functions for camera simulation of 3D scenes with hidden lens design
Authors:
Thomas Goossens,
Zheng Lyu,
Jamyuen Ko,
Gordon Wan,
Joyce Farrell,
Brian Wandell
Abstract:
Combining image sensor simulation tools (e.g., ISETCam) with physically based ray tracing (e.g., PBRT) offers possibilities for designing and evaluating novel imaging systems as well as for synthesizing physically accurate, labeled images for machine learning. One practical limitation has been simulating the optics precisely: Lens manufacturers generally prefer to keep lens design confidential. We…
▽ More
Combining image sensor simulation tools (e.g., ISETCam) with physically based ray tracing (e.g., PBRT) offers possibilities for designing and evaluating novel imaging systems as well as for synthesizing physically accurate, labeled images for machine learning. One practical limitation has been simulating the optics precisely: Lens manufacturers generally prefer to keep lens design confidential. We present a pragmatic solution to this problem using a black box lens model in Zemax; such models provide necessary optical information while preserving the lens designer's intellectual property. First, we describe and provide software to construct a polynomial ray transfer function that characterizes how rays entering the lens at any position and angle subsequently exit the lens. We implement the ray-transfer calculation as a camera model in PBRT and confirm that the PBRT ray-transfer calculations match the Zemax lens calculations for edge spread functions and relative illumination.
△ Less
Submitted 23 February, 2022; v1 submitted 17 February, 2022;
originally announced February 2022.
-
Accurate smartphone camera simulation using 3D scenes
Authors:
Zheng Lyu,
Thomas Goossens,
Brian Wandell,
Joyce Farrell
Abstract:
We assess the accuracy of a smartphone camera simulation. The simulation is an end-to-end analysis that begins with a physical description of a high dynamic range 3D scene and includes a specification of the optics and the image sensor. The simulation is compared to measurements of a physical version of the scene. The image system simulation accurately matched measurements of optical blur, depth o…
▽ More
We assess the accuracy of a smartphone camera simulation. The simulation is an end-to-end analysis that begins with a physical description of a high dynamic range 3D scene and includes a specification of the optics and the image sensor. The simulation is compared to measurements of a physical version of the scene. The image system simulation accurately matched measurements of optical blur, depth of field, spectral quantum efficiency, scene inter-reflections, and sensor noise. The results support the use of image systems simulation methods for soft prototy** cameras and for producing synthetic data in machine learning applications.
△ Less
Submitted 27 January, 2022; v1 submitted 18 January, 2022;
originally announced January 2022.
-
Vignetted-aperture correction for spectral cameras with integrated thin-film Fabry-Pérot filters
Authors:
Thomas Goossens,
Bert Geelen,
Andy Lambrechts,
Chris Van Hoof
Abstract:
Spectral cameras with integrated thin-film Fabry-Pérot filters have become increasingly important in many applications. These applications often require the detection of spectral features at specific wavelengths or to quantify small variations in the spectrum. This can be challenging since thin-film filters are sensitive to the angle of incidence of the light. In prior work we modeled and correcte…
▽ More
Spectral cameras with integrated thin-film Fabry-Pérot filters have become increasingly important in many applications. These applications often require the detection of spectral features at specific wavelengths or to quantify small variations in the spectrum. This can be challenging since thin-film filters are sensitive to the angle of incidence of the light. In prior work we modeled and corrected for the distribution of incident angles for an ideal finite aperture. Many real lenses however experience vignetting. Therefore in this article we generalize our model to the more common case of a vignetted aperture, which changes the distribution of incident angles. We propose a practical method to estimate the model parameters and correct undesired shifts in measured spectra. This is experimentally validated for a lens mounted on a visible to near-infrared spectral camera.
△ Less
Submitted 14 May, 2019;
originally announced May 2019.
