-
Camera Calibration through Geometric Constraints from Rotation and Projection Matrices
Authors:
Muhammad Waleed,
Abdul Rauf,
Murtaza Taj
Abstract:
The process of camera calibration involves estimating the intrinsic and extrinsic parameters, which are essential for accurately performing tasks such as 3D reconstruction, object tracking and augmented reality. In this work, we propose a novel constraints-based loss for measuring the intrinsic (focal length: $(f_x, f_y)$ and principal point: $(p_x, p_y)$) and extrinsic (baseline: ($b$), disparity…
▽ More
The process of camera calibration involves estimating the intrinsic and extrinsic parameters, which are essential for accurately performing tasks such as 3D reconstruction, object tracking and augmented reality. In this work, we propose a novel constraints-based loss for measuring the intrinsic (focal length: $(f_x, f_y)$ and principal point: $(p_x, p_y)$) and extrinsic (baseline: ($b$), disparity: ($d$), translation: $(t_x, t_y, t_z)$, and rotation specifically pitch: $(θ_p)$) camera parameters. Our novel constraints are based on geometric properties inherent in the camera model, including the anatomy of the projection matrix (vanishing points, image of world origin, axis planes) and the orthonormality of the rotation matrix. Thus we proposed a novel Unsupervised Geometric Constraint Loss (UGCL) via a multitask learning framework. Our methodology is a hybrid approach that employs the learning power of a neural network to estimate the desired parameters along with the underlying mathematical properties inherent in the camera projection matrix. This distinctive approach not only enhances the interpretability of the model but also facilitates a more informed learning process. Additionally, we introduce a new CVGL Camera Calibration dataset, featuring over 900 configurations of camera parameters, incorporating 63,600 image pairs that closely mirror real-world conditions. By training and testing on both synthetic and real-world datasets, our proposed approach demonstrates improvements across all parameters when compared to the state-of-the-art (SOTA) benchmarks. The code and the updated dataset can be found here: https://github.com/CVLABLUMS/CVGL-Camera-Calibration
△ Less
Submitted 20 February, 2024; v1 submitted 13 February, 2024;
originally announced February 2024.
-
Enhanced optical trap** via structured scattering
Authors:
Michael A Taylor,
Muhammad Waleed,
Alexander B Stilgoe,
Halina Rubinsztein-Dunlop,
Warwick P Bowen
Abstract:
Interferometry can completely redirect light, providing the potential for strong and controllable optical forces. However, small particles do not naturally act like interferometric beamsplitters, and the optical scattering from them is not generally thought to allow efficient interference. Instead, optical trap** is typically achieved via deflection of the incident field. Here we show that a sui…
▽ More
Interferometry can completely redirect light, providing the potential for strong and controllable optical forces. However, small particles do not naturally act like interferometric beamsplitters, and the optical scattering from them is not generally thought to allow efficient interference. Instead, optical trap** is typically achieved via deflection of the incident field. Here we show that a suitably structured incident field can achieve beamsplitter-like interactions with scattering particles. The resulting trap offers order-of-magnitude higher stiffness than the usual Gaussian trap in one axis, even when constrained to phase-only structuring. We demonstrate trap** of 3.5 to 10.0~$μ$m silica spheres, achieving stiffness up to 27.5$\pm$4.1 times higher than is possible using Gaussian traps, and two orders of magnitude higher measurement signal-to-noise ratio. These results are highly relevant to many applications, including cellular manipulation, fluid dynamics, micro-robotics, and tests of fundamental physics.
△ Less
Submitted 20 May, 2021;
originally announced May 2021.
-
Ultrafast viscosity measurement with ballistic optical tweezers
Authors:
Lars S. Madsen,
Muhammad Waleed,
Catxere A. Casacio,
Alexander B. Stilgoe,
Michael A. Taylor,
Warwick P. Bowen
Abstract:
Viscosity is an important property of out-of-equilibrium systems such as active biological materials and driven non-Newtonian fluids, and for fields ranging from biomaterials to geology, energy technologies and medicine. However, noninvasive viscosity measurements typically require integration times of seconds. Here we demonstrate a four orders-of-magnitude improvement in speed, down to twenty mic…
▽ More
Viscosity is an important property of out-of-equilibrium systems such as active biological materials and driven non-Newtonian fluids, and for fields ranging from biomaterials to geology, energy technologies and medicine. However, noninvasive viscosity measurements typically require integration times of seconds. Here we demonstrate a four orders-of-magnitude improvement in speed, down to twenty microseconds, with uncertainty dominated by fundamental thermal noise for the first time. We achieve this using the instantaneous velocity of a trapped particle in an optical tweezer. To resolve the instantaneous velocity we develop a structured-light detection system that allows particle tracking with megahertz bandwidths. Our results translate viscosity from a static averaged property, to one that may be dynamically tracked on the timescales of active dynamics. This opens a pathway to new discoveries in out-of-equilibrium systems, from the fast dynamics of phase transitions, to energy dissipation in motor molecule step**, to violations of fluctuation laws of equilibrium thermodynamics.
△ Less
Submitted 28 June, 2020;
originally announced July 2020.
-
Quantum correlations overcome the photodamage limits of light microscopy
Authors:
Catxere A. Casacio,
Lars S. Madsen,
Alex Terrasson,
Muhammad Waleed,
Kai Barnscheidt,
Boris Hage,
Michael A. Taylor,
Warwick P. Bowen
Abstract:
State-of-the-art microscopes use intense lasers that can severely disturb biological processes, function and viability. This introduces hard limits on performance that only quantum photon correlations can overcome. Here we demonstrate this absolute quantum advantage, achieving signal-to-noise beyond the photodamage-free capacity of conventional microscopy. We achieve this in a coherent Raman micro…
▽ More
State-of-the-art microscopes use intense lasers that can severely disturb biological processes, function and viability. This introduces hard limits on performance that only quantum photon correlations can overcome. Here we demonstrate this absolute quantum advantage, achieving signal-to-noise beyond the photodamage-free capacity of conventional microscopy. We achieve this in a coherent Raman microscope, which we use to image molecular bonds within a cell with both quantum-enhanced contrast and sub-wavelength resolution. This allows the observation of nanoscale biological structures that would otherwise not be resolved. Coherent Raman microscopes allow highly selective biomolecular finger-printing in unlabelled specimens, but photodamage is a major roadblock for many applications. By showing that this roadblock can be overcome, our work provides a path towards order-of-magnitude improvements in both sensitivity and imaging speed.
△ Less
Submitted 12 September, 2020; v1 submitted 31 March, 2020;
originally announced April 2020.
-
Evanescent single-molecule biosensing with quantum limited precision
Authors:
N. P. Mauranyapin,
L. S. Madsen,
M. A. Taylor,
M. Waleed,
W. P. Bowen
Abstract:
Sensors that are able to detect and track single unlabelled biomolecules are an important tool both to understand biomolecular dynamics and interactions at nanoscale, and for medical diagnostics operating at their ultimate detection limits. Recently, exceptional sensitivity has been achieved using the strongly enhanced evanescent fields provided by optical microcavities and nano-sized plasmonic re…
▽ More
Sensors that are able to detect and track single unlabelled biomolecules are an important tool both to understand biomolecular dynamics and interactions at nanoscale, and for medical diagnostics operating at their ultimate detection limits. Recently, exceptional sensitivity has been achieved using the strongly enhanced evanescent fields provided by optical microcavities and nano-sized plasmonic resonators. However, at high field intensities photodamage to the biological specimen becomes increasingly problematic. Here, we introduce an optical nanofibre based evanescent biosensor that operates at the fundamental precision limit introduced by quantisation of light. This allows a four order-of-magnitude reduction in optical intensity whilst maintaining state-of-the-art sensitivity. It enable quantum noise limited tracking of single biomolecules as small as 3.5 nm, and surface-molecule interactions to be monitored over extended periods. By achieving quantum noise limited precision, our approach provides a pathway towards quantum-enhanced single-molecule biosensors.
△ Less
Submitted 14 November, 2016; v1 submitted 19 September, 2016;
originally announced September 2016.
