-
Self-attention-based non-linear basis transformations for compact latent space modelling of dynamic optical fibre transmission matrices
Authors:
Yijie Zheng,
Robert J. Kilpatrick,
David B. Phillips,
George S. D. Gordon
Abstract:
Multimode optical fibres are hair-thin strands of glass that efficiently transport light. They promise next-generation medical endoscopes that provide unprecedented sub-cellular image resolution deep inside the body. However, confining light to such fibres means that images are inherently scrambled in transit. Conventionally, this scrambling has been compensated by pre-calibrating how a specific f…
▽ More
Multimode optical fibres are hair-thin strands of glass that efficiently transport light. They promise next-generation medical endoscopes that provide unprecedented sub-cellular image resolution deep inside the body. However, confining light to such fibres means that images are inherently scrambled in transit. Conventionally, this scrambling has been compensated by pre-calibrating how a specific fibre scrambles light and solving a stationary linear matrix equation that represents a physical model of the fibre. However, as the technology develops towards real-world deployment, the unscrambling process must account for dynamic changes in the matrix representing the fibre's effect on light, due to factors such as movement and temperature shifts, and non-linearities resulting from the inaccessibility of the fibre tip when inside the body. Such complex, dynamic and nonlinear behaviour is well-suited to approximation by neural networks, but most leading image reconstruction networks rely on convolutional layers, which assume strong correlations between adjacent pixels, a strong inductive bias that is inappropriate for fibre matrices which may be expressed in a range of arbitrary coordinate representations with long-range correlations. We introduce a new concept that uses self-attention layers to dynamically transform the coordinate representations of varying fibre matrices to a basis that admits compact, low-dimensional representations suitable for further processing. We demonstrate the effectiveness of this approach on diverse fibre matrix datasets. We show our models significantly improve the sparsity of fibre bases in their transformed bases with a participation ratio, p, as a measure of sparsity, of between 0.01 and 0.11. Further, we show that these transformed representations admit reconstruction of the original matrices with < 10% reconstruction error, demonstrating the invertibility.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
Interpretable cancer cell detection with phonon microscopy using multi-task conditional neural networks for inter-batch calibration
Authors:
Yijie Zheng,
Rafael Fuentes-Dominguez,
Matt Clark,
George S. D. Gordon,
Fernando Perez-Cota
Abstract:
Advances in artificial intelligence (AI) show great potential in revealing underlying information from phonon microscopy (high-frequency ultrasound) data to identify cancerous cells. However, this technology suffers from the 'batch effect' that comes from unavoidable technical variations between each experiment, creating confounding variables that the AI model may inadvertently learn. We therefore…
▽ More
Advances in artificial intelligence (AI) show great potential in revealing underlying information from phonon microscopy (high-frequency ultrasound) data to identify cancerous cells. However, this technology suffers from the 'batch effect' that comes from unavoidable technical variations between each experiment, creating confounding variables that the AI model may inadvertently learn. We therefore present a multi-task conditional neural network framework to simultaneously achieve inter-batch calibration, by removing confounding variables, and accurate cell classification of time-resolved phonon-derived signals. We validate our approach by training and validating on different experimental batches, achieving a balanced precision of 89.22% and an average cross-validated precision of 89.07% for classifying background, healthy and cancerous regions. Classification can be performed in 0.5 seconds with only simple prior batch information required for multiple batch corrections. Further, we extend our model to reconstruct denoised signals, enabling physical interpretation of salient features indicating disease state including sound velocity, sound attenuation and cell-adhesion to substrate.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
Hyperpixels: Pixel Filter Arrays of Multivariate Optical Elements for Optimized Spectral Imaging
Authors:
Calum Williams,
Richard Cousins,
Christopher J. Mellor,
Sarah E. Bohndiek,
George S. D. Gordon
Abstract:
We introduce the concept of `hyperpixels' in which each element of a pixel filter array (suitable for CMOS image sensor integration) has a spectral transmission tailored to a target spectral component expected in application-specific scenes. These are analogous to arrays of multivariate optical elements that could be used for sensing specific analytes. Spectral tailoring is achieved by engineering…
▽ More
We introduce the concept of `hyperpixels' in which each element of a pixel filter array (suitable for CMOS image sensor integration) has a spectral transmission tailored to a target spectral component expected in application-specific scenes. These are analogous to arrays of multivariate optical elements that could be used for sensing specific analytes. Spectral tailoring is achieved by engineering the heights of multiple sub-pixel Fabry-Perot resonators that cover each pixel area. We first present a design approach for hyperpixels, based on a matched filter concept and, as an exemplar, design a set of 4 hyperpixels tailored to optimally discriminate between 4 spectral reflectance targets. Next, we fabricate repeating 2x2 pixel filter arrays of these designs, alongside repeating 2x2 arrays of an optimal bandpass filters, perform both spectral and imaging characterization. Experimentally measured hyperpixel transmission spectra show a 2.4x reduction in unmixing matrix condition number (p=0.031) compared to the optimal band-pass set. Imaging experiments using the filter arrays with a monochrome sensor achieve a 3.47x reduction in unmixing matrix condition number (p=0.020) compared to the optimal band-pass set. This demonstrates the utility of the hyperpixel approach and shows its superiority even over the optimal bandpass case. We expect that with further improvements in design and fabrication processes increased performance may be obtained. Because the hyperpixels are straightforward to customize, fabricate and can be placed atop monochrome sensors, this approach is highly versatile and could be adapted to a wide range of real-time imaging applications which are limited by low SNR including micro-endoscopy, capsule endoscopy, industrial inspection and machine vision.
△ Less
Submitted 25 March, 2024;
originally announced March 2024.
-
Single- and multi-layer micro-scale diffractive lens fabrication for fiber imaging probes with versatile depth-of-field
Authors:
Fei He,
Rafael Fuentes-Dominguez,
Richard Cousins,
Christopher J. Mellor,
Jennifer K. Barton,
George S. D. Gordon
Abstract:
Hair-thin optical fiber endoscopes have opened up new paradigms for advanced imaging applications in vivo. In certain applications, such as optical coherence tomography (OCT), light-sha** structures may be required on fiber facets to generate needle-like Bessel beams with large depth-of-field, while in others shorter depths of field with high lateral resolutions are preferable. In this paper, we…
▽ More
Hair-thin optical fiber endoscopes have opened up new paradigms for advanced imaging applications in vivo. In certain applications, such as optical coherence tomography (OCT), light-sha** structures may be required on fiber facets to generate needle-like Bessel beams with large depth-of-field, while in others shorter depths of field with high lateral resolutions are preferable. In this paper, we demonstrate a novel method to fabricate light-sha** structures on optical fibres, achieved via bonding encapsulated planar diffractive lenses onto fiber facets. Diffractive metallic structures have the advantages of being simple to design, fabricate and transfer, and our encapsulation approach is scalable to multi-layer stacks. As a demonstration, we design and transfer a Fresnel zone plate and a diffractive axicon onto fiber facets, and show that the latter device generates a needle-like Bessel beam with 350 mu m focal depth. We also evaluate the imaging performance of both devices and show that the axicon fiber is able to maintain focussed images of a USAF resolution target over a 150 mu m distance. Finally, we fabricate a two-layer stack of Fresnel zone plates on a fiber and characterise the modified beam profile and demonstrate good imaging performance. We anticipate our fabrication approach could enable multi-functional complex optical structures (e.g. using plasmonics, polarization control) to be integrated onto fibers for ultra-thin advanced imaging and sensing.
△ Less
Submitted 25 January, 2024;
originally announced January 2024.
-
Ultra-miniature dual-wavelength spatial frequency domain imaging for micro-endoscopy
Authors:
Jane Crowley,
George S. D. Gordon
Abstract:
There is a need for a cost-effective, quantitative imaging tool that can be deployed endoscopically to better detect early stage gastrointestinal cancers. Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that produces near-real time, quantitative maps of absorption and reduced scattering coefficients, but most implementations are bulky and suitable only for use outside the b…
▽ More
There is a need for a cost-effective, quantitative imaging tool that can be deployed endoscopically to better detect early stage gastrointestinal cancers. Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that produces near-real time, quantitative maps of absorption and reduced scattering coefficients, but most implementations are bulky and suitable only for use outside the body. We present an ultra-miniature SFDI system comprised of an optical fiber array (diameter $0.125$ mm) and a micro camera ($1\times1$ mm package) displacing conventionally bulky components, in particular the projector. The prototype has outer diameter $3$ mm, but the individual components dimensions could permit future packaging to $<1.5$ mm diameter. We develop a phase-tracking algorithm to rapidly extract images with fringe projections at $3$ equispaced phase shifts in order to perform SFDI demodulation. To validate performance, we first demonstrate comparable recovery of quantitative optical properties between our ultra-miniature system and a conventional bench-top SFDI system with agreement of $15$\% and $6$\% for absorption and reduced scattering respectively. Next, we demonstrate imaging of absorption and reduced scattering of tissue-mimicking phantoms providing enhanced contrast between simulated tissue types (healthy and tumour), done simultaneously at wavelengths of $515$ nm and $660$ nm. This device shows promise as a cost-effective, quantitative imaging tool to detect variations in optical absorption and scattering as indicators of cancer.
△ Less
Submitted 3 October, 2023; v1 submitted 6 June, 2023;
originally announced June 2023.
-
Single-ended Recovery of Optical fiber Transmission Matrices using Neural Networks
Authors:
Yijie Zheng,
George S. D. Gordon
Abstract:
Ultra-thin multimode optical fiber imaging promises next-generation medical endoscopes reaching high image resolution for deep tissues. However, current technology suffers from severe optical distortion, as the fiber's calibration is sensitive to bending and temperature and thus requires in vivo re-measurement with access to a single end only. We present a neural network (NN)-based approach to rec…
▽ More
Ultra-thin multimode optical fiber imaging promises next-generation medical endoscopes reaching high image resolution for deep tissues. However, current technology suffers from severe optical distortion, as the fiber's calibration is sensitive to bending and temperature and thus requires in vivo re-measurement with access to a single end only. We present a neural network (NN)-based approach to reconstruct the fiber's transmission matrix (TM) based on multi-wavelength reflection-mode measurements. We train two different NN architectures via a custom loss function insensitive to global phase-degeneracy: a fully connected NN and convolutional U-Net. We reconstruct the 64 $\times$ 64 complex-valued fiber TMs through a simulated single-ended optical fiber with $\leq$ 4\% error and cross-validate on experimentally measured TMs, demonstrating both wide-field and confocal scanning image reconstruction with small error. Our TM recovery approach is 4500 times faster, is more robust to fiber perturbation during characterization, and operates with non-square TMs.
△ Less
Submitted 3 October, 2023; v1 submitted 31 March, 2023;
originally announced March 2023.
-
Designing and simulating realistic spatial frequency domain imaging systems using open-source 3D rendering software
Authors:
Jane Crowley,
George S. D. Gordon
Abstract:
Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that can deliver real-time maps of absorption and reduced scattering coefficients. However, there are a wide range of imaging geometries that practical SFDI systems must cope with including imaging flat samples ex vivo, imaging inside tubular lumen in vivo such as in an endoscopy, and measuring tumours or polyps of varying sha…
▽ More
Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that can deliver real-time maps of absorption and reduced scattering coefficients. However, there are a wide range of imaging geometries that practical SFDI systems must cope with including imaging flat samples ex vivo, imaging inside tubular lumen in vivo such as in an endoscopy, and measuring tumours or polyps of varying shapes, sizes and optical properties. There is a need for a design and simulation tool to accelerate design and fabrication of new SFDI systems. We present such a system implemented using open-source 3D design and ray-tracing software Blender that is capable of simulating media with realistic optical properties (mimicking healthy and cancerous tissue), a wide variety of shapes and size, and in both planar and tubular imaging geometries. We first demonstrate quantitative agreement between Monte-Carlo simulated scattering and absorption coefficients and those measured from our Blender system. Next, we show the ability of the system to simulate absorption, scattering and shape for flat samples with small simulated tumours and show that the improved contrast associated with SFDI is reproduced. Finally, to demonstrate the versatility of the system as a design tool we show that it can be used to generate a custom look-up-table for map** from modulation amplitude values to absorption and scattering values in a tubular geometry, simulating a lumen. As a demonstrative example we show that longitudinal sectioning of the tube, with separate look-up tables for each section, significantly improves accuracy of SFDI, representing an important design insight for future systems. We therefore anticipate our simulation system will significantly aid in the design and development of novel SFDI systems, especially as such systems are miniaturised for deployment in endoscopic and laparoscopic systems.
△ Less
Submitted 24 February, 2023;
originally announced February 2023.
-
Markov Cricket: Using Forward and Inverse Reinforcement Learning to Model, Predict And Optimize Batting Performance in One-Day International Cricket
Authors:
Manohar Vohra,
George S. D. Gordon
Abstract:
In this paper, we model one-day international cricket games as Markov processes, applying forward and inverse Reinforcement Learning (RL) to develop three novel tools for the game. First, we apply Monte-Carlo learning to fit a nonlinear approximation of the value function for each state of the game using a score-based reward model. We show that, when used as a proxy for remaining scoring resources…
▽ More
In this paper, we model one-day international cricket games as Markov processes, applying forward and inverse Reinforcement Learning (RL) to develop three novel tools for the game. First, we apply Monte-Carlo learning to fit a nonlinear approximation of the value function for each state of the game using a score-based reward model. We show that, when used as a proxy for remaining scoring resources, this approach outperforms the state-of-the-art Duckworth-Lewis-Stern method used in professional matches by 3 to 10 fold. Next, we use inverse reinforcement learning, specifically a variant of guided-cost learning, to infer a linear model of rewards based on expert performances, assumed here to be play sequences of winning teams. From this model we explicitly determine the optimal policy for each state and find this agrees with common intuitions about the game. Finally, we use the inferred reward models to construct a game simulator that models the posterior distribution of final scores under different policies. We envisage our prediction and simulation techniques may provide a fairer alternative for estimating final scores in interrupted games, while the inferred reward model may provide useful insights for the professional game to optimize playing strategy. Further, we anticipate our method of applying RL to this game may have broader application to other sports with discrete states of play where teams take turns, such as baseball and rounders.
△ Less
Submitted 7 March, 2021;
originally announced March 2021.
-
HoloGen: An open source toolbox for high-speed hologram generation
Authors:
Peter J. Christopher,
Andrew Kadis,
George S. D. Gordon,
Timothy D. Wilkinson
Abstract:
The rise of mixed reality systems such as Microsoft HoloLens has prompted an increase in interest in the fields of 2D and 3D holography. Already applied in fields including telecommunications, imaging, projection, lithography, beam sha** and optical tweezing, Computer Generated Holography (CGH) offers an exciting approach to a wide range of light sha** problems. The numerical processing requir…
▽ More
The rise of mixed reality systems such as Microsoft HoloLens has prompted an increase in interest in the fields of 2D and 3D holography. Already applied in fields including telecommunications, imaging, projection, lithography, beam sha** and optical tweezing, Computer Generated Holography (CGH) offers an exciting approach to a wide range of light sha** problems. The numerical processing required to generate a hologram is high and requires significant domain expertise. This has historically slowed the adoption of holographic techniques in emerging fields. In this paper we present HoloGen, an open-source Cuda C and C ++ framework for computer generated holography. HoloGen unites, for the first time, a wide array of existing hologram generation algorithms with state of the art performance while attempting to remain intuitive and easy to use. This is enabled by a C # and Windows Presentation Framework (WPF) graphical user interface (GUI). A novel reflection based parameter hierarchy is used to ensure ease of modification. Extensive use of C ++ templates based on the Standard Template Library (STL), compile time flexibility is preserved while maintaining runtime performance. The current release of HoloGen unites implementations of well known generation algorithms including Gerchberg-Saxton (GS), Liu-Taghizadeh (LT), Direct Search (DS), Simulated Annealing (SA) and One-Step Phase-Retrieval (OSPR) with less known specialist variants including Weighted GS and Adaptive OSPR. Benchmarking results are presented for several key algorithms. The software is freely available under an MIT license.
△ Less
Submitted 27 September, 2021; v1 submitted 24 August, 2020;
originally announced August 2020.
-
Holographic Predictive Search: Extending the Scope
Authors:
Peter J. Christopher,
Ralf Mouthaan,
George S. D. Gordon,
Timothy D. Wilkinson
Abstract:
Holographic Predictive Search (HPS) is a novel approach to search-based hologram generation that uses a mathematical understanding of the optical transforms to make informed optimisation decisions. Existing search techniques such as Direct Search (DS) and Simulated Annealing (SA) rely on trialling modifications to a test hologram and observing the results. A formula is used to decide whether the c…
▽ More
Holographic Predictive Search (HPS) is a novel approach to search-based hologram generation that uses a mathematical understanding of the optical transforms to make informed optimisation decisions. Existing search techniques such as Direct Search (DS) and Simulated Annealing (SA) rely on trialling modifications to a test hologram and observing the results. A formula is used to decide whether the change should be accepted. HPS operates presciently, using knowledge of the underlying mathematical relationship to make exact changes to the test hologram that guarantee the 'best' outcome for that change. In this work, we extend the scope of the original research to cover both phase and amplitude modulating Spatial Light Modulators (SLMs), both phase sensitive and phase insensitive systems and both Fresnel and Fraunhofer diffraction. In the cases discussed, improvements of up to 10x are observed in final error and the approach also offers significant performance benefits in generation time. This comes at the expense of increased complexity and loss of generality.
△ Less
Submitted 24 August, 2020;
originally announced August 2020.
-
Benchmarking the Gerchberg-Saxton Algorithm
Authors:
Peter J. Christopher,
George S. D. Gordon,
Timothy D. Wilkinson
Abstract:
Due to the proliferation of spatial light modulators, digital holography is finding wide-spread use in fields from augmented reality to medical imaging to additive manufacturing to lithography to optical tweezing to telecommunications. There are numerous types of SLM available with a multitude of algorithms for generating holograms. Each algorithm has limitations in terms of convergence speed, pow…
▽ More
Due to the proliferation of spatial light modulators, digital holography is finding wide-spread use in fields from augmented reality to medical imaging to additive manufacturing to lithography to optical tweezing to telecommunications. There are numerous types of SLM available with a multitude of algorithms for generating holograms. Each algorithm has limitations in terms of convergence speed, power efficiency, accuracy and data storage requirement.
Here, we consider probably the most common algorithm for computer generated holography - Gerchberg-Saxton - and examine the trade-off in convergent quality, performance and efficiency. In particular, we focus on measuring and understanding the factors that control runtime and convergence.
△ Less
Submitted 18 May, 2020;
originally announced May 2020.
-
Characterising optical fibre transmission matrices using metasurface reflector stacks for lensless imaging without distal access
Authors:
George S. D. Gordon,
Milana Gataric,
Alberto Gil C. P. Ramos,
Ralf Mouthaan,
Calum Williams,
Jonghee Yoon,
Timothy D. Wilkinson,
Sarah E. Bohndiek
Abstract:
The ability to form images through hair-thin optical fibres promises to open up new applications from biomedical imaging to industrial inspection. Unfortunately, deployment has been limited because small changes in mechanical deformation (e.g. bending) and temperature can completely scramble optical information, distorting images. Since such changes are dynamic, correcting them requires measuremen…
▽ More
The ability to form images through hair-thin optical fibres promises to open up new applications from biomedical imaging to industrial inspection. Unfortunately, deployment has been limited because small changes in mechanical deformation (e.g. bending) and temperature can completely scramble optical information, distorting images. Since such changes are dynamic, correcting them requires measurement of the fibre transmission matrix (TM) in situ immediately before imaging. TM calibration typically requires access to both the proximal and distal facets of the fibre simultaneously, which is not feasible during most realistic usage scenarios without compromising the thin form factor with bulky distal optics. Here, we introduce a new approach to determine the TM of multi-mode fibre (MMF) or multi-core fibre (MCF) in a reflection-mode configuration without access to the distal facet. A thin stack of structured metasurface reflectors is used at the distal facet to introduce wavelength-dependent, spatially heterogeneous reflectance profiles. We derive a first-order fibre model that compensates these wavelength-dependent changes in the TM and show that, consequently, the reflected data at 3 wavelengths can be used to unambiguously reconstruct the full TM by an iterative optimisation algorithm. We then present a method for sample illumination and imaging following TM reconstruction. Unlike previous approaches, our method does not require the TM to be unitary making it applicable to physically realistic fibre systems. We demonstrate TM reconstruction and imaging first using simulated non-unitary fibres and noisy reflection matrices, then using much larger experimentally-measured TMs of a densely-packed MCF, and finally on an experimentally-measured multi-wavelength set of TMs recorded from a MMF. Our findings pave the way for online transmission matrix calibration in situ in hair-thin optical fibres
△ Less
Submitted 5 April, 2019; v1 submitted 4 April, 2019;
originally announced April 2019.
-
Grayscale-to-color: Single-step fabrication of bespoke multispectral filter arrays
Authors:
Calum Williams,
George S. D. Gordon,
Sophia Gruber,
Timothy D. Wilkinson,
Sarah E. Bohndiek
Abstract:
Conventional cameras, such as in smartphones, capture wideband red, green and blue (RGB) spectral components, replicating human vision. Multispectral imaging (MSI) captures spatial and spectral information beyond our vision but typically requires bulky optical components and is expensive. Snapshot multispectral image sensors have been proposed as a key enabler for a plethora of MSI applications, f…
▽ More
Conventional cameras, such as in smartphones, capture wideband red, green and blue (RGB) spectral components, replicating human vision. Multispectral imaging (MSI) captures spatial and spectral information beyond our vision but typically requires bulky optical components and is expensive. Snapshot multispectral image sensors have been proposed as a key enabler for a plethora of MSI applications, from diagnostic medical imaging to remote sensing. To achieve low-cost and compact designs, spatially variant multispectral filter arrays (MSFAs) based on thin-film optical components are deposited atop image sensors. Conventional MSFAs achieve spectral filtering through either multi-layer stacks or pigment, requiring: complex mixtures of materials; additional lithographic steps for each additional wavelength; and large thicknesses to achieve high transmission efficiency. By contrast, we show here for the first time a single-step grayscale lithographic process that enables fabrication of bespoke MSFAs based on the Fabry-Perot resonances of spatially variant metal-insulator-metal (MIM) cavities, where the exposure dose controls insulator (cavity) thickness. We demonstrate customizable MSFAs scalable up to N-wavelength bands spanning the visible and near-infrared with high transmission efficiency (~75%) and narrow linewidths (~50 nm). Using this technique, we achieve multispectral imaging of several spectrally distinct target using our bespoke MIM-MSFAs fitted to a monochrome CMOS image sensor. Our unique framework provides an attractive alternative to conventional MSFA manufacture, by reducing both fabrication complexity and cost of these intricate optical devices, while increasing customizability.
△ Less
Submitted 27 January, 2019;
originally announced January 2019.
-
Quantitative phase and polarisation endoscopy applied to detection of early oesophageal tumourigenesis
Authors:
George S. D. Gordon,
James Joseph,
Maria P. Alcolea,
Travis Sawyer,
Alexander J. Macfaden,
Calum Williams,
Catherine R. M. Fitzpatrick,
Philip H. Jones,
Massimiliano di Pietro,
Rebecca C. Fitzgerald,
Timothy D. Wilkinson,
Sarah E. Bohndiek
Abstract:
Phase and polarisation of coherent light are highly perturbed by interaction with microstructural changes in pre-malignant tissue, holding promise for label-free early cancer detection in endoscopically accessible tissues such as the gastrointestinal tract. Flexible optical fibres used in conventional diagnostic endoscopy scramble phase and polarisation, restricting clinicians instead to low-contr…
▽ More
Phase and polarisation of coherent light are highly perturbed by interaction with microstructural changes in pre-malignant tissue, holding promise for label-free early cancer detection in endoscopically accessible tissues such as the gastrointestinal tract. Flexible optical fibres used in conventional diagnostic endoscopy scramble phase and polarisation, restricting clinicians instead to low-contrast amplitude-only imaging. Here, we unscramble phase and polarisation images by exploiting the near-diagonal multi-core fibre (MCF) transmission matrix to create a novel parallelised fibre characterisation architecture, scalable to arbitrary MCFs without additional experimental overhead. Our flexible MCF holographic endoscope produces full-field en-face images of amplitude, quantitative phase and resolved polarimetric properties using a low-cost laser diode and camera. We demonstrate that recovered phase enables computational re-focusing at working distances up to 1mm over a field-of-view up to 750$\times$750 $μm^2$. Furthermore, we demonstrate that the spatial distribution of phase and polarisation information enables label-free visualisation of early tumours in oesophageal mouse issue that are not identifiable using conventional amplitude-only information, a milestone towards future application for early cancer detection in endoscopy.
△ Less
Submitted 9 November, 2018;
originally announced November 2018.
-
Reconstruction of optical vector-fields with applications in endoscopic imaging
Authors:
Milana Gataric,
George S. D. Gordon,
Francesco Renna,
Alberto Gil C. P. Ramos,
Maria P. Alcolea,
Sarah E. Bohndiek
Abstract:
We introduce a framework for the reconstruction of the amplitude, phase and polarisation of an optical vector-field using calibration measurements acquired by an imaging device with an unknown linear transformation. By incorporating effective regularisation terms, this new approach is able to recover an optical vector-field with respect to an arbitrary representation system, which may be different…
▽ More
We introduce a framework for the reconstruction of the amplitude, phase and polarisation of an optical vector-field using calibration measurements acquired by an imaging device with an unknown linear transformation. By incorporating effective regularisation terms, this new approach is able to recover an optical vector-field with respect to an arbitrary representation system, which may be different from the one used in calibration. In particular, it enables the recovery of an optical vector-field with respect to a Fourier basis, which is shown to yield indicative features of increased scattering associated with tissue abnormalities. We demonstrate the effectiveness of our approach using synthetic holographic images as well as biological tissue samples in an experimental setting where measurements of an optical vector-field are acquired by a fibre endoscope, and observe that indeed the recovered Fourier coefficients are useful in distinguishing healthy tissues from lesions in early stages of oesophageal cancer.
△ Less
Submitted 18 July, 2018; v1 submitted 27 April, 2018;
originally announced April 2018.