Deep Learning-Assisted Co-registration of Full-Spectral Autofluorescence Lifetime Microscopic Images with H&E-Stained Histology Images
Authors:
Qiang Wang,
Susan Fernandes,
Gareth O. S. Williams,
Neil Finlayson,
Ahsan R. Akram,
Kevin Dhaliwal,
James R. Hopgood,
Marta Vallejo
Abstract:
Autofluorescence lifetime images reveal unique characteristics of endogenous fluorescence in biological samples. Comprehensive understanding and clinical diagnosis rely on co-registration with the gold standard, histology images, which is extremely challenging due to the difference of both images. Here, we show an unsupervised image-to-image translation network that significantly improves the succ…
▽ More
Autofluorescence lifetime images reveal unique characteristics of endogenous fluorescence in biological samples. Comprehensive understanding and clinical diagnosis rely on co-registration with the gold standard, histology images, which is extremely challenging due to the difference of both images. Here, we show an unsupervised image-to-image translation network that significantly improves the success of the co-registration using a conventional optimisation-based regression network, applicable to autofluorescence lifetime images at different emission wavelengths. A preliminary blind comparison by experienced researchers shows the superiority of our method on co-registration. The results also indicate that the approach is applicable to various image formats, like fluorescence intensity images. With the registration, stitching outcomes illustrate the distinct differences of the spectral lifetime across an unstained tissue, enabling macro-level rapid visual identification of lung cancer and cellular-level characterisation of cell variants and common types. The approach could be effortlessly extended to lifetime images beyond this range and other staining technologies.
△ Less
Submitted 15 February, 2022;
originally announced February 2022.
Sub millimetre flexible fibre probe for background and fluorescence free Raman spectroscopy
Authors:
Stephanos Yerolatsitis,
András Kufcsák,
Katjana Ehrlich,
Harry A. C. Wood,
Susan Fernandes,
Tom Quinn,
Vikki Young,
Irene Young,
Katie Hamilton,
Ahsan R. Akram,
Robert R. Thomson,
Keith Finlayson,
Kevin Dhaliwal,
James M. Stone
Abstract:
Using the shifted-excitation Raman difference spectroscopy technique and an optical fibre featuring a negative curvature excitation core and a coaxial ring of high numerical aperture collection cores, we have developed a portable, background and fluorescence free, endoscopic Raman probe. The probe consists of a single fibre with a diameter of less than 0.25 mm packaged in a sub-millimetre tubing,…
▽ More
Using the shifted-excitation Raman difference spectroscopy technique and an optical fibre featuring a negative curvature excitation core and a coaxial ring of high numerical aperture collection cores, we have developed a portable, background and fluorescence free, endoscopic Raman probe. The probe consists of a single fibre with a diameter of less than 0.25 mm packaged in a sub-millimetre tubing, making it compatible with standard bronchoscopes. The Raman excitation light in the fibre is guided in air and therefore interacts little with silica, enabling an almost background free transmission of the excitation light. In addition, we used the shifted-excitation Raman difference spectroscopy technique and a tunable 785 nm laser to separate the fluorescence and the Raman spectrum from highly fluorescent samples, demonstrating the suitability of the probe for biomedical applications. Using this probe we also acquired fluorescence free human lung tissue data.
△ Less
Submitted 16 December, 2020;
originally announced December 2020.
