-
Hyperspectral unmixing for Raman spectroscopy via physics-constrained autoencoders
Authors:
Dimitar Georgiev,
Álvaro Fernández-Galiana,
Simon Vilms Pedersen,
Georgios Papadopoulos,
Ruoxiao Xie,
Molly M. Stevens,
Mauricio Barahona
Abstract:
Raman spectroscopy is widely used across scientific domains to characterize the chemical composition of samples in a non-destructive, label-free manner. Many applications entail the unmixing of signals from mixtures of molecular species to identify the individual components present and their proportions, yet conventional methods for chemometrics often struggle with complex mixture scenarios encoun…
▽ More
Raman spectroscopy is widely used across scientific domains to characterize the chemical composition of samples in a non-destructive, label-free manner. Many applications entail the unmixing of signals from mixtures of molecular species to identify the individual components present and their proportions, yet conventional methods for chemometrics often struggle with complex mixture scenarios encountered in practice. Here, we develop hyperspectral unmixing algorithms based on autoencoder neural networks, and we systematically validate them using both synthetic and experimental benchmark datasets created in-house. Our results demonstrate that unmixing autoencoders provide improved accuracy, robustness and efficiency compared to standard unmixing methods. We also showcase the applicability of autoencoders to complex biological settings by showing improved biochemical characterization of volumetric Raman imaging data from a monocytic cell.
△ Less
Submitted 7 March, 2024;
originally announced March 2024.
-
Transfer Learning Bayesian Optimization to Design Competitor DNA Molecules for Use in Diagnostic Assays
Authors:
Ruby Sedgwick,
John P. Goertz,
Molly M. Stevens,
Ruth Misener,
Mark van der Wilk
Abstract:
With the rise in engineered biomolecular devices, there is an increased need for tailor-made biological sequences. Often, many similar biological sequences need to be made for a specific application meaning numerous, sometimes prohibitively expensive, lab experiments are necessary for their optimization. This paper presents a transfer learning design of experiments workflow to make this developmen…
▽ More
With the rise in engineered biomolecular devices, there is an increased need for tailor-made biological sequences. Often, many similar biological sequences need to be made for a specific application meaning numerous, sometimes prohibitively expensive, lab experiments are necessary for their optimization. This paper presents a transfer learning design of experiments workflow to make this development feasible. By combining a transfer learning surrogate model with Bayesian optimization, we show how the total number of experiments can be reduced by sharing information between optimization tasks. We demonstrate the reduction in the number of experiments using data from the development of DNA competitors for use in an amplification-based diagnostic assay. We use cross-validation to compare the predictive accuracy of different transfer learning models, and then compare the performance of the models for both single objective and penalized optimization tasks.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
RamanSPy: An open-source Python package for integrative Raman spectroscopy data analysis
Authors:
Dimitar Georgiev,
Simon Vilms Pedersen,
Ruoxiao Xie,
Álvaro Fernández-Galiana,
Molly M. Stevens,
Mauricio Barahona
Abstract:
Raman spectroscopy is a non-destructive and label-free chemical analysis technique, which plays a key role in the analysis and discovery cycle of various branches of science. Nonetheless, progress in Raman spectroscopic analysis is still impeded by the lack of software, methodological and data standardisation, and the ensuing fragmentation and lack of reproducibility of analysis workflows thereof.…
▽ More
Raman spectroscopy is a non-destructive and label-free chemical analysis technique, which plays a key role in the analysis and discovery cycle of various branches of science. Nonetheless, progress in Raman spectroscopic analysis is still impeded by the lack of software, methodological and data standardisation, and the ensuing fragmentation and lack of reproducibility of analysis workflows thereof. To address these issues, we introduce RamanSPy, an open-source Python package for Raman spectroscopic research and analysis. RamanSPy provides a comprehensive library of ready-to-use tools for spectroscopic analysis, which streamlines day-to-day tasks, integrative analyses, as well as novel research and algorithmic development. RamanSPy is modular and open source, not tied to a particular technology or data format, and can be readily interfaced with the burgeoning ecosystem for data science, statistical analysis and machine learning in Python.
△ Less
Submitted 5 July, 2023;
originally announced July 2023.
-
Unsupervised hyperspectral data mining and bioimaging by information entropy and self-modeling curve resolution
Authors:
Simon Vilms Pedersen,
Anders R. Walther,
Anthony Callanan,
Molly M. Stevens,
Martin A. B. Hedegaard,
Eva C. Arnspang
Abstract:
Unsupervised estimation of the dimensionality of hyperspectral microspectroscopy datasets containing pure and mixed spectral features, and extraction of their representative endmember spectra, remains a challenge in biochemical data mining. We report a new versatile algorithm building on semi-nonnegativity constrained self-modeling curve resolution and information entropy, to estimate the quantity…
▽ More
Unsupervised estimation of the dimensionality of hyperspectral microspectroscopy datasets containing pure and mixed spectral features, and extraction of their representative endmember spectra, remains a challenge in biochemical data mining. We report a new versatile algorithm building on semi-nonnegativity constrained self-modeling curve resolution and information entropy, to estimate the quantity of separable biochemical species from hyperspectral microspectroscopy, and extraction of their representative spectra. The algorithm is benchmarked with established methods from satellite remote sensing, spectral unmixing, and clustering. To demonstrate the widespread applicability of the developed algorithm, we collected hyperspectral datasets using spontaneous Raman, Coherent Anti-stokes Raman Scattering and Fourier Transform IR, of seven reference compounds, an oil-in-water emulsion, and tissue-engineered extracellular matrices on poly-L-lactic acid and porcine jejunum-derived small intestine submucosa scaffolds seeded with bovine chondrocytes. We show the potential of the developed algorithm by consolidating hyperspectral molecular information with sample microstructure, pertinent to fields ranging from gastrophysics to regenerative medicine.
△ Less
Submitted 6 October, 2022;
originally announced October 2022.
-
High-throughput molecular imaging via deep learning enabled Raman spectroscopy
Authors:
Conor C. Horgan,
Magnus Jensen,
Anika Nagelkerke,
Jean-Phillipe St-Pierre,
Tom Vercauteren,
Molly M. Stevens,
Mads S. Bergholt
Abstract:
Raman spectroscopy enables non-destructive, label-free imaging with unprecedented molecular contrast but is limited by slow data acquisition, largely preventing high-throughput imaging applications. Here, we present a comprehensive framework for higher-throughput molecular imaging via deep learning enabled Raman spectroscopy, termed DeepeR, trained on a large dataset of hyperspectral Raman images,…
▽ More
Raman spectroscopy enables non-destructive, label-free imaging with unprecedented molecular contrast but is limited by slow data acquisition, largely preventing high-throughput imaging applications. Here, we present a comprehensive framework for higher-throughput molecular imaging via deep learning enabled Raman spectroscopy, termed DeepeR, trained on a large dataset of hyperspectral Raman images, with over 1.5 million spectra (400 hours of acquisition) in total. We firstly perform denoising and reconstruction of low signal-to-noise ratio Raman molecular signatures via deep learning, with a 9x improvement in mean squared error over state-of-the-art Raman filtering methods. Next, we develop a neural network for robust 2-4x super-resolution of hyperspectral Raman images that preserves molecular cellular information. Combining these approaches, we achieve Raman imaging speed-ups of up to 160x, enabling high resolution, high signal-to-noise ratio cellular imaging in under one minute. Finally, transfer learning is applied to extend DeepeR from cell to tissue-scale imaging. DeepeR provides a foundation that will enable a host of higher-throughput Raman spectroscopy and molecular imaging applications across biomedicine.
△ Less
Submitted 28 September, 2020;
originally announced September 2020.
-
Fluorescence-Guided Raman Spectroscopy for Tumour Margin Delineation
Authors:
Conor C. Horgan,
Mads S. Bergholt,
May Zaw Thin,
Anika Nagelkerke,
Robert Kennedy,
Tammy L. Kalber,
Daniel J. Stuckey,
Molly M. Stevens
Abstract:
The initial detection and identification of suspicious lesions and the precise delineation of tumour mar-gins are essential for successful tumour resection, with progression-free survival linked to rates of complete resection. However, post-surgical positive margin rates remain high for many cancers and despite numerous advances in intraoperative imaging and diagnostic technologies, there exists n…
▽ More
The initial detection and identification of suspicious lesions and the precise delineation of tumour mar-gins are essential for successful tumour resection, with progression-free survival linked to rates of complete resection. However, post-surgical positive margin rates remain high for many cancers and despite numerous advances in intraoperative imaging and diagnostic technologies, there exists no single modality that can adequately perform both tumoural detection and delineation. Here, we demonstrate a multimodal computer vision-based diagnostic system capable of both the gross detection and identification of suspicious lesions and the precise delineation of disease margins. We first show that through visual tracking of a spectroscopic probe, we enable real-time tumour margin delineation both for ex vivo human tumour biopsies and for an in vivo tumour xenograft mouse model. We then demonstrate that the combination of Raman spectroscopic diagnoses with protoporphyrin IX (PPIX) fluorescence imaging enables fluorescence-guided Raman spectroscopic margin delineation. Our fluorescence-guided Raman spectroscopic system achieves superior margin delineation accuracy to fluorescence imaging alone, demonstrating the potential for our system to achieve improved clinical outcomes for tumour resection surgeries.
△ Less
Submitted 24 September, 2020;
originally announced September 2020.
-
Integrated Photodynamic Raman Theranostics for Cancer Diagnosis, Treatment, and Post-Treatment Molecular Monitoring
Authors:
Conor C. Horgan,
Mads S. Bergholt,
Anika Nagelkerke,
May Zaw Thin,
Isaac J. Pence,
Ulrike Kauscher,
Tammy L. Kalber,
Daniel J. Stuckey,
Molly M. Stevens
Abstract:
Theranostics, the combination of diagnosis and therapy, has long held promise as a means to achieving personalised precision cancer treatments. However, despite its potential, theranostics has yet to realise significant clinical translation, largely due the complexity and overriding toxicity concerns of existing theranostic nanoparticle strategies. Here, we present an alternative nanoparticle-free…
▽ More
Theranostics, the combination of diagnosis and therapy, has long held promise as a means to achieving personalised precision cancer treatments. However, despite its potential, theranostics has yet to realise significant clinical translation, largely due the complexity and overriding toxicity concerns of existing theranostic nanoparticle strategies. Here, we present an alternative nanoparticle-free theranostic approach based on simultaneous Raman spectroscopy and photodynamic therapy (PDT) in an integrated clinical platform for cancer theranostics. We detail the compatibility of Raman spectroscopy and PDT for cancer theranostics, whereby Raman spectroscopic diagnosis can be performed on PDT photosensitiser-positive cells and tissues without inadvertent photosensitiser activation/photobleaching or impaired diagnostic capacity. We further demonstrate that our theranostic platform enables in vivo tumour diagnosis, treatment, and post-treatment molecular monitoring in real-time. This system thus achieves effective theranostic performance, providing a promising new avenue towards the clinical realisation of theranostics.
△ Less
Submitted 8 September, 2020;
originally announced September 2020.