-
Virtual Histology with Photon Absorption Remote Sensing using a Cycle-Consistent Generative Adversarial Network with Weakly Registered Pairs
Authors:
James E. D. Tweel,
Benjamin R. Ecclestone,
Marian Boktor,
James Alexander Tummon Simmons,
Paul Fieguth,
Parsin Haji Reza
Abstract:
Modern histopathology relies on the microscopic examination of thin tissue sections stained with histochemical techniques, typically using brightfield or fluorescence microscopy. However, the staining of samples can permanently alter their chemistry and structure, meaning an individual tissue section must be prepared for each desired staining contrast. This not only consumes valuable tissue sample…
▽ More
Modern histopathology relies on the microscopic examination of thin tissue sections stained with histochemical techniques, typically using brightfield or fluorescence microscopy. However, the staining of samples can permanently alter their chemistry and structure, meaning an individual tissue section must be prepared for each desired staining contrast. This not only consumes valuable tissue samples but also introduces delays in essential diagnostic timelines. In this work, virtual histochemical staining is developed using label-free photon absorption remote sensing (PARS) microscopy. We present a method that generates virtually stained histology images that are indistinguishable from the gold standard hematoxylin and eosin (H&E) staining. First, PARS label-free ultraviolet absorption images are captured directly within unstained tissue specimens. The radiative and non-radiative absorption images are then preprocessed, and virtually stained through the presented pathway. The preprocessing pipeline features a self-supervised Noise2Void denoising convolutional neural network (CNN) as well as a novel algorithm for pixel-level mechanical scanning error correction. These developments significantly enhance the recovery of sub-micron tissue structures, such as nucleoli location and chromatin distribution. Finally, we used a cycle-consistent generative adversarial network CycleGAN architecture to virtually stain the preprocessed PARS data. Virtual staining is applied to thin unstained sections of malignant human skin and breast tissue samples. Clinically relevant details are revealed, with comparable contrast and quality to gold standard H&E-stained images. This work represents a crucial step to deploying label-free microscopy as an alternative to standard histopathology techniques.
△ Less
Submitted 26 June, 2023; v1 submitted 14 June, 2023;
originally announced June 2023.
-
SignalKG: Towards Reasoning about the Underlying Causes of Sensor Observations
Authors:
Anj Simmons,
Rajesh Vasa,
Antonio Giardina
Abstract:
This paper demonstrates our vision for knowledge graphs that assist machines to reason about the cause of signals observed by sensors. We show how the approach allows for constructing smarter surveillance systems that reason about the most likely cause (e.g., an attacker breaking a window) of a signal rather than acting directly on the received signal without consideration for how it was produced.
This paper demonstrates our vision for knowledge graphs that assist machines to reason about the cause of signals observed by sensors. We show how the approach allows for constructing smarter surveillance systems that reason about the most likely cause (e.g., an attacker breaking a window) of a signal rather than acting directly on the received signal without consideration for how it was produced.
△ Less
Submitted 31 August, 2022; v1 submitted 10 August, 2022;
originally announced August 2022.
-
Signal Knowledge Graph
Authors:
Anj Simmons,
Rajesh Vasa
Abstract:
This paper presents an knowledge graph to assist in reasoning over signals for intelligence purposes. We highlight limitations of existing knowledge graphs and reasoning systems for this purpose, using inference of an attack using combined data from microphones, cameras and social media as an example. Rather than acting directly on the received signal, our approach considers attacker behaviour, si…
▽ More
This paper presents an knowledge graph to assist in reasoning over signals for intelligence purposes. We highlight limitations of existing knowledge graphs and reasoning systems for this purpose, using inference of an attack using combined data from microphones, cameras and social media as an example. Rather than acting directly on the received signal, our approach considers attacker behaviour, signal emission, receiver characteristics, and how signals are summarised to support inferring the underlying cause of the signal.
△ Less
Submitted 24 June, 2022;
originally announced June 2022.
-
Target Geometry Estimation Using Deep Neural Networks in Sonar Sensing
Authors:
Chen Ming,
James A. Simmons
Abstract:
Accurate imaging of target shape is a crucial aspect of wideband FM biosonar in echolocating bats, for which we have developed new algorithms that provide a solution for the shape of complicated targets in the computational domain. We use recurrent neural networks and convolutional neural networks to determine the number of glints (i.e., major reflecting surfaces) making up the target's structure…
▽ More
Accurate imaging of target shape is a crucial aspect of wideband FM biosonar in echolocating bats, for which we have developed new algorithms that provide a solution for the shape of complicated targets in the computational domain. We use recurrent neural networks and convolutional neural networks to determine the number of glints (i.e., major reflecting surfaces) making up the target's structure and the distances between the glints (target shape in sonar). Echoes are dechirped relative to broadcasts, and the dechirped spectrograms are scanned in short time segments to find local spectral ripple patterns arising from different interglint delay separations. By proceeding in successive time-window slices, we mimic time-frequency neural processing in the bat's auditory system as a novel means of real-time target discrimination for sonar sensing in robotics.
△ Less
Submitted 29 March, 2022;
originally announced March 2022.
-
A reliability measure for smart surveillance systems
Authors:
Anj Simmons
Abstract:
We present a reliability measure for smart surveillance systems, taking into account the adversarial nature of intrusion. Our approach is based on percolation theory and is a generalisation of Hamedmoghadam et al.'s reliability measure. Specifically, our approach incorporates a customisable cost function to allow modelling a diverse range of situations, such as access restrictions, monitoring, and…
▽ More
We present a reliability measure for smart surveillance systems, taking into account the adversarial nature of intrusion. Our approach is based on percolation theory and is a generalisation of Hamedmoghadam et al.'s reliability measure. Specifically, our approach incorporates a customisable cost function to allow modelling a diverse range of situations, such as access restrictions, monitoring, and failures. We demonstrate our approach by applying it to a digital twin of a smart building. However, challenges remain in estimating and modelling the key parameters needed.
△ Less
Submitted 16 March, 2022; v1 submitted 18 February, 2022;
originally announced February 2022.
-
In vivo functional and structural retina imaging using multimodal photoacoustic remote sensing microscopy and optical coherence tomography
Authors:
Zohreh Hosseinaee,
Nicholas Pellegrino,
Nima Abbasi,
Tara Amiri,
James A. Tummon Simmons,
Paul Fieguth,
Parsin Haji Reza
Abstract:
We have developed a multimodal photoacoustic remote sensing (PARS) microscope combined with swept source optical coherence tomography for in vivo, non-contact retinal imaging. Building on the proven strength of multiwavelength PARS imaging, the system is applied for estimating retinal oxygen saturation in the rat retina. The capability of the technology is demonstrated by imaging both microanatomy…
▽ More
We have developed a multimodal photoacoustic remote sensing (PARS) microscope combined with swept source optical coherence tomography for in vivo, non-contact retinal imaging. Building on the proven strength of multiwavelength PARS imaging, the system is applied for estimating retinal oxygen saturation in the rat retina. The capability of the technology is demonstrated by imaging both microanatomy and the microvasculature of the retina in vivo. To our knowledge this is the first time a non-contact photoacoustic imaging technique is employed for in vivo oxygen saturation measurement in the retina.
△ Less
Submitted 25 August, 2021;
originally announced August 2021.
-
The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort study
Authors:
Gustav Mårtensson,
Daniel Ferreira,
Tobias Granberg,
Lena Cavallin,
Ketil Oppedal,
Alessandro Padovani,
Irena Rektorova,
Laura Bonanni,
Matteo Pardini,
Milica Kramberger,
John-Paul Taylor,
Jakub Hort,
Jón Snædal,
Jaime Kulisevsky,
Frederic Blanc,
Angelo Antonini,
Patrizia Mecocci,
Bruno Vellas,
Magda Tsolaki,
Iwona Kłoszewska,
Hilkka Soininen,
Simon Lovestone,
Andrew Simmons,
Dag Aarsland,
Eric Westman
Abstract:
Deep learning (DL) methods have in recent years yielded impressive results in medical imaging, with the potential to function as clinical aid to radiologists. However, DL models in medical imaging are often trained on public research cohorts with images acquired with a single scanner or with strict protocol harmonization, which is not representative of a clinical setting. The aim of this study was…
▽ More
Deep learning (DL) methods have in recent years yielded impressive results in medical imaging, with the potential to function as clinical aid to radiologists. However, DL models in medical imaging are often trained on public research cohorts with images acquired with a single scanner or with strict protocol harmonization, which is not representative of a clinical setting. The aim of this study was to investigate how well a DL model performs in unseen clinical data sets---collected with different scanners, protocols and disease populations---and whether more heterogeneous training data improves generalization. In total, 3117 MRI scans of brains from multiple dementia research cohorts and memory clinics, that had been visually rated by a neuroradiologist according to Scheltens' scale of medial temporal atrophy (MTA), were included in this study. By training multiple versions of a convolutional neural network on different subsets of this data to predict MTA ratings, we assessed the impact of including images from a wider distribution during training had on performance in external memory clinic data. Our results showed that our model generalized well to data sets acquired with similar protocols as the training data, but substantially worse in clinical cohorts with visibly different tissue contrasts in the images. This implies that future DL studies investigating performance in out-of-distribution (OOD) MRI data need to assess multiple external cohorts for reliable results. Further, by including data from a wider range of scanners and protocols the performance improved in OOD data, which suggests that more heterogeneous training data makes the model generalize better. To conclude, this is the most comprehensive study to date investigating the domain shift in deep learning on MRI data, and we advocate rigorous evaluation of DL models on clinical data prior to being certified for deployment.
△ Less
Submitted 1 November, 2019;
originally announced November 2019.
