-
Ensuring accurate stain reproduction in deep generative networks for virtual immunohistochemistry
Authors:
Christopher D. Walsh,
Joanne Edwards,
Robert H. Insall
Abstract:
Immunohistochemistry is a valuable diagnostic tool for cancer pathology. However, it requires specialist labs and equipment, is time-intensive, and is difficult to reproduce. Consequently, a long term aim is to provide a digital method of recreating physical immunohistochemical stains. Generative Adversarial Networks have become exceedingly advanced at map** one image type to another and have sh…
▽ More
Immunohistochemistry is a valuable diagnostic tool for cancer pathology. However, it requires specialist labs and equipment, is time-intensive, and is difficult to reproduce. Consequently, a long term aim is to provide a digital method of recreating physical immunohistochemical stains. Generative Adversarial Networks have become exceedingly advanced at map** one image type to another and have shown promise at inferring immunostains from haematoxylin and eosin. However, they have a substantial weakness when used with pathology images as they can fabricate structures that are not present in the original data. CycleGANs can mitigate invented tissue structures in pathology image map** but have a related disposition to generate areas of inaccurate staining. In this paper, we describe a modification to the loss function of a CycleGAN to improve its map** ability for pathology images by enforcing realistic stain replication while retaining tissue structure. Our approach improves upon others by considering structure and staining during model training. We evaluated our network using the Fréchet Inception distance, coupled with a new technique that we propose to appraise the accuracy of virtual immunohistochemistry. This assesses the overlap between each stain component in the inferred and ground truth images through colour deconvolution, thresholding and the Sorensen-Dice coefficient. Our modified loss function resulted in a Dice coefficient for the virtual stain of 0.78 compared with the real AE1/AE3 slide. This was superior to the unaltered CycleGAN's score of 0.74. Additionally, our loss function improved the Fréchet Inception distance for the reconstruction to 74.54 from 76.47. We, therefore, describe an advance in virtual restaining that can extend to other immunostains and tumour types and deliver reproducible, fast and readily accessible immunohistochemistry worldwide.
△ Less
Submitted 14 April, 2022;
originally announced April 2022.
-
OncoPetNet: A Deep Learning based AI system for mitotic figure counting on H&E stained whole slide digital images in a large veterinary diagnostic lab setting
Authors:
Michael Fitzke,
Derick Whitley,
Wilson Yau,
Fernando Rodrigues Jr,
Vladimir Fadeev,
Cindy Bacmeister,
Chris Carter,
Jeffrey Edwards,
Matthew P. Lungren,
Mark Parkinson
Abstract:
Background: Histopathology is an important modality for the diagnosis and management of many diseases in modern healthcare, and plays a critical role in cancer care. Pathology samples can be large and require multi-site sampling, leading to upwards of 20 slides for a single tumor, and the human-expert tasks of site selection and and quantitative assessment of mitotic figures are time consuming and…
▽ More
Background: Histopathology is an important modality for the diagnosis and management of many diseases in modern healthcare, and plays a critical role in cancer care. Pathology samples can be large and require multi-site sampling, leading to upwards of 20 slides for a single tumor, and the human-expert tasks of site selection and and quantitative assessment of mitotic figures are time consuming and subjective. Automating these tasks in the setting of a digital pathology service presents significant opportunities to improve workflow efficiency and augment human experts in practice. Approach: Multiple state-of-the-art deep learning techniques for histopathology image classification and mitotic figure detection were used in the development of OncoPetNet. Additionally, model-free approaches were used to increase speed and accuracy. The robust and scalable inference engine leverages Pytorch's performance optimizations as well as specifically developed speed up techniques in inference. Results: The proposed system, demonstrated significantly improved mitotic counting performance for 41 cancer cases across 14 cancer types compared to human expert baselines. In 21.9% of cases use of OncoPetNet led to change in tumor grading compared to human expert evaluation. In deployment, an effective 0.27 min/slide inference was achieved in a high throughput veterinary diagnostic pathology service across 2 centers processing 3,323 digital whole slide images daily. Conclusion: This work represents the first successful automated deployment of deep learning systems for real-time expert-level performance on important histopathology tasks at scale in a high volume clinical practice. The resulting impact outlines important considerations for model development, deployment, clinical decision making, and informs best practices for implementation of deep learning systems in digital histopathology practices.
△ Less
Submitted 17 August, 2021;
originally announced August 2021.
-
Analog Seizure Detection for Implanted Responsive Neurostimulation
Authors:
Abbas A. Zaki,
Noah C. Parker,
Tae-Yoon Kim,
Sam Ishak,
Ty E. Stovall,
Genchang Peng,
Hina Dave,
Jay Harvey,
Mehrdad Nourani,
Xuan Hu,
Alexander J. Edwards,
Joseph S. Friedman
Abstract:
Epilepsy can be treated with medication, however, $30\%$ of epileptic patients are still drug resistive. Devices like responsive neurostimluation systems are implanted in select patients who may not be amenable to surgical resection. However, state-of-the-art devices suffer from low accuracy and high sensitivity. We propose a novel patient-specific seizure detection system based on naïve Bayesian…
▽ More
Epilepsy can be treated with medication, however, $30\%$ of epileptic patients are still drug resistive. Devices like responsive neurostimluation systems are implanted in select patients who may not be amenable to surgical resection. However, state-of-the-art devices suffer from low accuracy and high sensitivity. We propose a novel patient-specific seizure detection system based on naïve Bayesian inference using Müller C-elements. The system improves upon the current leading neurostimulation device, NeuroPace's RNS by implementing analog signal processing for feature extraction, minimizing the power consumption compared to the digital counterpart.
Preliminary simulations were performed in MATLAB, demonstrating that through integrating multiple channels and features, up to $98\%$ detection accuracy for individual patients can be achieved. Similarly, power calculations were performed, demonstrating that the system uses $6.5 μW$ per channel, which when compared to the state-of-the-art NeuroPace system would increase battery life by up to $50 \%$.
△ Less
Submitted 11 June, 2021;
originally announced June 2021.
-
A Pulse Width Modulation based Power-elastic and Robust Mixed-signal Perceptron Design
Authors:
Sergey Mileiko,
Rishad Shafik,
Alex Yakovlev,
Jonathan Edwards
Abstract:
Neural networks are exerting burgeoning influence in emerging artificial intelligence applications at the micro-edge, such as sensing systems and image processing. As many of these systems are typically self-powered, their circuits are expected to be resilient and efficient in the presence of continuous power variations caused by the harvesters.
In this paper, we propose a novel mixed-signal (i.…
▽ More
Neural networks are exerting burgeoning influence in emerging artificial intelligence applications at the micro-edge, such as sensing systems and image processing. As many of these systems are typically self-powered, their circuits are expected to be resilient and efficient in the presence of continuous power variations caused by the harvesters.
In this paper, we propose a novel mixed-signal (i.e. analogue/digital) approach of designing a power-elastic perceptron using the principle of pulse width modulation (PWM). Fundamental to the design are a number of parallel inverters that transcode the input-weight pairs based on the principle of PWM duty cycle. Since PWM-based inverters are typically agnostic to amplitude and frequency variations, the perceptron shows a high degree of power elasticity and robustness under these variations. We show extensive design analysis in Cadence Analog Design Environment tool using a 3x3 perceptron circuit as a case study to demonstrate the resilience in the presence of parameric variations.
△ Less
Submitted 17 October, 2019;
originally announced October 2019.
-
The impact of high density receptor clusters on VEGF signaling
Authors:
Ye Chen,
Christopher Short,
Ádám M. Halász,
Jeremy S. Edwards
Abstract:
Vascular endothelial growth factor (VEGF) signaling is involved in the process of blood vessel development and maintenance. Signaling is initiated by binding of the bivalent VEGF ligand to the membrane-bound receptors (VEGFR), which in turn stimulates receptor dimerization. Herein, we discuss experimental evidence that VEGF receptors localize in caveloae and other regions of the plasma membrane,…
▽ More
Vascular endothelial growth factor (VEGF) signaling is involved in the process of blood vessel development and maintenance. Signaling is initiated by binding of the bivalent VEGF ligand to the membrane-bound receptors (VEGFR), which in turn stimulates receptor dimerization. Herein, we discuss experimental evidence that VEGF receptors localize in caveloae and other regions of the plasma membrane, and for other receptors, it has been shown that receptor clustering has an impact on dimerization and thus also on signaling. Overall, receptor clustering is part of a complex ecosystem of interactions and how receptor clustering impacts dimerization is not well understood. To address these questions, we have formulated the simplest possible model. We have postulated the existence of a single high affinity region in the cell membrane, which acts as a transient trap for receptors. We have defined an ODE model by introducing high- and low-density receptor variables and introduce the corresponding reactions from a realistic model of VEGF signal initiation. Finally, we use the model to investigate the relation between the degree of VEGFR concentration, ligand availability, and signaling. In conclusion, our simulation results provide a deeper understanding of the role of receptor clustering in cell signaling.
△ Less
Submitted 3 September, 2013;
originally announced September 2013.
