-
Autonomous Quality and Hallucination Assessment for Virtual Tissue Staining and Digital Pathology
Authors:
Luzhe Huang,
Yuzhu Li,
Nir Pillar,
Tal Keidar Haran,
William Dean Wallace,
Aydogan Ozcan
Abstract:
Histopathological staining of human tissue is essential in the diagnosis of various diseases. The recent advances in virtual tissue staining technologies using AI alleviate some of the costly and tedious steps involved in the traditional histochemical staining process, permitting multiplexed rapid staining of label-free tissue without using staining reagents, while also preserving tissue. However,…
▽ More
Histopathological staining of human tissue is essential in the diagnosis of various diseases. The recent advances in virtual tissue staining technologies using AI alleviate some of the costly and tedious steps involved in the traditional histochemical staining process, permitting multiplexed rapid staining of label-free tissue without using staining reagents, while also preserving tissue. However, potential hallucinations and artifacts in these virtually stained tissue images pose concerns, especially for the clinical utility of these approaches. Quality assessment of histology images is generally performed by human experts, which can be subjective and depends on the training level of the expert. Here, we present an autonomous quality and hallucination assessment method (termed AQuA), mainly designed for virtual tissue staining, while also being applicable to histochemical staining. AQuA achieves 99.8% accuracy when detecting acceptable and unacceptable virtually stained tissue images without access to ground truth, also presenting an agreement of 98.5% with the manual assessments made by board-certified pathologists. Besides, AQuA achieves super-human performance in identifying realistic-looking, virtually stained hallucinatory images that would normally mislead human diagnosticians by deceiving them into diagnosing patients that never existed. We further demonstrate the wide adaptability of AQuA across various virtually and histochemically stained tissue images and showcase its strong external generalization to detect unseen hallucination patterns of virtual staining network models as well as artifacts observed in the traditional histochemical staining workflow. This framework creates new opportunities to enhance the reliability of virtual staining and will provide quality assurance for various image generation and transformation tasks in digital pathology and computational imaging.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Automated HER2 Scoring in Breast Cancer Images Using Deep Learning and Pyramid Sampling
Authors:
Sahan Yoruc Selcuk,
Xilin Yang,
Bijie Bai,
Yijie Zhang,
Yuzhu Li,
Musa Aydin,
Aras Firat Unal,
Aditya Gomatam,
Zhen Guo,
Darrow Morgan Angus,
Goren Kolodney,
Karine Atlan,
Tal Keidar Haran,
Nir Pillar,
Aydogan Ozcan
Abstract:
Human epidermal growth factor receptor 2 (HER2) is a critical protein in cancer cell growth that signifies the aggressiveness of breast cancer (BC) and helps predict its prognosis. Accurate assessment of immunohistochemically (IHC) stained tissue slides for HER2 expression levels is essential for both treatment guidance and understanding of cancer mechanisms. Nevertheless, the traditional workflow…
▽ More
Human epidermal growth factor receptor 2 (HER2) is a critical protein in cancer cell growth that signifies the aggressiveness of breast cancer (BC) and helps predict its prognosis. Accurate assessment of immunohistochemically (IHC) stained tissue slides for HER2 expression levels is essential for both treatment guidance and understanding of cancer mechanisms. Nevertheless, the traditional workflow of manual examination by board-certified pathologists encounters challenges, including inter- and intra-observer inconsistency and extended turnaround times. Here, we introduce a deep learning-based approach utilizing pyramid sampling for the automated classification of HER2 status in IHC-stained BC tissue images. Our approach analyzes morphological features at various spatial scales, efficiently managing the computational load and facilitating a detailed examination of cellular and larger-scale tissue-level details. This method addresses the tissue heterogeneity of HER2 expression by providing a comprehensive view, leading to a blind testing classification accuracy of 84.70%, on a dataset of 523 core images from tissue microarrays. Our automated system, proving reliable as an adjunct pathology tool, has the potential to enhance diagnostic precision and evaluation speed, and might significantly impact cancer treatment planning.
△ Less
Submitted 31 March, 2024;
originally announced April 2024.
-
Virtual histological staining of unlabeled autopsy tissue
Authors:
Yuzhu Li,
Nir Pillar,
**gxi Li,
Tairan Liu,
Di Wu,
Songyu Sun,
Guangdong Ma,
Kevin de Haan,
Luzhe Huang,
Sepehr Hamidi,
Anatoly Urisman,
Tal Keidar Haran,
William Dean Wallace,
Jonathan E. Zuckerman,
Aydogan Ozcan
Abstract:
Histological examination is a crucial step in an autopsy; however, the traditional histochemical staining of post-mortem samples faces multiple challenges, including the inferior staining quality due to autolysis caused by delayed fixation of cadaver tissue, as well as the resource-intensive nature of chemical staining procedures covering large tissue areas, which demand substantial labor, cost, a…
▽ More
Histological examination is a crucial step in an autopsy; however, the traditional histochemical staining of post-mortem samples faces multiple challenges, including the inferior staining quality due to autolysis caused by delayed fixation of cadaver tissue, as well as the resource-intensive nature of chemical staining procedures covering large tissue areas, which demand substantial labor, cost, and time. These challenges can become more pronounced during global health crises when the availability of histopathology services is limited, resulting in further delays in tissue fixation and more severe staining artifacts. Here, we report the first demonstration of virtual staining of autopsy tissue and show that a trained neural network can rapidly transform autofluorescence images of label-free autopsy tissue sections into brightfield equivalent images that match hematoxylin and eosin (H&E) stained versions of the same samples, eliminating autolysis-induced severe staining artifacts inherent in traditional histochemical staining of autopsied tissue. Our virtual H&E model was trained using >0.7 TB of image data and a data-efficient collaboration scheme that integrates the virtual staining network with an image registration network. The trained model effectively accentuated nuclear, cytoplasmic and extracellular features in new autopsy tissue samples that experienced severe autolysis, such as COVID-19 samples never seen before, where the traditional histochemical staining failed to provide consistent staining quality. This virtual autopsy staining technique can also be extended to necrotic tissue, and can rapidly and cost-effectively generate artifact-free H&E stains despite severe autolysis and cell death, also reducing labor, cost and infrastructure requirements associated with the standard histochemical staining.
△ Less
Submitted 1 August, 2023;
originally announced August 2023.
-
Impact of Aviation Electrification on Airports: Flight Scheduling and Charging
Authors:
Boya Hou,
Subhonmesh Bose,
Lavanya Marla,
Kiruba Haran
Abstract:
Electrification can help to reduce the carbon footprint of aviation. The transition away from jet fuel-powered conventional airplane towards battery-powered electrified aircraft will impose extra charging requirements on airports. In this paper, we first quantify the increase in energy demands at several airports across the United States (US), when commercial airline carriers partially deploy hybr…
▽ More
Electrification can help to reduce the carbon footprint of aviation. The transition away from jet fuel-powered conventional airplane towards battery-powered electrified aircraft will impose extra charging requirements on airports. In this paper, we first quantify the increase in energy demands at several airports across the United States (US), when commercial airline carriers partially deploy hybrid electric aircraft (HEA). We then illustrate that smart charging and minor modifications to flight schedules can substantially reduce peak power demands, and in turn the needs for grid infrastructure upgrade. Motivated by our data analysis, we then formulate an optimization problem for slot allocation that incorporates HEA charging considerations. This problem jointly decides flight schedules and charging profiles to manage airport congestion and peak power demands. We illustrate the efficacy of our formulation through a case study on the John F. Kennedy International Airport.
△ Less
Submitted 31 May, 2022; v1 submitted 19 August, 2021;
originally announced August 2021.
