-
Critical Evaluation of Artificial Intelligence as Digital Twin of Pathologist for Prostate Cancer Pathology
Authors:
Okyaz Eminaga,
Mahmoud Abbas,
Christian Kunder,
Yuri Tolkach,
Ryan Han,
James D. Brooks,
Rosalie Nolley,
Axel Semjonow,
Martin Boegemann,
Robert West,
** Long,
Richard Fan,
Olaf Bettendorf
Abstract:
Prostate cancer pathology plays a crucial role in clinical management but is time-consuming. Artificial intelligence (AI) shows promise in detecting prostate cancer and grading patterns. We tested an AI-based digital twin of a pathologist, vPatho, on 2,603 histology images of prostate tissue stained with hematoxylin and eosin. We analyzed various factors influencing tumor-grade disagreement betwee…
▽ More
Prostate cancer pathology plays a crucial role in clinical management but is time-consuming. Artificial intelligence (AI) shows promise in detecting prostate cancer and grading patterns. We tested an AI-based digital twin of a pathologist, vPatho, on 2,603 histology images of prostate tissue stained with hematoxylin and eosin. We analyzed various factors influencing tumor-grade disagreement between vPatho and six human pathologists. Our results demonstrated that vPatho achieved comparable performance in prostate cancer detection and tumor volume estimation, as reported in the literature. Concordance levels between vPatho and human pathologists were examined. Notably, moderate to substantial agreement was observed in identifying complementary histological features such as ductal, cribriform, nerve, blood vessels, and lymph cell infiltrations. However, concordance in tumor grading showed a decline when applied to prostatectomy specimens (kappa = 0.44) compared to biopsy cores (kappa = 0.70). Adjusting the decision threshold for the secondary Gleason pattern from 5% to 10% improved the concordance level between pathologists and vPatho for tumor grading on prostatectomy specimens (kappa from 0.44 to 0.64). Potential causes of grade discordance included the vertical extent of tumors toward the prostate boundary and the proportions of slides with prostate cancer. Gleason pattern 4 was particularly associated with discordance. Notably, grade discordance with vPatho was not specific to any of the six pathologists involved in routine clinical grading. In conclusion, our study highlights the potential utility of AI in develo** a digital twin of a pathologist. This approach can help uncover limitations in AI adoption and the current grading system for prostate cancer pathology.
△ Less
Submitted 23 August, 2023;
originally announced August 2023.
-
Conceptual Framework and Documentation Standards of Cystoscopic Media Content for Artificial Intelligence
Authors:
Okyaz Eminaga,
Timothy Jiyong Lee,
Jessie Ge,
Eugene Shkolyar,
Mark Laurie,
** Long,
Lukas Graham Hockman,
Joseph C. Liao
Abstract:
Background: The clinical documentation of cystoscopy includes visual and textual materials. However, the secondary use of visual cystoscopic data for educational and research purposes remains limited due to inefficient data management in routine clinical practice. Methods: A conceptual framework was designed to document cystoscopy in a standardized manner with three major sections: data management…
▽ More
Background: The clinical documentation of cystoscopy includes visual and textual materials. However, the secondary use of visual cystoscopic data for educational and research purposes remains limited due to inefficient data management in routine clinical practice. Methods: A conceptual framework was designed to document cystoscopy in a standardized manner with three major sections: data management, annotation management, and utilization management. A Swiss-cheese model was proposed for quality control and root cause analyses. We defined the infrastructure required to implement the framework with respect to FAIR (findable, accessible, interoperable, re-usable) principles. We applied two scenarios exemplifying data sharing for research and educational projects to ensure the compliance with FAIR principles. Results: The framework was successfully implemented while following FAIR principles. The cystoscopy atlas produced from the framework could be presented in an educational web portal; a total of 68 full-length qualitative videos and corresponding annotation data were sharable for artificial intelligence projects covering frame classification and segmentation problems at case, lesion and frame levels. Conclusion: Our study shows that the proposed framework facilitates the storage of the visual documentation in a standardized manner and enables FAIR data for education and artificial intelligence research.
△ Less
Submitted 18 January, 2023; v1 submitted 14 January, 2023;
originally announced January 2023.
-
Causal Models, Prediction, and Extrapolation in Cell Line Perturbation Experiments
Authors:
James P. Long,
Yumeng Yang,
Kim-Anh Do
Abstract:
In cell line perturbation experiments, a collection of cells is perturbed with external agents (e.g. drugs) and responses such as protein expression measured. Due to cost constraints, only a small fraction of all possible perturbations can be tested in vitro. This has led to the development of computational (in silico) models which can predict cellular responses to perturbations. Perturbations wit…
▽ More
In cell line perturbation experiments, a collection of cells is perturbed with external agents (e.g. drugs) and responses such as protein expression measured. Due to cost constraints, only a small fraction of all possible perturbations can be tested in vitro. This has led to the development of computational (in silico) models which can predict cellular responses to perturbations. Perturbations with clinically interesting predicted responses can be prioritized for in vitro testing. In this work, we compare causal and non-causal regression models for perturbation response prediction in a Melanoma cancer cell line. The current best performing method on this data set is Cellbox which models how proteins causally effect each other using a system of ordinary differential equations (ODEs). We derive a closed form solution to the Cellbox system of ODEs in the linear case. These analytic results facilitate comparison of Cellbox to regression approaches. We show that causal models such as Cellbox, while requiring more assumptions, enable extrapolation in ways that non-causal regression models cannot. For example, causal models can predict responses for never before tested drugs. We illustrate these strengths and weaknesses in simulations. In an application to the Melanoma cell line data, we find that regression models outperform the Cellbox causal model.
△ Less
Submitted 20 July, 2022;
originally announced July 2022.
-
Non-genetic diversity modulates population performance
Authors:
Adam James Waite,
Nicholas W. Frankel,
Yann S. Dufour,
Jessica F. Johnston,
Junjiajia Long,
Thierry Emonet
Abstract:
Biological functions are typically performed by groups of cells that express predominantly the same genes, yet display a continuum of phenotypes. While it is known how one genotype can generate such non-genetic diversity, it remains unclear how different phenotypes contribute to the performance of biological function at the population level. We developed a microfluidic device to simultaneously mea…
▽ More
Biological functions are typically performed by groups of cells that express predominantly the same genes, yet display a continuum of phenotypes. While it is known how one genotype can generate such non-genetic diversity, it remains unclear how different phenotypes contribute to the performance of biological function at the population level. We developed a microfluidic device to simultaneously measure the phenotype and chemotactic performance of tens of thousands of individual, freely-swimming Escherichia coli as they climbed a gradient of attractant. We discovered that spatial structure spontaneously emerged from initially well-mixed wild type populations due to non-genetic diversity. By manipulating the expression of key chemotaxis proteins, we established a causal relationship between protein expression, non- genetic diversity, and performance that was theoretically predicted. This approach generated a complete phenotype-to-performance map, in which we found a nonlinear regime. We used this map to demonstrate how changing the shape of a phenotypic distribution can have as large of an effect on collective performance as changing the mean phenotype, suggesting that selection could act on both during the process of adaptation.
△ Less
Submitted 3 January, 2017;
originally announced January 2017.
-
Feedback Between Motion and Sensation Provides Nonlinear Boost in Run-and-tumble Navigation
Authors:
Junjiajia Long,
Steven W. Zucker,
Thierry Emonet
Abstract:
Many organisms navigate gradients by alternating straight motions (runs) with random reorientations (tumbles), transiently suppressing tumbles whenever attractant signal increases. This induces a functional coupling between movement and sensation, since tumbling probability is controlled by the internal state of the organism which, in turn, depends on previous signal levels. Although a negative fe…
▽ More
Many organisms navigate gradients by alternating straight motions (runs) with random reorientations (tumbles), transiently suppressing tumbles whenever attractant signal increases. This induces a functional coupling between movement and sensation, since tumbling probability is controlled by the internal state of the organism which, in turn, depends on previous signal levels. Although a negative feedback tends to maintain this internal state close to adapted levels, positive feedback can arise when motion up the gradient reduces tumbling probability, further boosting drift up the gradient. Importantly, such positive feedback can drive large fluctuations in the internal state, complicating analytical approaches. Previous studies focused on what happens when the negative feedback dominates the dynamics. By contrast, we show here that there is a large portion of physiologically-relevant parameter space where the positive feedback can dominate, even when gradients are relatively shallow. We demonstrate how large transients emerge because of non-normal dynamics (non-orthogonal eigenvectors near a stable fixed point) inherent in the positive feedback, and further identify a fundamental nonlinearity that strongly amplifies their effect. Most importantly, this amplification is asymmetric, elongating runs in favorable directions and abbreviating others. The result is a "ratchet-like" gradient climbing behavior with drift speeds that can approach half the maximum run speed of the organism. Our results thus show that the classical drawback of run-and-tumble navigation --- wasteful runs in the wrong direction --- can be mitigated by exploiting the non-normal dynamics implicit in the run-and-tumble strategy.
△ Less
Submitted 22 February, 2017; v1 submitted 10 May, 2016;
originally announced May 2016.
-
Adaptability of non-genetic diversity in bacterial chemotaxis
Authors:
Nicholas W Frankel,
William Pontius,
Yann S Dufour,
Junjiajia Long,
Luis Hernandez- Nunez,
Thierry Emonet
Abstract:
Bacterial chemotaxis systems are as diverse as the environments that bacteria inhabit, but how much environmental variation can cells tolerate with a single system? Diversification of a single chemotaxis system could serve as an alternative, or even evolutionary step**-stone, to switching between multiple systems. We hypothesized that mutations in gene regulation could lead to heritable control…
▽ More
Bacterial chemotaxis systems are as diverse as the environments that bacteria inhabit, but how much environmental variation can cells tolerate with a single system? Diversification of a single chemotaxis system could serve as an alternative, or even evolutionary step**-stone, to switching between multiple systems. We hypothesized that mutations in gene regulation could lead to heritable control of chemotactic diversity. By simulating foraging and colonization of E. coli using a single-cell chemotaxis model, we found that different environments selected for different behaviors. The resulting trade-offs show that populations facing diverse environments would ideally diversify behaviors when time for navigation is limited. We show that advantageous diversity can arise from changes in the distribution of protein levels among individuals, which could occur through mutations in gene regulation. We propose experiments to test our prediction that chemotactic diversity in a clonal population could be a selectable trait that enables adaptation to environmental variability.
△ Less
Submitted 25 November, 2015;
originally announced November 2015.
-
Map** neuron positions to curved cortical surfaces
Authors:
**tao Long,
Richard Tomsett,
Marcus Kaiser
Abstract:
Real cortical tissue curves and folds according to experimental data. However, our current simulations only use unfolded cortical layers. This project extends the cortical slice model in order to be able to specify arbitrary curvatures to the cortical layers and investigate the effect of curvature and folding on neuron density and layer morphology.
Real cortical tissue curves and folds according to experimental data. However, our current simulations only use unfolded cortical layers. This project extends the cortical slice model in order to be able to specify arbitrary curvatures to the cortical layers and investigate the effect of curvature and folding on neuron density and layer morphology.
△ Less
Submitted 13 May, 2014;
originally announced May 2014.