-
Graph Neural Networks in Histopathology: Emerging Trends and Future Directions
Authors:
Siemen Brussee,
Giorgio Buzzanca,
Anne M. R. Schrader,
Jesper Kers
Abstract:
Histopathological analysis of Whole Slide Images (WSIs) has seen a surge in the utilization of deep learning methods, particularly Convolutional Neural Networks (CNNs). However, CNNs often fall short in capturing the intricate spatial dependencies inherent in WSIs. Graph Neural Networks (GNNs) present a promising alternative, adept at directly modeling pairwise interactions and effectively discern…
▽ More
Histopathological analysis of Whole Slide Images (WSIs) has seen a surge in the utilization of deep learning methods, particularly Convolutional Neural Networks (CNNs). However, CNNs often fall short in capturing the intricate spatial dependencies inherent in WSIs. Graph Neural Networks (GNNs) present a promising alternative, adept at directly modeling pairwise interactions and effectively discerning the topological tissue and cellular structures within WSIs. Recognizing the pressing need for deep learning techniques that harness the topological structure of WSIs, the application of GNNs in histopathology has experienced rapid growth. In this comprehensive review, we survey GNNs in histopathology, discuss their applications, and explore emerging trends that pave the way for future advancements in the field. We begin by elucidating the fundamentals of GNNs and their potential applications in histopathology. Leveraging quantitative literature analysis, we identify four emerging trends: Hierarchical GNNs, Adaptive Graph Structure Learning, Multimodal GNNs, and Higher-order GNNs. Through an in-depth exploration of these trends, we offer insights into the evolving landscape of GNNs in histopathological analysis. Based on our findings, we propose future directions to propel the field forward. Our analysis serves to guide researchers and practitioners towards innovative approaches and methodologies, fostering advancements in histopathological analysis through the lens of graph neural networks.
△ Less
Submitted 21 June, 2024; v1 submitted 18 June, 2024;
originally announced June 2024.
-
Technological Challenges of Ambient Serious Games in Higher Education
Authors:
Lea C. Brandl,
Börge Kordts,
Andreas Schrader
Abstract:
Naturally, university courses should be designed to attract students, engaging them to achieve learning goals. Toward this end, the use of Serious Games has been proposed in the literature. To address positive effects, such as content memorability and attendance rates, we propose Ambient Serious Games as games embedded in a computer-enriched environment, which is only partially perceived mentally…
▽ More
Naturally, university courses should be designed to attract students, engaging them to achieve learning goals. Toward this end, the use of Serious Games has been proposed in the literature. To address positive effects, such as content memorability and attendance rates, we propose Ambient Serious Games as games embedded in a computer-enriched environment, which is only partially perceived mentally by players. In this paper, we describe five technological key challenges that must be overcome to seamlessly and beneficially integrate an Ambient Serious Game into teaching. These challenges, derived from a scenario, focus on the technological provision and conduct of such games based on a software platform. They include (1) the integration of physical smart learning objects in heterogeneous environments under dynamic constraints, (2) the representation of abstract subject matter using smart learning objects, (3) the guided or automatic connection of all involved components, (4) the explanation of the components, their interaction, as well as the serious game itself, and (5) feedback on the game state.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
-
Ontologies for increasing the FAIRness of plant research data
Authors:
Kathryn Dumschott,
Hannah Dörpholz,
Marie-Angélique Laporte,
Dominik Brilhaus,
Andrea Schrader,
Björn Usadel,
Steffen Neumann,
Elizabeth Arnaud,
Angela Kranz
Abstract:
The importance of improving the FAIRness (findability, accessibility, interoperability, reusability) of research data is undeniable, especially in the face of large, complex datasets currently being produced by omics technologies. Facilitating the integration of a dataset with other types of data increases the likelihood of reuse, and the potential of answering novel research questions. Ontologies…
▽ More
The importance of improving the FAIRness (findability, accessibility, interoperability, reusability) of research data is undeniable, especially in the face of large, complex datasets currently being produced by omics technologies. Facilitating the integration of a dataset with other types of data increases the likelihood of reuse, and the potential of answering novel research questions. Ontologies are a useful tool for semantically tagging datasets as adding relevant metadata increases the understanding of how data was produced and increases its interoperability. Ontologies provide concepts for a particular domain as well as the relationships between concepts. By tagging data with ontology terms, data becomes both human and machine interpretable, allowing for increased reuse and interoperability. However, the task of identifying ontologies relevant to a particular research domain or technology is challenging, especially within the diverse realm of fundamental plant research. In this review, we outline the ontologies most relevant to the fundamental plant sciences and how they can be used to annotate data related to plant-specific experiments within metadata frameworks, such as Investigation-Study-Assay (ISA). We also outline repositories and platforms most useful for identifying applicable ontologies or finding ontology terms.
△ Less
Submitted 25 August, 2023;
originally announced September 2023.
-
Anatomy-informed Data Augmentation for Enhanced Prostate Cancer Detection
Authors:
Balint Kovacs,
Nils Netzer,
Michael Baumgartner,
Carolin Eith,
Dimitrios Bounias,
Clara Meinzer,
Paul F. Jaeger,
Kevin S. Zhang,
Ralf Floca,
Adrian Schrader,
Fabian Isensee,
Regula Gnirs,
Magdalena Goertz,
Viktoria Schuetz,
Albrecht Stenzinger,
Markus Hohenfellner,
Heinz-Peter Schlemmer,
Ivo Wolf,
David Bonekamp,
Klaus H. Maier-Hein
Abstract:
Data augmentation (DA) is a key factor in medical image analysis, such as in prostate cancer (PCa) detection on magnetic resonance images. State-of-the-art computer-aided diagnosis systems still rely on simplistic spatial transformations to preserve the pathological label post transformation. However, such augmentations do not substantially increase the organ as well as tumor shape variability in…
▽ More
Data augmentation (DA) is a key factor in medical image analysis, such as in prostate cancer (PCa) detection on magnetic resonance images. State-of-the-art computer-aided diagnosis systems still rely on simplistic spatial transformations to preserve the pathological label post transformation. However, such augmentations do not substantially increase the organ as well as tumor shape variability in the training set, limiting the model's ability to generalize to unseen cases with more diverse localized soft-tissue deformations. We propose a new anatomy-informed transformation that leverages information from adjacent organs to simulate typical physiological deformations of the prostate and generates unique lesion shapes without altering their label. Due to its lightweight computational requirements, it can be easily integrated into common DA frameworks. We demonstrate the effectiveness of our augmentation on a dataset of 774 biopsy-confirmed examinations, by evaluating a state-of-the-art method for PCa detection with different augmentation settings.
△ Less
Submitted 7 September, 2023;
originally announced September 2023.
