-
Deployment of Deep Learning Model in Real World Clinical Setting: A Case Study in Obstetric Ultrasound
Authors:
Chun Kit Wong,
Mary Ngo,
Manxi Lin,
Zahra Bashir,
Amihai Heen,
Morten Bo Søndergaard Svendsen,
Martin Grønnebæk Tolsgaard,
Anders Nymark Christensen,
Aasa Feragen
Abstract:
Despite the rapid development of AI models in medical image analysis, their validation in real-world clinical settings remains limited. To address this, we introduce a generic framework designed for deploying image-based AI models in such settings. Using this framework, we deployed a trained model for fetal ultrasound standard plane detection, and evaluated it in real-time sessions with both novic…
▽ More
Despite the rapid development of AI models in medical image analysis, their validation in real-world clinical settings remains limited. To address this, we introduce a generic framework designed for deploying image-based AI models in such settings. Using this framework, we deployed a trained model for fetal ultrasound standard plane detection, and evaluated it in real-time sessions with both novice and expert users. Feedback from these sessions revealed that while the model offers potential benefits to medical practitioners, the need for navigational guidance was identified as a key area for improvement. These findings underscore the importance of early deployment of AI models in real-world settings, leading to insights that can guide the refinement of the model and system based on actual user feedback.
△ Less
Submitted 22 March, 2024;
originally announced April 2024.
-
Diffusion-based Iterative Counterfactual Explanations for Fetal Ultrasound Image Quality Assessment
Authors:
Paraskevas Pegios,
Manxi Lin,
Nina Weng,
Morten Bo Søndergaard Svendsen,
Zahra Bashir,
Siavash Bigdeli,
Anders Nymark Christensen,
Martin Tolsgaard,
Aasa Feragen
Abstract:
Obstetric ultrasound image quality is crucial for accurate diagnosis and monitoring of fetal health. However, producing high-quality standard planes is difficult, influenced by the sonographer's expertise and factors like the maternal BMI or the fetus dynamics. In this work, we propose using diffusion-based counterfactual explainable AI to generate realistic high-quality standard planes from low-q…
▽ More
Obstetric ultrasound image quality is crucial for accurate diagnosis and monitoring of fetal health. However, producing high-quality standard planes is difficult, influenced by the sonographer's expertise and factors like the maternal BMI or the fetus dynamics. In this work, we propose using diffusion-based counterfactual explainable AI to generate realistic high-quality standard planes from low-quality non-standard ones. Through quantitative and qualitative evaluation, we demonstrate the effectiveness of our method in producing plausible counterfactuals of increased quality. This shows future promise both for enhancing training of clinicians by providing visual feedback, as well as for improving image quality and, consequently, downstream diagnosis and monitoring.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Shortcut Learning in Medical Image Segmentation
Authors:
Manxi Lin,
Nina Weng,
Kamil Mikolaj,
Zahra Bashir,
Morten Bo Søndergaard Svendsen,
Martin Tolsgaard,
Anders Nymark Christensen,
Aasa Feragen
Abstract:
Shortcut learning is a phenomenon where machine learning models prioritize learning simple, potentially misleading cues from data that do not generalize well beyond the training set. While existing research primarily investigates this in the realm of image classification, this study extends the exploration of shortcut learning into medical image segmentation. We demonstrate that clinical annotatio…
▽ More
Shortcut learning is a phenomenon where machine learning models prioritize learning simple, potentially misleading cues from data that do not generalize well beyond the training set. While existing research primarily investigates this in the realm of image classification, this study extends the exploration of shortcut learning into medical image segmentation. We demonstrate that clinical annotations such as calipers, and the combination of zero-padded convolutions and center-cropped training sets in the dataset can inadvertently serve as shortcuts, impacting segmentation accuracy. We identify and evaluate the shortcut learning on two different but common medical image segmentation tasks. In addition, we suggest strategies to mitigate the influence of shortcut learning and improve the generalizability of the segmentation models. By uncovering the presence and implications of shortcuts in medical image segmentation, we provide insights and methodologies for evaluating and overcoming this pervasive challenge and call for attention in the community for shortcuts in segmentation. Our code is public at https://github.com/nina-weng/shortcut_skinseg .
△ Less
Submitted 27 June, 2024; v1 submitted 11 March, 2024;
originally announced March 2024.
-
Learning semantic image quality for fetal ultrasound from noisy ranking annotation
Authors:
Manxi Lin,
Jakob Ambsdorf,
Emilie Pi Fogtmann Sejer,
Zahra Bashir,
Chun Kit Wong,
Paraskevas Pegios,
Alberto Raheli,
Morten Bo Søndergaard Svendsen,
Mads Nielsen,
Martin Grønnebæk Tolsgaard,
Anders Nymark Christensen,
Aasa Feragen
Abstract:
We introduce the notion of semantic image quality for applications where image quality relies on semantic requirements. Working in fetal ultrasound, where ranking is challenging and annotations are noisy, we design a robust coarse-to-fine model that ranks images based on their semantic image quality and endow our predicted rankings with an uncertainty estimate. To annotate rankings on training dat…
▽ More
We introduce the notion of semantic image quality for applications where image quality relies on semantic requirements. Working in fetal ultrasound, where ranking is challenging and annotations are noisy, we design a robust coarse-to-fine model that ranks images based on their semantic image quality and endow our predicted rankings with an uncertainty estimate. To annotate rankings on training data, we design an efficient ranking annotation scheme based on the merge sort algorithm. Finally, we compare our ranking algorithm to a number of state-of-the-art ranking algorithms on a challenging fetal ultrasound quality assessment task, showing the superior performance of our method on the majority of rank correlation metrics.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
An Automatic Guidance and Quality Assessment System for Doppler Imaging of Umbilical Artery
Authors:
Chun Kit Wong,
Manxi Lin,
Alberto Raheli,
Zahra Bashir,
Morten Bo Søndergaard Svendsen,
Martin Grønnebæk Tolsgaard,
Aasa Feragen,
Anders Nymark Christensen
Abstract:
Examination of the umbilical artery with Doppler ultrasonography is performed to investigate blood supply to the fetus through the umbilical cord, which is vital for the monitoring of fetal health. Such examination involves several steps that must be performed correctly: identifying suitable sites on the umbilical artery for the measurement, acquiring the blood flow curve in the form of a Doppler…
▽ More
Examination of the umbilical artery with Doppler ultrasonography is performed to investigate blood supply to the fetus through the umbilical cord, which is vital for the monitoring of fetal health. Such examination involves several steps that must be performed correctly: identifying suitable sites on the umbilical artery for the measurement, acquiring the blood flow curve in the form of a Doppler spectrum, and ensuring compliance to a set of quality standards. These steps rely heavily on the operator's skill, and the shortage of experienced sonographers has thus created a demand for machine assistance. In this work, we propose an automatic system to fill the gap. By using a modified Faster R-CNN network, we obtain an algorithm that can suggest locations suitable for Doppler measurement. Meanwhile, we have also developed a method for assessment of the Doppler spectrum's quality. The proposed system is validated on 657 images from a national ultrasound screening database, with results demonstrating its potential as a guidance system.
△ Less
Submitted 6 July, 2023; v1 submitted 11 April, 2023;
originally announced April 2023.
-
Removing confounding information from fetal ultrasound images
Authors:
Kamil Mikolaj,
Manxi Lin,
Zahra Bashir,
Morten Bo Søndergaard Svendsen,
Martin Tolsgaard,
Anders Nymark,
Aasa Feragen
Abstract:
Confounding information in the form of text or markings embedded in medical images can severely affect the training of diagnostic deep learning algorithms. However, data collected for clinical purposes often have such markings embedded in them. In dermatology, known examples include drawings or rulers that are overrepresented in images of malignant lesions. In this paper, we encounter text and cal…
▽ More
Confounding information in the form of text or markings embedded in medical images can severely affect the training of diagnostic deep learning algorithms. However, data collected for clinical purposes often have such markings embedded in them. In dermatology, known examples include drawings or rulers that are overrepresented in images of malignant lesions. In this paper, we encounter text and calipers placed on the images found in national databases containing fetal screening ultrasound scans, which correlate with standard planes to be predicted. In order to utilize the vast amounts of data available in these databases, we develop and validate a series of methods for minimizing the confounding effects of embedded text and calipers on deep learning algorithms designed for ultrasound, using standard plane classification as a test case.
△ Less
Submitted 24 March, 2023;
originally announced March 2023.
-
Practical I/O-Efficient Multiway Separators
Authors:
Svend C. Svendsen
Abstract:
We revisit the fundamental problem of I/O-efficiently computing $r$-way separators on planar graphs. An $r$-way separator divides a planar graph with $N$ vertices into $O(r)$ regions of size $O(N/r)$ and $O(\sqrt {Nr})$ boundary vertices in total, where boundary vertices are vertices that are adjacent to more than one region. Such separators are used in I/O-efficient solutions to many fundamental…
▽ More
We revisit the fundamental problem of I/O-efficiently computing $r$-way separators on planar graphs. An $r$-way separator divides a planar graph with $N$ vertices into $O(r)$ regions of size $O(N/r)$ and $O(\sqrt {Nr})$ boundary vertices in total, where boundary vertices are vertices that are adjacent to more than one region. Such separators are used in I/O-efficient solutions to many fundamental problems on planar graphs such as breadth-first search, finding single-source shortest paths, topological sorting, and finding strongly connected components. Our main result is an I/O-efficient sampling-based algorithm that, given a Koebe-embedding of a graph with $N$ vertices and a parameter $r$, computes an $r$-way separator for the graph under certain assumptions on the size of internal memory. Computing a Koebe-embedding of a planar graph is difficult in practice and no known I/O-efficient algorithm currently exists. Therefore, we show how our algorithm can be generalized and applied directly to Delaunay triangulations without relying on a Koebe-embedding. This adaptation can produce many boundary vertices in the worst-case, however, to our knowledge our result is the first to be implemented in practice due to the many non-trivial and complex techniques used in previous results. Furthermore, we show that our algorithm performs well on real-world data and that the number of boundary vertices is small in practice.
Motivated by applications in geometric information systems, we show how our algorithm for Delaunay triangulations can be applied to compute the flow accumulation over a terrain, which models how much water flows over the vertices of a terrain. When given an $r$-way separator, our implementation of the algorithm outperforms traditional sweep-line-based algorithms on the publicly available digital elevation model of Denmark.
△ Less
Submitted 6 July, 2021;
originally announced July 2021.
-
1D and 2D Flow Routing on a Terrain
Authors:
Aaron Lowe,
Svend C. Svendsen,
Pankaj K. Agarwal,
Lars Arge
Abstract:
An important problem in terrain analysis is modeling how water flows across a terrain creating floods by forming channels and filling depressions. In this paper we study a number of \emph{flow-query} related problems: Given a terrain $Σ$, represented as a triangulated $xy$-monotone surface with $n$ vertices, a rain distribution $R$ which may vary over time, determine how much water is flowing over…
▽ More
An important problem in terrain analysis is modeling how water flows across a terrain creating floods by forming channels and filling depressions. In this paper we study a number of \emph{flow-query} related problems: Given a terrain $Σ$, represented as a triangulated $xy$-monotone surface with $n$ vertices, a rain distribution $R$ which may vary over time, determine how much water is flowing over a given edge as a function of time. We develop internal-memory as well as I/O-efficient algorithms for flow queries.
This paper contains four main results:
(i) We present an internal-memory algorithm that preprocesses $Σ$ into a linear-size data structure that for a (possibly time varying) rain distribution $R$ can return the flow-rate functions of all edges of $Σ$ in $O(ρk+|φ| \log n)$ time, where $ρ$ is the number of sinks in $Σ$, $k$ is the number of times the rain distribution changes, and $|φ|$ is the total complexity of the flow-rate functions that have non-zero values;
(ii) We also present an I/O-efficient algorithm for preprocessing $Σ$ into a linear-size data structure so that for a rain distribution $R$, it can compute the flow-rate function of all edges using $O(\text{Sort}(|φ|))$ I/Os and $O(|φ| \log |φ|)$ internal computation time.
(iii) $Σ$ can be preprocessed into a linear-size data structure so that for a given rain distribution $R$, the flow-rate function of an edge $(q,r) \in Σ$ under the single-flow direction (SFD) model can be computed more efficiently.
(iv) We present an algorithm for computing the two-dimensional channel along which water flows using Manning's equation; a widely used empirical equation that relates the flow-rate of water in an open channel to the geometry of the channel along with the height of water in the channel.
△ Less
Submitted 16 September, 2020;
originally announced September 2020.
-
Experimental evaluation of beamforming on UAVs in cellular systems
Authors:
Tomasz Izydorczyk,
Michel Massanet Ginard,
Simon Svendsen,
Gilberto Berardinelli,
Preben Mogensen
Abstract:
The usage of beamforming in Unmanned Aerial Vehicles (UAVs) has the potential of significantly improving the air-to-ground link quality. This paper presents the outcome of experimental trial of such a UAV-based beamforming system over live cellular networks. A testbed with directional antennas has been built for the experiments. It is shown that beamforming can extend the signal coverage due to an…
▽ More
The usage of beamforming in Unmanned Aerial Vehicles (UAVs) has the potential of significantly improving the air-to-ground link quality. This paper presents the outcome of experimental trial of such a UAV-based beamforming system over live cellular networks. A testbed with directional antennas has been built for the experiments. It is shown that beamforming can extend the signal coverage due to antenna gain, as well as spatially reduce interference leading to higher signal quality. Moreover, it has a positive impact on the mobility performance of a flying UAV by reducing handover occurrences. It is also discussed, in which situations beamforming should translate into the uplink throughput gain.
△ Less
Submitted 24 March, 2020;
originally announced March 2020.
-
Learning to Find Hydrological Corrections
Authors:
Lars Arge,
Allan Grønlund,
Svend Christian Svendsen,
Jonas Tranberg
Abstract:
High resolution Digital Elevation models, such as the (Big) grid terrain model of Denmark with more than 200 billion measurements, is a basic requirement for water flow modelling and flood risk analysis. However, a large number of modifications often need to be made to even very accurate terrain models, such as the Danish model, before they can be used in realistic flow modeling. These modificatio…
▽ More
High resolution Digital Elevation models, such as the (Big) grid terrain model of Denmark with more than 200 billion measurements, is a basic requirement for water flow modelling and flood risk analysis. However, a large number of modifications often need to be made to even very accurate terrain models, such as the Danish model, before they can be used in realistic flow modeling. These modifications include removal of bridges, which otherwise will act as dams in flow modeling, and inclusion of culverts that transport water underneath roads. In fact, the danish model is accompanied by a detailed set of hydrological corrections for the digital elevation model. However, producing these hydrological corrections is a very slow an expensive process, since it is to a large extent done manually and often with local input. This also means that corrections can be of varying quality. In this paper we propose a new algorithmic apporach based on machine learning and convolutional neural networks for automatically detecting hydrological corrections for such large terrain data. Our model is able to detect most hydrological corrections known for the danish model and quite a few more that should have been included in the original list.
△ Less
Submitted 17 September, 2019;
originally announced September 2019.
-
External Memory Pipelining Made Easy With TPIE
Authors:
Lars Arge,
Mathias Rav,
Svend C. Svendsen,
Jakob Truelsen
Abstract:
When handling large datasets that exceed the capacity of the main memory, movement of data between main memory and external memory (disk), rather than actual (CPU) computation time, is often the bottleneck in the computation. Since data is moved between disk and main memory in large contiguous blocks, this has led to the development of a large number of I/O-efficient algorithms that minimize the n…
▽ More
When handling large datasets that exceed the capacity of the main memory, movement of data between main memory and external memory (disk), rather than actual (CPU) computation time, is often the bottleneck in the computation. Since data is moved between disk and main memory in large contiguous blocks, this has led to the development of a large number of I/O-efficient algorithms that minimize the number of such block movements.
TPIE is one of two major libraries that have been developed to support I/O-efficient algorithm implementations. TPIE provides an interface where list stream processing and sorting can be implemented in a simple and modular way without having to worry about memory management or block movement. However, if care is not taken, such streaming-based implementations can lead to practically inefficient algorithms since lists of data items are typically written to (and read from) disk between components.
In this paper we present a major extension of the TPIE library that includes a pipelining framework that allows for practically efficient streaming-based implementations while minimizing I/O-overhead between streaming components. The framework pipelines streaming components to avoid I/Os between components, that is, it processes several components simultaneously while passing output from one component directly to the input of the next component in main memory. TPIE automatically determines which components to pipeline and performs the required main memory management, and the extension also includes support for parallelization of internal memory computation and progress tracking across an entire application. The extended library has already been used to evaluate I/O-efficient algorithms in the research literature and is heavily used in I/O-efficient commercial terrain processing applications by the Danish startup SCALGO.
△ Less
Submitted 27 October, 2017;
originally announced October 2017.
