-
Self-Contrastive Weakly Supervised Learning Framework for Prognostic Prediction Using Whole Slide Images
Authors:
Saul Fuster,
Farbod Khoraminia,
Julio Silva-Rodríguez,
Umay Kiraz,
Geert J. L. H. van Leenders,
Trygve Eftestøl,
Valery Naranjo,
Emiel A. M. Janssen,
Tahlita C. M. Zuiverloon,
Kjersti Engan
Abstract:
We present a pioneering investigation into the application of deep learning techniques to analyze histopathological images for addressing the substantial challenge of automated prognostic prediction. Prognostic prediction poses a unique challenge as the ground truth labels are inherently weak, and the model must anticipate future events that are not directly observable in the image. To address thi…
▽ More
We present a pioneering investigation into the application of deep learning techniques to analyze histopathological images for addressing the substantial challenge of automated prognostic prediction. Prognostic prediction poses a unique challenge as the ground truth labels are inherently weak, and the model must anticipate future events that are not directly observable in the image. To address this challenge, we propose a novel three-part framework comprising of a convolutional network based tissue segmentation algorithm for region of interest delineation, a contrastive learning module for feature extraction, and a nested multiple instance learning classification module. Our study explores the significance of various regions of interest within the histopathological slides and exploits diverse learning scenarios. The pipeline is initially validated on artificially generated data and a simpler diagnostic task. Transitioning to prognostic prediction, tasks become more challenging. Employing bladder cancer as use case, our best models yield an AUC of 0.721 and 0.678 for recurrence and treatment outcome prediction respectively.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Class and Region-Adaptive Constraints for Network Calibration
Authors:
Balamurali Murugesan,
Julio Silva-Rodriguez,
Ismail Ben Ayed,
Jose Dolz
Abstract:
In this work, we present a novel approach to calibrate segmentation networks that considers the inherent challenges posed by different categories and object regions. In particular, we present a formulation that integrates class and region-wise constraints into the learning objective, with multiple penalty weights to account for class and region differences. Finding the optimal penalty weights manu…
▽ More
In this work, we present a novel approach to calibrate segmentation networks that considers the inherent challenges posed by different categories and object regions. In particular, we present a formulation that integrates class and region-wise constraints into the learning objective, with multiple penalty weights to account for class and region differences. Finding the optimal penalty weights manually, however, might be unfeasible, and potentially hinder the optimization process. To overcome this limitation, we propose an approach based on Class and Region-Adaptive constraints (CRaC), which allows to learn the class and region-wise penalty weights during training. CRaC is based on a general Augmented Lagrangian method, a well-established technique in constrained optimization. Experimental results on two popular segmentation benchmarks, and two well-known segmentation networks, demonstrate the superiority of CRaC compared to existing approaches. The code is available at: https://github.com/Bala93/CRac/
△ Less
Submitted 18 March, 2024;
originally announced March 2024.
-
Solar Power Generation Profile Estimation for Lunar Surface Solar PV Systems
Authors:
Jesus Silva-Rodriguez,
Xingpeng Li
Abstract:
As NASA prepares to carry out its Artemis lunar missions, the design and planning of robust power systems tailored to the lunar environment become necessary and urgent. Solar photovoltaic (PV) systems are among the most suitable power generators for lunar applications given the abundant solar irradiance the lunar surface receives as a result of the lack of an atmosphere. However, the vastly differ…
▽ More
As NASA prepares to carry out its Artemis lunar missions, the design and planning of robust power systems tailored to the lunar environment become necessary and urgent. Solar photovoltaic (PV) systems are among the most suitable power generators for lunar applications given the abundant solar irradiance the lunar surface receives as a result of the lack of an atmosphere. However, the vastly different environmental conditions of the moon compared to those on Earth call for special reconsiderations to the traditional PV power output models used for terrestrial applications. The substantially wider range of temperatures on the moon combined with the absence of atmosphere implies the PV will operate at very different thermal conditions. Therefore, this paper proposes a PV power output model that determines PV cell temperature on the lunar surface based on lunar ambient temperature as well as solar irradiance, while also capturing these special lunar conditions. The model is based on thermal exchange via the three main heat transfer paths: heat radiation, absorption, and convection. Moreover, four different array configurations are presented and compared to determine the most suitable choice based on energy generation and complexity for different locations around the moon.
△ Less
Submitted 22 February, 2024;
originally announced February 2024.
-
Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathy
Authors:
Julio Silva-Rodriguez,
Jihed Chelbi,
Waziha Kabir,
Hadi Chakor,
Jose Dolz,
Ismail Ben Ayed,
Riadh Kobbi
Abstract:
Using deep learning models pre-trained on Imagenet is the traditional solution for medical image classification to deal with data scarcity. Nevertheless, relevant literature supports that this strategy may offer limited gains due to the high dissimilarity between domains. Currently, the paradigm of adapting domain-specialized foundation models is proving to be a promising alternative. However, how…
▽ More
Using deep learning models pre-trained on Imagenet is the traditional solution for medical image classification to deal with data scarcity. Nevertheless, relevant literature supports that this strategy may offer limited gains due to the high dissimilarity between domains. Currently, the paradigm of adapting domain-specialized foundation models is proving to be a promising alternative. However, how to perform such knowledge transfer, and the benefits and limitations it presents, are under study. The CGI-HRDC challenge for Hypertensive Retinopathy diagnosis on fundus images introduces an appealing opportunity to evaluate the transferability of a recently released vision-language foundation model of the retina, FLAIR. In this work, we explore the potential of using FLAIR features as starting point for fundus image classification, and we compare its performance with regard to Imagenet initialization on two popular transfer learning methods: Linear Probing (LP) and Fine-Tuning (FP). Our empirical observations suggest that, in any case, the use of the traditional strategy provides performance gains. In contrast, direct transferability from FLAIR model allows gains of 2.5%. When fine-tuning the whole network, the performance gap increases up to 4%. In this case, we show that avoiding feature deterioration via LP initialization of the classifier allows the best re-use of the rich pre-trained features. Although direct transferability using LP still offers limited performance, we believe that foundation models such as FLAIR will drive the evolution of deep-learning-based fundus image analysis.
△ Less
Submitted 27 January, 2024;
originally announced January 2024.
-
Attention to detail: inter-resolution knowledge distillation
Authors:
Rocío del Amor,
Julio Silva-Rodríguez,
Adrián Colomer,
Valery Naranjo
Abstract:
The development of computer vision solutions for gigapixel images in digital pathology is hampered by significant computational limitations due to the large size of whole slide images. In particular, digitizing biopsies at high resolutions is a time-consuming process, which is necessary due to the worsening results from the decrease in image detail. To alleviate this issue, recent literature has p…
▽ More
The development of computer vision solutions for gigapixel images in digital pathology is hampered by significant computational limitations due to the large size of whole slide images. In particular, digitizing biopsies at high resolutions is a time-consuming process, which is necessary due to the worsening results from the decrease in image detail. To alleviate this issue, recent literature has proposed using knowledge distillation to enhance the model performance at reduced image resolutions. In particular, soft labels and features extracted at the highest magnification level are distilled into a model that takes lower-magnification images as input. However, this approach fails to transfer knowledge about the most discriminative image regions in the classification process, which may be lost when the resolution is decreased. In this work, we propose to distill this information by incorporating attention maps during training. In particular, our formulation leverages saliency maps of the target class via grad-CAMs, which guides the lower-resolution Student model to match the Teacher distribution by minimizing the l2 distance between them. Comprehensive experiments on prostate histology image grading demonstrate that the proposed approach substantially improves the model performance across different image resolutions compared to previous literature.
△ Less
Submitted 11 January, 2024;
originally announced January 2024.
-
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models
Authors:
Julio Silva-Rodríguez,
Sina Hajimiri,
Ismail Ben Ayed,
Jose Dolz
Abstract:
Efficient transfer learning (ETL) is receiving increasing attention to adapt large pre-trained language-vision models on downstream tasks with a few labeled samples. While significant progress has been made, we reveal that state-of-the-art ETL approaches exhibit strong performance only in narrowly-defined experimental setups, and with a careful adjustment of hyperparameters based on a large corpus…
▽ More
Efficient transfer learning (ETL) is receiving increasing attention to adapt large pre-trained language-vision models on downstream tasks with a few labeled samples. While significant progress has been made, we reveal that state-of-the-art ETL approaches exhibit strong performance only in narrowly-defined experimental setups, and with a careful adjustment of hyperparameters based on a large corpus of labeled samples. In particular, we make two interesting, and surprising empirical observations. First, to outperform a simple Linear Probing baseline, these methods require to optimize their hyper-parameters on each target task. And second, they typically underperform -- sometimes dramatically -- standard zero-shot predictions in the presence of distributional drifts. Motivated by the unrealistic assumptions made in the existing literature, i.e., access to a large validation set and case-specific grid-search for optimal hyperparameters, we propose a novel approach that meets the requirements of real-world scenarios. More concretely, we introduce a CLass-Adaptive linear Probe (CLAP) objective, whose balancing term is optimized via an adaptation of the general Augmented Lagrangian method tailored to this context. We comprehensively evaluate CLAP on a broad span of datasets and scenarios, demonstrating that it consistently outperforms SoTA approaches, while yet being a much more efficient alternative.
△ Less
Submitted 25 March, 2024; v1 submitted 19 December, 2023;
originally announced December 2023.
-
Decentralized Micro Water-Energy Co-Optimization for Small Communities
Authors:
Jesus Silva-Rodriguez,
Xingpeng Li
Abstract:
The water-energy nexus encompasses the interdependencies between water and energy resources identifying the existing links between the production and distribution of these resources. Therefore, understanding the water-energy nexus is crucial for develo** sustainable and integrated resource management approaches. This paper proposes a decentralized co-optimization model for a micro water-energy n…
▽ More
The water-energy nexus encompasses the interdependencies between water and energy resources identifying the existing links between the production and distribution of these resources. Therefore, understanding the water-energy nexus is crucial for develo** sustainable and integrated resource management approaches. This paper proposes a decentralized co-optimization model for a micro water-energy nexus system (MWEN), aiming to optimize the combined supply of both resources to end consumers. The approach respects the separate ownership and management of the water and energy sectors while bridging the gap between their optimized operations. An enhanced version of the alternating direction method of multipliers (ADMM) is proposed, the objective-based ADMM (OB-ADMM), which is able to robustly optimize each system independently towards a common objective, only sharing information about the power consumption of water management, providing privacy for each resource provider.
△ Less
Submitted 2 October, 2023;
originally announced October 2023.
-
A Foundation LAnguage-Image model of the Retina (FLAIR): Encoding expert knowledge in text supervision
Authors:
Julio Silva-Rodriguez,
Hadi Chakor,
Riadh Kobbi,
Jose Dolz,
Ismail Ben Ayed
Abstract:
Foundation vision-language models are currently transforming computer vision, and are on the rise in medical imaging fueled by their very promising generalization capabilities. However, the initial attempts to transfer this new paradigm to medical imaging have shown less impressive performances than those observed in other domains, due to the significant domain shift and the complex, expert domain…
▽ More
Foundation vision-language models are currently transforming computer vision, and are on the rise in medical imaging fueled by their very promising generalization capabilities. However, the initial attempts to transfer this new paradigm to medical imaging have shown less impressive performances than those observed in other domains, due to the significant domain shift and the complex, expert domain knowledge inherent to medical-imaging tasks. Motivated by the need for domain-expert foundation models, we present FLAIR, a pre-trained vision-language model for universal retinal fundus image understanding. To this end, we compiled 37 open-access, mostly categorical fundus imaging datasets from various sources, with up to 97 different target conditions and 284,660 images. We integrate the expert's domain knowledge in the form of descriptive textual prompts, during both pre-training and zero-shot inference, enhancing the less-informative categorical supervision of the data. Such a textual expert's knowledge, which we compiled from the relevant clinical literature and community standards, describes the fine-grained features of the pathologies as well as the hierarchies and dependencies between them. We report comprehensive evaluations, which illustrate the benefit of integrating expert knowledge and the strong generalization capabilities of FLAIR under difficult scenarios with domain shifts or unseen categories. When adapted with a lightweight linear probe, FLAIR outperforms fully-trained, dataset-focused models, more so in the few-shot regimes. Interestingly, FLAIR outperforms by a large margin more generalist, larger-scale image-language models, which emphasizes the potential of embedding experts' domain knowledge and the limitations of generalist models in medical imaging.
△ Less
Submitted 15 August, 2023;
originally announced August 2023.
-
HistoColAi: An Open-Source Web Platform for Collaborative Digital Histology Image Annotation with AI-Driven Predictive Integration
Authors:
Cristian Camilo Pulgarín-Ospina,
Rocío del Amor,
Adrián Colomera,
Julio Silva-Rodríguez,
Valery Naranjo
Abstract:
Digital pathology has become a standard in the pathology workflow due to its many benefits. These include the level of detail of the whole slide images generated and the potential immediate sharing of cases between hospitals. Recent advances in deep learning-based methods for image analysis make them of potential aid in digital pathology. However, a major limitation in develo** computer-aided di…
▽ More
Digital pathology has become a standard in the pathology workflow due to its many benefits. These include the level of detail of the whole slide images generated and the potential immediate sharing of cases between hospitals. Recent advances in deep learning-based methods for image analysis make them of potential aid in digital pathology. However, a major limitation in develo** computer-aided diagnostic systems for pathology is the lack of an intuitive and open web application for data annotation. This paper proposes a web service that efficiently provides a tool to visualize and annotate digitized histological images. In addition, to show and validate the tool, in this paper we include a use case centered on the diagnosis of spindle cell skin neoplasm for multiple annotators. A usability study of the tool is also presented, showing the feasibility of the developed tool.
△ Less
Submitted 11 July, 2023;
originally announced July 2023.
-
Privacy-Preserving Decentralized Energy Management for Networked Microgrids via Objective-Based ADMM
Authors:
Jesus Silva-Rodriguez,
Xingpeng Li
Abstract:
This paper proposes a decentralized energy management (DEM) strategy for a network of local microgrids, providing economically balanced energy schedules for all participating microgrids. The proposed DEM strategy can preserve the privacy of each microgrid by only requiring them to share network power exchange information. The proposed DEM strategy enhances the traditional alternating direction met…
▽ More
This paper proposes a decentralized energy management (DEM) strategy for a network of local microgrids, providing economically balanced energy schedules for all participating microgrids. The proposed DEM strategy can preserve the privacy of each microgrid by only requiring them to share network power exchange information. The proposed DEM strategy enhances the traditional alternating direction method of multipliers (ADMM) formulation for networks of microgrids by examining the global objective value as well as the solution quality. A novel stop** decision combining these two metrics is proposed for the enhanced objective-based ADMM (OB-ADMM) method. This paper also presents a centralized energy management (CEM) model as a benchmark, and a post-processing proportional exchange algorithm (PEA) to balance the economic benefit of each microgrid. The resulting proposed OB-ADMM model combined with the PEA delivers the final high-fidelity optimal solution for multiple microgrids in a grid-connected collaborative power exchange network. Moreover, the proposed decentralized operational strategy preserves the economic and privacy interests of individual microgrid participants. Different network cases are simulated to test the algorithm's performance, and the results validate the aforementioned claims.
△ Less
Submitted 7 April, 2023;
originally announced April 2023.
-
Towards foundation models and few-shot parameter-efficient fine-tuning for volumetric organ segmentation
Authors:
Julio Silva-Rodríguez,
Jose Dolz,
Ismail Ben Ayed
Abstract:
With the recent raise of foundation models in computer vision and NLP, the pretrain-and-adapt strategy, where a large-scale model is fine-tuned on downstream tasks, is gaining popularity. However, traditional fine-tuning approaches may still require significant resources and yield sub-optimal results when the labeled data of the target task is scarce. This is especially the case in clinical settin…
▽ More
With the recent raise of foundation models in computer vision and NLP, the pretrain-and-adapt strategy, where a large-scale model is fine-tuned on downstream tasks, is gaining popularity. However, traditional fine-tuning approaches may still require significant resources and yield sub-optimal results when the labeled data of the target task is scarce. This is especially the case in clinical settings. To address this challenge, we formalize few-shot efficient fine-tuning (FSEFT), a novel and realistic setting for medical image segmentation. Furthermore, we introduce a novel parameter-efficient fine-tuning strategy tailored to medical image segmentation, with (a) spatial adapter modules that are more appropriate for dense prediction tasks; and (b) a constrained transductive inference, which leverages task-specific prior knowledge. Our comprehensive experiments on a collection of public CT datasets for organ segmentation reveal the limitations of standard fine-tuning methods in few-shot scenarios, point to the potential of vision adapters and transductive inference, and confirm the suitability of foundation models.
△ Less
Submitted 28 September, 2023; v1 submitted 29 March, 2023;
originally announced March 2023.
-
Cost-benefit Analysis And Comparisons For Different Offshore Wind Energy Transmission Systems
Authors:
Jesus Silva-Rodriguez,
** Lu,
Xingpeng Li
Abstract:
This paper investigates how to efficiently and economically deliver offshore energy generated by offshore wind turbines to onshore. Both power cables and hydrogen energy facilities are analyzed. Each method is examined with the associated proposed optimal sizing model. A cost-benefit analysis is conducted, and these methods are compared under different scenarios. Three long-distance energy transmi…
▽ More
This paper investigates how to efficiently and economically deliver offshore energy generated by offshore wind turbines to onshore. Both power cables and hydrogen energy facilities are analyzed. Each method is examined with the associated proposed optimal sizing model. A cost-benefit analysis is conducted, and these methods are compared under different scenarios. Three long-distance energy transmission methods are proposed to transmit offshore energy onshore, considering the capital/operation costs for related energy conversion and transmission facilities. The first method that deploys power cables only is a benchmark method. The other two methods utilize a hydrogen supercenter (HSC) and transmit offshore energy to and onshore substation through hydrogen pipelines. For the second method, electrolyzers are placed at offshore wind farms connected to HSC with low-pressure hydrogen pipelines. For the third method, offshore wind power is distributed to the HSC and then converted into hydrogen using electrolyzers placed at the HSC. An offshore scenario including three wind farms located in the Gulf of Mexico and one onshore substation is used as the base test case. Numerical simulations are conducted over a planning period of 30 years using the proposed optimization models for each method separately. Simulation results show that the proposed hydrogen-based methods can effectively transmit offshore energy to the onshore substation. The distances between the wind farms can influence the selection and configuration of the offshore wind energy system. Moreover, the proposed study analyzes the cost and benefits for various systems with different energy carriers. It can also suggest which method could be the best candidate for offshore energy delivery system under which scenario and demonstrate a promising future for offshore wind power generation.
△ Less
Submitted 26 January, 2023;
originally announced January 2023.
-
Challenging mitosis detection algorithms: Global labels allow centroid localization
Authors:
Claudio Fernandez-Martín,
Umay Kiraz,
Julio Silva-Rodríguez,
Sandra Morales,
Emiel Janssen,
Valery Naranjo
Abstract:
Mitotic activity is a crucial proliferation biomarker for the diagnosis and prognosis of different types of cancers. Nevertheless, mitosis counting is a cumbersome process for pathologists, prone to low reproducibility, due to the large size of augmented biopsy slides, the low density of mitotic cells, and pattern heterogeneity. To improve reproducibility, deep learning methods have been proposed…
▽ More
Mitotic activity is a crucial proliferation biomarker for the diagnosis and prognosis of different types of cancers. Nevertheless, mitosis counting is a cumbersome process for pathologists, prone to low reproducibility, due to the large size of augmented biopsy slides, the low density of mitotic cells, and pattern heterogeneity. To improve reproducibility, deep learning methods have been proposed in the last years using convolutional neural networks. However, these methods have been hindered by the process of data labelling, which usually solely consist of the mitosis centroids. Therefore, current literature proposes complex algorithms with multiple stages to refine the labels at pixel level, and to reduce the number of false positives. In this work, we propose to avoid complex scenarios, and we perform the localization task in a weakly supervised manner, using only image-level labels on patches. The results obtained on the publicly available TUPAC16 dataset are competitive with state-of-the-art methods, using only one training phase. Our method achieves an F1-score of 0.729 and challenges the efficiency of previous methods, which required multiple stages and strong mitosis location information.
△ Less
Submitted 30 November, 2022;
originally announced November 2022.
-
Centralized Networked Micro Water-Energy Nexus with Proportional Exchange Among Participants
Authors:
Jesus Silva-Rodriguez,
Xingpeng Li
Abstract:
This paper proposes a Networked Micro Water-Energy Nexus (NetMicroWEN) capable of co-optimizing and simultaneously supplying water and energy to local consumers in nearby communities. The system manages different water and energy inputs of different communities in a local network to cooperatively meet their demands. This paper considers a centralized network topology that connects all members of t…
▽ More
This paper proposes a Networked Micro Water-Energy Nexus (NetMicroWEN) capable of co-optimizing and simultaneously supplying water and energy to local consumers in nearby communities. The system manages different water and energy inputs of different communities in a local network to cooperatively meet their demands. This paper considers a centralized network topology that connects all members of the network under one control system. This paper also proposes a Proportional Exchange Algorithm (PEA) that allows members to benefit equally from exchanging both resources among other members of the NetMicroWEN and the main water and power distribution systems. The co-optimization model is a mixed-integer linear program, involving all necessary power and water related constraints for the network to achieve a feasible and practical solution. The economic benefits of the NetMicroWEN are illustrated by a comparison with separate Micro Water- Energy Nexus (MWEN) systems meeting their own demands individually. The case studies demonstrate that the proposed NetMicroWEN achieves substantially lower operating costs compared to the operation of separate MWEN systems.
△ Less
Submitted 5 July, 2022;
originally announced July 2022.
-
Resilient Operational Planning for Microgrids Against Extreme Events
Authors:
Cunzhi Zhao,
Jesus Silva-Rodriguez,
Xingpeng Li
Abstract:
This paper proposes a novel resilience index, a microgrid survivability rate (SR) under extreme events, and then proposes a novel Resilient Operational Planning (ROP) algorithm to maximize the proposed resilience index SR. The proposed ROP algorithm can incorporate predetermined inverter failure probabilities and generate multiple scenarios accordingly to optimize resilient operations during an ex…
▽ More
This paper proposes a novel resilience index, a microgrid survivability rate (SR) under extreme events, and then proposes a novel Resilient Operational Planning (ROP) algorithm to maximize the proposed resilience index SR. The proposed ROP algorithm can incorporate predetermined inverter failure probabilities and generate multiple scenarios accordingly to optimize resilient operations during an extreme event. The implemented ROP algorithm consists of two main steps: (i) optimization of resilient operational planning, and (ii) preventive resilience enhancement if minimum SR is not met per the analysis in step 1. A typical microgrid (MG) is studied to compare the proposed ROP algorithm against a traditional microgrid energy management (MEM) model. Results indicate that an enhanced resilience operation is achieved by the ROP algorithm, which is demonstrated by the quantification of resilience via the SR. Moreover, the proposed ROP algorithm is able to obtain a greater SR overall compared to that achieved by the traditional MEM, and this benefit of using the proposed ROP increases as the inverter failure probabilities increase.
△ Less
Submitted 15 June, 2022;
originally announced June 2022.
-
Constrained unsupervised anomaly segmentation
Authors:
Julio Silva-Rodríguez,
Valery Naranjo,
Jose Dolz
Abstract:
Current unsupervised anomaly localization approaches rely on generative models to learn the distribution of normal images, which is later used to identify potential anomalous regions derived from errors on the reconstructed images. However, a main limitation of nearly all prior literature is the need of employing anomalous images to set a class-specific threshold to locate the anomalies. This limi…
▽ More
Current unsupervised anomaly localization approaches rely on generative models to learn the distribution of normal images, which is later used to identify potential anomalous regions derived from errors on the reconstructed images. However, a main limitation of nearly all prior literature is the need of employing anomalous images to set a class-specific threshold to locate the anomalies. This limits their usability in realistic scenarios, where only normal data is typically accessible. Despite this major drawback, only a handful of works have addressed this limitation, by integrating supervision on attention maps during training. In this work, we propose a novel formulation that does not require accessing images with abnormalities to define the threshold. Furthermore, and in contrast to very recent work, the proposed constraint is formulated in a more principled manner, leveraging well-known knowledge in constrained optimization. In particular, the equality constraint on the attention maps in prior work is replaced by an inequality constraint, which allows more flexibility. In addition, to address the limitations of penalty-based functions we employ an extension of the popular log-barrier methods to handle the constraint. Last, we propose an alternative regularization term that maximizes the Shannon entropy of the attention maps, reducing the amount of hyperparameters of the proposed model. Comprehensive experiments on two publicly available datasets on brain lesion segmentation demonstrate that the proposed approach substantially outperforms relevant literature, establishing new state-of-the-art results for unsupervised lesion segmentation, and without the need to access anomalous images.
△ Less
Submitted 12 July, 2022; v1 submitted 3 March, 2022;
originally announced March 2022.
-
Acoustic Echo Cancellation using Residual U-Nets
Authors:
J. Silva-Rodríguez,
M. F. Dolz,
M. Ferrer,
A. Castelló,
V. Naranjo,
G. Piñero
Abstract:
This paper presents an acoustic echo canceler based on a U-Net convolutional neural network for single-talk and double-talk scenarios. U-Net networks have previously been used in the audio processing area for source separation problems because of their ability to reproduce the finest details of audio signals, but to our knowledge, this is the first time they have been used for acoustic echo cancel…
▽ More
This paper presents an acoustic echo canceler based on a U-Net convolutional neural network for single-talk and double-talk scenarios. U-Net networks have previously been used in the audio processing area for source separation problems because of their ability to reproduce the finest details of audio signals, but to our knowledge, this is the first time they have been used for acoustic echo cancellation (AEC). The U-Net hyperparameters have been optimized to obtain the best AEC performance, but using a reduced number of parameters to meet a latency restriction of 40 ms. The training and testing of our model have been carried out within the framework of the 'ICASSP 2021 AEC Challenge' organized by Microsoft. We have trained the optimized U-Net model with a synthetic dataset only (S-U-Net) and with a synthetic dataset and the single-talk set of a real dataset (SR-U-Net), both datasets were released for the challenge. The S-U-Net model presented better results for double-talk scenarios, thus their inferred near-end signals from the blind testset were submitted to the challenge. Our canceler ranked 12th among 17 teams, and 5th among 10 academia teams, obtaining an overall mean opinion score of 3.57.
△ Less
Submitted 20 September, 2021;
originally announced September 2021.
-
Looking at the whole picture: constrained unsupervised anomaly segmentation
Authors:
Julio Silva-Rodríguez,
Valery Naranjo,
Jose Dolz
Abstract:
Current unsupervised anomaly localization approaches rely on generative models to learn the distribution of normal images, which is later used to identify potential anomalous regions derived from errors on the reconstructed images. However, a main limitation of nearly all prior literature is the need of employing anomalous images to set a class-specific threshold to locate the anomalies. This limi…
▽ More
Current unsupervised anomaly localization approaches rely on generative models to learn the distribution of normal images, which is later used to identify potential anomalous regions derived from errors on the reconstructed images. However, a main limitation of nearly all prior literature is the need of employing anomalous images to set a class-specific threshold to locate the anomalies. This limits their usability in realistic scenarios, where only normal data is typically accessible. Despite this major drawback, only a handful of works have addressed this limitation, by integrating supervision on attention maps during training. In this work, we propose a novel formulation that does not require accessing images with abnormalities to define the threshold. Furthermore, and in contrast to very recent work, the proposed constraint is formulated in a more principled manner, leveraging well-known knowledge in constrained optimization. In particular, the equality constraint on the attention maps in prior work is replaced by an inequality constraint, which allows more flexibility. In addition, to address the limitations of penalty-based functions we employ an extension of the popular log-barrier methods to handle the constraint. Comprehensive experiments on the popular BRATS'19 dataset demonstrate that the proposed approach substantially outperforms relevant literature, establishing new state-of-the-art results for unsupervised lesion segmentation.
△ Less
Submitted 28 October, 2021; v1 submitted 1 September, 2021;
originally announced September 2021.
-
Prostate Gland Segmentation in Histology Images via Residual and Multi-Resolution U-Net
Authors:
Julio Silva-Rodríguez,
Elena Payá-Bosch,
Gabriel García,
Adrián Colomer,
Valery Naranjo
Abstract:
Prostate cancer is one of the most prevalent cancers worldwide. One of the key factors in reducing its mortality is based on early detection. The computer-aided diagnosis systems for this task are based on the glandular structural analysis in histology images. Hence, accurate gland detection and segmentation is crucial for a successful prediction. The methodological basis of this work is a prostat…
▽ More
Prostate cancer is one of the most prevalent cancers worldwide. One of the key factors in reducing its mortality is based on early detection. The computer-aided diagnosis systems for this task are based on the glandular structural analysis in histology images. Hence, accurate gland detection and segmentation is crucial for a successful prediction. The methodological basis of this work is a prostate gland segmentation based on U-Net convolutional neural network architectures modified with residual and multi-resolution blocks, trained using data augmentation techniques. The residual configuration outperforms in the test subset the previous state-of-the-art approaches in an image-level comparison, reaching an average Dice Index of 0.77.
△ Less
Submitted 21 May, 2021;
originally announced May 2021.
-
Going Deeper through the Gleason Scoring Scale: An Automatic end-to-end System for Histology Prostate Grading and Cribriform Pattern Detection
Authors:
Julio Silva-Rodríguez,
Adrián Colomer,
María A. Sales,
Rafael Molina,
Valery Naranjo
Abstract:
The Gleason scoring system is the primary diagnostic and prognostic tool for prostate cancer. In recent years, with the development of digitisation devices, the use of computer vision techniques for the analysis of biopsies has increased. However, to the best of the authors' knowledge, the development of algorithms to automatically detect individual cribriform patterns belonging to Gleason grade 4…
▽ More
The Gleason scoring system is the primary diagnostic and prognostic tool for prostate cancer. In recent years, with the development of digitisation devices, the use of computer vision techniques for the analysis of biopsies has increased. However, to the best of the authors' knowledge, the development of algorithms to automatically detect individual cribriform patterns belonging to Gleason grade 4 has not yet been studied in the literature. The objective of the work presented in this paper is to develop a deep-learning-based system able to support pathologists in the daily analysis of prostate biopsies. The methodological core of this work is a patch-wise predictive model based on convolutional neural networks able to determine the presence of cancerous patterns. In particular, we train from scratch a simple self-design architecture. The cribriform pattern is detected by retraining the set of filters of the last convolutional layer in the network. From the reconstructed prediction map, we compute the percentage of each Gleason grade in the tissue to feed a multi-layer perceptron which provides a biopsy-level score.mIn our SICAPv2 database, composed of 182 annotated whole slide images, we obtained a Cohen's quadratic kappa of 0.77 in the test set for the patch-level Gleason grading with the proposed architecture trained from scratch. Our results outperform previous ones reported in the literature. Furthermore, this model reaches the level of fine-tuned state-of-the-art architectures in a patient-based four groups cross validation. In the cribriform pattern detection task, we obtained an area under ROC curve of 0.82. Regarding the biopsy Gleason scoring, we achieved a quadratic Cohen's Kappa of 0.81 in the test subset. Shallow CNN architectures trained from scratch outperform current state-of-the-art methods for Gleason grades classification.
△ Less
Submitted 21 May, 2021;
originally announced May 2021.
-
WeGleNet: A Weakly-Supervised Convolutional Neural Network for the Semantic Segmentation of Gleason Grades in Prostate Histology Images
Authors:
Julio Silva-Rodríguez,
Adrián Colomer,
Valery Naranjo
Abstract:
Prostate cancer is one of the main diseases affecting men worldwide. The Gleason scoring system is the primary diagnostic tool for prostate cancer. This is obtained via the visual analysis of cancerous patterns in prostate biopsies performed by expert pathologists, and the aggregation of the main Gleason grades in a combined score. Computer-aided diagnosis systems allow to reduce the workload of p…
▽ More
Prostate cancer is one of the main diseases affecting men worldwide. The Gleason scoring system is the primary diagnostic tool for prostate cancer. This is obtained via the visual analysis of cancerous patterns in prostate biopsies performed by expert pathologists, and the aggregation of the main Gleason grades in a combined score. Computer-aided diagnosis systems allow to reduce the workload of pathologists and increase the objectivity. Recently, efforts have been made in the literature to develop algorithms aiming the direct estimation of the global Gleason score at biopsy/core level with global labels. However, these algorithms do not cover the accurate localization of the Gleason patterns into the tissue. In this work, we propose a deep-learning-based system able to detect local cancerous patterns in the prostate tissue using only the global-level Gleason score during training. The methodological core of this work is the proposed weakly-supervised-trained convolutional neural network, WeGleNet, based on a multi-class segmentation layer after the feature extraction module, a global-aggregation, and the slicing of the background class for the model loss estimation during training. We obtained a Cohen's quadratic kappa (k) of 0.67 for the pixel-level prediction of cancerous patterns in the validation cohort. We compared the model performance for semantic segmentation of Gleason grades with supervised state-of-the-art architectures in the test cohort. We obtained a pixel-level k of 0.61 and a macro-averaged f1-score of 0.58, at the same level as fully-supervised methods. Regarding the estimation of the core-level Gleason score, we obtained a k of 0.76 and 0.67 between the model and two different pathologists. WeGleNet is capable of performing the semantic segmentation of Gleason grades similarly to fully-supervised methods without requiring pixel-level annotations.
△ Less
Submitted 21 May, 2021;
originally announced May 2021.
-
Self-learning for weakly supervised Gleason grading of local patterns
Authors:
Julio Silva-Rodríguez,
Adrián Colomer,
Jose Dolz,
Valery Naranjo
Abstract:
Prostate cancer is one of the main diseases affecting men worldwide. The gold standard for diagnosis and prognosis is the Gleason grading system. In this process, pathologists manually analyze prostate histology slides under microscope, in a high time-consuming and subjective task. In the last years, computer-aided-diagnosis (CAD) systems have emerged as a promising tool that could support patholo…
▽ More
Prostate cancer is one of the main diseases affecting men worldwide. The gold standard for diagnosis and prognosis is the Gleason grading system. In this process, pathologists manually analyze prostate histology slides under microscope, in a high time-consuming and subjective task. In the last years, computer-aided-diagnosis (CAD) systems have emerged as a promising tool that could support pathologists in the daily clinical practice. Nevertheless, these systems are usually trained using tedious and prone-to-error pixel-level annotations of Gleason grades in the tissue. To alleviate the need of manual pixel-wise labeling, just a handful of works have been presented in the literature. Motivated by this, we propose a novel weakly-supervised deep-learning model, based on self-learning CNNs, that leverages only the global Gleason score of gigapixel whole slide images during training to accurately perform both, grading of patch-level patterns and biopsy-level scoring. To evaluate the performance of the proposed method, we perform extensive experiments on three different external datasets for the patch-level Gleason grading, and on two different test sets for global Grade Group prediction. We empirically demonstrate that our approach outperforms its supervised counterpart on patch-level Gleason grading by a large margin, as well as state-of-the-art methods on global biopsy-level scoring. Particularly, the proposed model brings an average improvement on the Cohen's quadratic kappa (k) score of nearly 18% compared to full-supervision for the patch-level Gleason grading task.
△ Less
Submitted 21 May, 2021;
originally announced May 2021.
-
Gleason Grading of Histology Prostate Images through Semantic Segmentation via Residual U-Net
Authors:
Amartya Kalapahar,
Julio Silva-Rodríguez,
Adrián Colomer,
Fernando López-Mir,
Valery Naranjo
Abstract:
Worldwide, prostate cancer is one of the main cancers affecting men. The final diagnosis of prostate cancer is based on the visual detection of Gleason patterns in prostate biopsy by pathologists. Computer-aided-diagnosis systems allow to delineate and classify the cancerous patterns in the tissue via computer-vision algorithms in order to support the physicians' task. The methodological core of t…
▽ More
Worldwide, prostate cancer is one of the main cancers affecting men. The final diagnosis of prostate cancer is based on the visual detection of Gleason patterns in prostate biopsy by pathologists. Computer-aided-diagnosis systems allow to delineate and classify the cancerous patterns in the tissue via computer-vision algorithms in order to support the physicians' task. The methodological core of this work is a U-Net convolutional neural network for image segmentation modified with residual blocks able to segment cancerous tissue according to the full Gleason system. This model outperforms other well-known architectures, and reaches a pixel-level Cohen's quadratic Kappa of 0.52, at the level of previous image-level works in the literature, but providing also a detailed localisation of the patterns.
△ Less
Submitted 22 May, 2020;
originally announced May 2020.
