Improving automatic endoscopic stone recognition using a multi-view fusion approach enhanced with two-step transfer learning
Authors:
Francisco Lopez-Tiro,
Elias Villalvazo-Avila,
Juan Pablo Betancur-Rengifo,
Ivan Reyes-Amezcua,
Jacques Hubert,
Gilberto Ochoa-Ruiz,
Christian Daul
Abstract:
This contribution presents a deep-learning method for extracting and fusing image information acquired from different viewpoints, with the aim to produce more discriminant object features for the identification of the type of kidney stones seen in endoscopic images. The model was further improved with a two-step transfer learning approach and by attention blocks to refine the learned feature maps.…
▽ More
This contribution presents a deep-learning method for extracting and fusing image information acquired from different viewpoints, with the aim to produce more discriminant object features for the identification of the type of kidney stones seen in endoscopic images. The model was further improved with a two-step transfer learning approach and by attention blocks to refine the learned feature maps. Deep feature fusion strategies improved the results of single view extraction backbone models by more than 6% in terms of accuracy of the kidney stones classification.
△ Less
Submitted 22 August, 2023; v1 submitted 6 April, 2023;
originally announced April 2023.
Boosting Kidney Stone Identification in Endoscopic Images Using Two-Step Transfer Learning
Authors:
Francisco Lopez-Tiro,
Juan Pablo Betancur-Rengifo,
Arturo Ruiz-Sanchez,
Ivan Reyes-Amezcua,
Jonathan El-Beze,
Jacques Hubert,
Michel Daudon,
Gilberto Ochoa-Ruiz,
Christian Daul
Abstract:
Knowing the cause of kidney stone formation is crucial to establish treatments that prevent recurrence. There are currently different approaches for determining the kidney stone type. However, the reference ex-vivo identification procedure can take up to several weeks, while an in-vivo visual recognition requires highly trained specialists. Machine learning models have been developed to provide ur…
▽ More
Knowing the cause of kidney stone formation is crucial to establish treatments that prevent recurrence. There are currently different approaches for determining the kidney stone type. However, the reference ex-vivo identification procedure can take up to several weeks, while an in-vivo visual recognition requires highly trained specialists. Machine learning models have been developed to provide urologists with an automated classification of kidney stones during an ureteroscopy; however, there is a general lack in terms of quality of the training data and methods. In this work, a two-step transfer learning approach is used to train the kidney stone classifier. The proposed approach transfers knowledge learned on a set of images of kidney stones acquired with a CCD camera (ex-vivo dataset) to a final model that classifies images from endoscopic images (ex-vivo dataset). The results show that learning features from different domains with similar information helps to improve the performance of a model that performs classification in real conditions (for instance, uncontrolled lighting conditions and blur). Finally, in comparison to models that are trained from scratch or by initializing ImageNet weights, the obtained results suggest that the two-step approach extracts features improving the identification of kidney stones in endoscopic images.
△ Less
Submitted 24 October, 2022;
originally announced October 2022.
