-
SAR-RARP50: Segmentation of surgical instrumentation and Action Recognition on Robot-Assisted Radical Prostatectomy Challenge
Authors:
Dimitrios Psychogyios,
Emanuele Colleoni,
Beatrice Van Amsterdam,
Chih-Yang Li,
Shu-Yu Huang,
Yuchong Li,
Fucang Jia,
Baosheng Zou,
Guotai Wang,
Yang Liu,
Maxence Boels,
Jiayu Huo,
Rachel Sparks,
Prokar Dasgupta,
Alejandro Granados,
Sebastien Ourselin,
Mengya Xu,
An Wang,
Yanan Wu,
Long Bai,
Hongliang Ren,
Atsushi Yamada,
Yuriko Harai,
Yuto Ishikawa,
Kazuyuki Hayashi
, et al. (25 additional authors not shown)
Abstract:
Surgical tool segmentation and action recognition are fundamental building blocks in many computer-assisted intervention applications, ranging from surgical skills assessment to decision support systems. Nowadays, learning-based action recognition and segmentation approaches outperform classical methods, relying, however, on large, annotated datasets. Furthermore, action recognition and tool segme…
▽ More
Surgical tool segmentation and action recognition are fundamental building blocks in many computer-assisted intervention applications, ranging from surgical skills assessment to decision support systems. Nowadays, learning-based action recognition and segmentation approaches outperform classical methods, relying, however, on large, annotated datasets. Furthermore, action recognition and tool segmentation algorithms are often trained and make predictions in isolation from each other, without exploiting potential cross-task relationships. With the EndoVis 2022 SAR-RARP50 challenge, we release the first multimodal, publicly available, in-vivo, dataset for surgical action recognition and semantic instrumentation segmentation, containing 50 suturing video segments of Robotic Assisted Radical Prostatectomy (RARP). The aim of the challenge is twofold. First, to enable researchers to leverage the scale of the provided dataset and develop robust and highly accurate single-task action recognition and tool segmentation approaches in the surgical domain. Second, to further explore the potential of multitask-based learning approaches and determine their comparative advantage against their single-task counterparts. A total of 12 teams participated in the challenge, contributing 7 action recognition methods, 9 instrument segmentation techniques, and 4 multitask approaches that integrated both action recognition and instrument segmentation. The complete SAR-RARP50 dataset is available at: https://rdr.ucl.ac.uk/projects/SARRARP50_Segmentation_of_surgical_instrumentation_and_Action_Recognition_on_Robot-Assisted_Radical_Prostatectomy_Challenge/191091
△ Less
Submitted 23 January, 2024; v1 submitted 31 December, 2023;
originally announced January 2024.
-
Structure-preserving schemes for drift-diffusion systems on general meshes: DDFV vs HFV
Authors:
Stella Krell,
Julien Moatti
Abstract:
We made a comparison between a Discrete Duality Finite Volume (DDFV) scheme and a Hybrid Finite Volume (HFV) scheme for a drift-diffusion model with mixed boundary conditions on general meshes. Both schemes are based on a nonlinear discretisation of the convection-diffusion fluxes, which ensures the positivity of the discrete densities. We investigate the behaviours of the schemes on various numer…
▽ More
We made a comparison between a Discrete Duality Finite Volume (DDFV) scheme and a Hybrid Finite Volume (HFV) scheme for a drift-diffusion model with mixed boundary conditions on general meshes. Both schemes are based on a nonlinear discretisation of the convection-diffusion fluxes, which ensures the positivity of the discrete densities. We investigate the behaviours of the schemes on various numerical test cases.
△ Less
Submitted 20 July, 2023;
originally announced July 2023.
-
TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition
Authors:
Isabel Funke,
Dominik Rivoir,
Stefanie Krell,
Stefanie Speidel
Abstract:
To enable context-aware computer assistance in the operating room of the future, cognitive systems need to understand automatically which surgical phase is being performed by the medical team. The primary source of information for surgical phase recognition is typically video, which presents two challenges: extracting meaningful features from the video stream and effectively modeling temporal info…
▽ More
To enable context-aware computer assistance in the operating room of the future, cognitive systems need to understand automatically which surgical phase is being performed by the medical team. The primary source of information for surgical phase recognition is typically video, which presents two challenges: extracting meaningful features from the video stream and effectively modeling temporal information in the sequence of visual features. For temporal modeling, attention mechanisms have gained popularity due to their ability to capture long-range dependencies. In this paper, we explore design choices for attention in existing temporal models for surgical phase recognition and propose a novel approach that uses attention more effectively and does not require hand-crafted constraints: TUNeS, an efficient and simple temporal model that incorporates self-attention at the core of a convolutional U-Net structure. In addition, we propose to train the feature extractor, a standard CNN, together with an LSTM on preferably long video segments, i.e., with long temporal context. In our experiments, almost all temporal models performed better on top of feature extractors that were trained with longer temporal context. On these contextualized features, TUNeS achieves state-of-the-art results on the Cholec80 dataset. This study offers new insights on how to use attention mechanisms to build accurate and efficient temporal models for surgical phase recognition. Implementing automatic surgical phase recognition is essential to automate the analysis and optimization of surgical workflows and to enable context-aware computer assistance during surgery, thus ultimately improving patient care.
△ Less
Submitted 13 May, 2024; v1 submitted 19 July, 2023;
originally announced July 2023.
-
Large time behavior of nonlinear finite volume schemes for convection-diffusion equations
Authors:
Clément Cancès,
Claire Chainais-Hillairet,
Maxime Herda,
Stella Krell
Abstract:
In this contribution we analyze the large time behavior of a family of nonlinear finite volume schemes for anisotropic convection-diffusion equations set in a bounded bidimensional domain and endowed with either Dirichlet and / or no-flux boundary conditions. We show that solutions to the two-point flux approximation (TPFA) and discrete duality finite volume (DDFV) schemes under consideration conv…
▽ More
In this contribution we analyze the large time behavior of a family of nonlinear finite volume schemes for anisotropic convection-diffusion equations set in a bounded bidimensional domain and endowed with either Dirichlet and / or no-flux boundary conditions. We show that solutions to the two-point flux approximation (TPFA) and discrete duality finite volume (DDFV) schemes under consideration converge exponentially fast toward their steady state. The analysis relies on discrete entropy estimates and discrete functional inequalities. As a biproduct of our analysis, we establish new discrete Poincaré-Wirtinger, Beckner and logarithmic Sobolev inequalities. Our theoretical results are illustrated by numerical simulations.
△ Less
Submitted 9 June, 2020; v1 submitted 12 November, 2019;
originally announced November 2019.
-
Numerical analysis of a nonlinear free-energy diminishing Discrete Duality Finite Volume scheme for convection diffusion equations
Authors:
Clément Cancès,
Claire Chainais-Hillairet,
Stella Krell
Abstract:
We propose a nonlinear Discrete Duality Finite Volume scheme to approximate the solutions of drift diffusion equations. The scheme is built to preserve at the discrete level even on severely distorted meshes the energy / energy dissipation relation. This relation is of paramount importance to capture the long-time behavior of the problem in an accurate way. To enforce it, the linear convection dif…
▽ More
We propose a nonlinear Discrete Duality Finite Volume scheme to approximate the solutions of drift diffusion equations. The scheme is built to preserve at the discrete level even on severely distorted meshes the energy / energy dissipation relation. This relation is of paramount importance to capture the long-time behavior of the problem in an accurate way. To enforce it, the linear convection diffusion equation is rewritten in a nonlinear form before being discretized. We establish the existence of positive solutions to the scheme. Based on compactness arguments, the convergence of the approximate solution towards a weak solution is established. Finally, we provide numerical evidences of the good behavior of the scheme when the discretization parameters tend to 0 and when time goes to infinity.
△ Less
Submitted 30 May, 2017;
originally announced May 2017.
-
A Hybrid High-Order method for the steady incompressible Navier--Stokes problem
Authors:
Daniele A. Di Pietro,
Stella Krell
Abstract:
In this work we introduce and analyze a novel Hybrid High-Order method for the steady incompressible Navier-Stokes equations. The proposed method is inf-sup stable on general polyhedral meshes, supports arbitrary approximation orders, and is (relatively) inexpensive thanks to the possibility of statically condensing a subset of the unknowns at each nonlinear iteration. We show under general assump…
▽ More
In this work we introduce and analyze a novel Hybrid High-Order method for the steady incompressible Navier-Stokes equations. The proposed method is inf-sup stable on general polyhedral meshes, supports arbitrary approximation orders, and is (relatively) inexpensive thanks to the possibility of statically condensing a subset of the unknowns at each nonlinear iteration. We show under general assumptions the existence of a discrete solution, which is also unique provided a data smallness condition is verified. Using a compactness argument, we prove convergence of the sequence of discrete solutions to minimal regularity exact solutions for general data. For more regular solutions, we prove optimal convergence rates for the energy-norm of the velocity and the $L^2$-norm of the pressure under a standard data smallness assumption. More precisely, when polynomials of degree $k\ge 0$ at mesh elements and faces are used, both quantities are proved to converge as $h^{k+1}$ (with $h$ denoting the meshsize).
△ Less
Submitted 27 July, 2016;
originally announced July 2016.