SuperPoint features in endoscopy
Authors:
O. L. Barbed,
F. Chadebecq,
J. Morlana,
J. M. MartÃnez-Montiel,
A. C. Murillo
Abstract:
There is often a significant gap between research results and applicability in routine medical practice. This work studies the performance of well-known local features on a medical dataset captured during routine colonoscopy procedures. Local feature extraction and matching is a key step for many computer vision applications, specially regarding 3D modelling. In the medical domain, handcrafted loc…
▽ More
There is often a significant gap between research results and applicability in routine medical practice. This work studies the performance of well-known local features on a medical dataset captured during routine colonoscopy procedures. Local feature extraction and matching is a key step for many computer vision applications, specially regarding 3D modelling. In the medical domain, handcrafted local features such as SIFT, with public pipelines such as COLMAP, are still a predominant tool for this kind of tasks. We explore the potential of the well known self-supervised approach SuperPoint, present an adapted variation for the endoscopic domain and propose a challenging evaluation framework. SuperPoint based models achieve significantly higher matching quality than commonly used local features in this domain. Our adapted model avoids features within specularity regions, a frequent and problematic artifact in endoscopic images, with consequent benefits for matching and reconstruction results.
△ Less
Submitted 9 January, 2023; v1 submitted 8 March, 2022;
originally announced March 2022.
Automated pick-up of suturing needles for robotic surgical assistance
Authors:
Claudia D'Ettorre,
George Dwyer,
Xiaofei Du,
Francois Chadebecq,
Francisco Vasconcelos,
Elena De Momi,
Danail Stoyanov
Abstract:
Robot-assisted laparoscopic prostatectomy (RALP) is a treatment for prostate cancer that involves complete or nerve sparing removal prostate tissue that contains cancer. After removal the bladder neck is successively sutured directly with the urethra. The procedure is called urethrovesical anastomosis and is one of the most dexterity demanding tasks during RALP. Two suturing instruments and a pair…
▽ More
Robot-assisted laparoscopic prostatectomy (RALP) is a treatment for prostate cancer that involves complete or nerve sparing removal prostate tissue that contains cancer. After removal the bladder neck is successively sutured directly with the urethra. The procedure is called urethrovesical anastomosis and is one of the most dexterity demanding tasks during RALP. Two suturing instruments and a pair of needles are used in combination to perform a running stitch during urethrovesical anastomosis. While robotic instruments provide enhanced dexterity to perform the anastomosis, it is still highly challenging and difficult to learn. In this paper, we presents a vision-guided needle gras** method for automatically gras** the needle that has been inserted into the patient prior to anastomosis. We aim to automatically grasp the suturing needle in a position that avoids hand-offs and immediately enables the start of suturing. The full gras** process can be broken down into: a needle detection algorithm; an approach phase where the surgical tool moves closer to the needle based on visual feedback; and a gras** phase through path planning based on observed surgical practice. Our experimental results show examples of successful autonomous gras** that has the potential to simplify and decrease the operational time in RALP by assisting a small component of urethrovesical anastomosis.
△ Less
Submitted 9 April, 2018;
originally announced April 2018.
