Showing 1–2 of 2 results for author: Hakim, R
-
Deep learning-based computer vision to recognize and classify suturing gestures in robot-assisted surgery
Authors:
Francisco Luongo,
Ryan Hakim,
Jessica H. Nguyen,
Animashree Anandkumar,
Andrew J Hung
Abstract:
Our previous work classified a taxonomy of suturing gestures during a vesicourethral anastomosis of robotic radical prostatectomy in association with tissue tears and patient outcomes. Herein, we train deep-learning based computer vision (CV) to automate the identification and classification of suturing gestures for needle driving attempts. Using two independent raters, we manually annotated live…
▽ More
Our previous work classified a taxonomy of suturing gestures during a vesicourethral anastomosis of robotic radical prostatectomy in association with tissue tears and patient outcomes. Herein, we train deep-learning based computer vision (CV) to automate the identification and classification of suturing gestures for needle driving attempts. Using two independent raters, we manually annotated live suturing video clips to label timepoints and gestures. Identification (2395 videos) and classification (511 videos) datasets were compiled to train CV models to produce two- and five-class label predictions, respectively. Networks were trained on inputs of raw RGB pixels as well as optical flow for each frame. Each model was trained on 80/20 train/test splits. In this study, all models were able to reliably predict either the presence of a gesture (identification, AUC: 0.88) as well as the type of gesture (classification, AUC: 0.87) at significantly above chance levels. For both gesture identification and classification datasets, we observed no effect of recurrent classification model choice (LSTM vs. convLSTM) on performance. Our results demonstrate CV's ability to recognize features that not only can identify the action of suturing but also distinguish between different classifications of suturing gestures. This demonstrates the potential to utilize deep learning CV towards future automation of surgical skill assessment.
△ Less
Submitted 26 August, 2020;
originally announced August 2020.
-
Development of Systematic Image Preprocessing of LAPAN-A3/IPB Multispectral Images
Authors:
Patria Rachman Hakim,
A Hadi Syafrudin,
Sartika Salaswati,
Satriya Utama,
Wahyudi Hasbi
Abstract:
As of any other satellite images, LAPAN-A3/IPB multispectral images suffered from both geometric and radiometric distortions which need to be corrected. LAPAN as satellite owner has developed image preprocessing algorithm to process raw image into systematically corrected image. This research aims to evaluate the performance of the developed algorithm, particularly the performance of lens vignetti…
▽ More
As of any other satellite images, LAPAN-A3/IPB multispectral images suffered from both geometric and radiometric distortions which need to be corrected. LAPAN as satellite owner has developed image preprocessing algorithm to process raw image into systematically corrected image. This research aims to evaluate the performance of the developed algorithm, particularly the performance of lens vignetting and band co-registration correction as well as the performance of direct image georeferencing. Lens vignetting distortion occurs on image was corrected by using pre-flight calibration data, while calculation of direct georeferencing was done by using satellite metadata of satellite position and attitude. Meanwhile, band co-registration correction was conducted based entirely on the image being processed using image matching approach. Based on several results and analysis which have been done, lens vignetting effects on image can be suppressed significantly from about 40 percent down to 10 percent, band coregistration error can be reduced to below 2-3 pixels in average, and the calculated direct georeferencing has 3000 meter accuracy. The results show that the developed image preprocessing algorithm has moderately good performance to process LAPAN-A3/IPB multispectral images.
△ Less
Submitted 26 January, 2019;
originally announced January 2019.
