-
SEGSRNet for Stereo-Endoscopic Image Super-Resolution and Surgical Instrument Segmentation
Authors:
Mansoor Hayat,
Supavadee Aramvith,
Titipat Achakulvisut
Abstract:
SEGSRNet addresses the challenge of precisely identifying surgical instruments in low-resolution stereo endoscopic images, a common issue in medical imaging and robotic surgery. Our innovative framework enhances image clarity and segmentation accuracy by applying state-of-the-art super-resolution techniques before segmentation. This ensures higher-quality inputs for more precise segmentation. SEGS…
▽ More
SEGSRNet addresses the challenge of precisely identifying surgical instruments in low-resolution stereo endoscopic images, a common issue in medical imaging and robotic surgery. Our innovative framework enhances image clarity and segmentation accuracy by applying state-of-the-art super-resolution techniques before segmentation. This ensures higher-quality inputs for more precise segmentation. SEGSRNet combines advanced feature extraction and attention mechanisms with spatial processing to sharpen image details, which is significant for accurate tool identification in medical images. Our proposed model outperforms current models including Dice, IoU, PSNR, and SSIM, SEGSRNet where it produces clearer and more accurate images for stereo endoscopic surgical imaging. SEGSRNet can provide image resolution and precise segmentation which can significantly enhance surgical accuracy and patient care outcomes.
△ Less
Submitted 26 April, 2024; v1 submitted 20 April, 2024;
originally announced April 2024.
-
Combined Channel and Spatial Attention-based Stereo Endoscopic Image Super-Resolution
Authors:
Mansoor Hayat,
Supavadee Armvith,
Dr. Titipat Achakulvisut
Abstract:
Stereo Imaging technology integration into medical diagnostics and surgeries brings a great revolution in the field of medical sciences. Now, surgeons and physicians have better insight into the anatomy of patients' organs. Like other technologies, stereo cameras have limitations, e.g., low resolution (LR) and blurry output images. Currently, most of the proposed techniques for super-resolution fo…
▽ More
Stereo Imaging technology integration into medical diagnostics and surgeries brings a great revolution in the field of medical sciences. Now, surgeons and physicians have better insight into the anatomy of patients' organs. Like other technologies, stereo cameras have limitations, e.g., low resolution (LR) and blurry output images. Currently, most of the proposed techniques for super-resolution focus on develo** complex blocks and complicated loss functions, which cause high system complexity. We proposed a combined channel and spatial attention block to extract features incorporated with a specific but very strong parallax attention module (PAM) for endoscopic image super-resolution. The proposed model is trained using the da Vinci dataset on scales 2 and 4. Our proposed model has improved PSNR up to 2.12 dB for scale 2 and 1.29 dB for scale 4, while SSIM is improved by 0.03 for scale 2 and 0.0008 for scale 4. By incorporating this method, diagnosis and treatment for endoscopic images can be more accurate and effective.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
Neuromatch Academy: Teaching Computational Neuroscience with global accessibility
Authors:
Tara van Viegen,
Athena Akrami,
Kate Bonnen,
Eric DeWitt,
Alexandre Hyafil,
Helena Ledmyr,
Grace W. Lindsay,
Patrick Mineault,
John D. Murray,
Xaq Pitkow,
Aina Puce,
Madineh Sedigh-Sarvestani,
Carsen Stringer,
Titipat Achakulvisut,
Elnaz Alikarami,
Melvin Selim Atay,
Eleanor Batty,
Jeffrey C. Erlich,
Byron V. Galbraith,
Yueqi Guo,
Ashley L. Juavinett,
Matthew R. Krause,
Songting Li,
Marius Pachitariu,
Elizabeth Straley
, et al. (10 additional authors not shown)
Abstract:
Neuromatch Academy designed and ran a fully online 3-week Computational Neuroscience summer school for 1757 students with 191 teaching assistants working in virtual inverted (or flipped) classrooms and on small group projects. Fourteen languages, active community management, and low cost allowed for an unprecedented level of inclusivity and universal accessibility.
Neuromatch Academy designed and ran a fully online 3-week Computational Neuroscience summer school for 1757 students with 191 teaching assistants working in virtual inverted (or flipped) classrooms and on small group projects. Fourteen languages, active community management, and low cost allowed for an unprecedented level of inclusivity and universal accessibility.
△ Less
Submitted 15 December, 2020;
originally announced December 2020.
-
Claim Extraction in Biomedical Publications using Deep Discourse Model and Transfer Learning
Authors:
Titipat Achakulvisut,
Chandra Bhagavatula,
Daniel Acuna,
Konrad Kording
Abstract:
Claims are a fundamental unit of scientific discourse. The exponential growth in the number of scientific publications makes automatic claim extraction an important problem for researchers who are overwhelmed by this information overload. Such an automated claim extraction system is useful for both manual and programmatic exploration of scientific knowledge. In this paper, we introduce a new datas…
▽ More
Claims are a fundamental unit of scientific discourse. The exponential growth in the number of scientific publications makes automatic claim extraction an important problem for researchers who are overwhelmed by this information overload. Such an automated claim extraction system is useful for both manual and programmatic exploration of scientific knowledge. In this paper, we introduce a new dataset of 1,500 scientific abstracts from the biomedical domain with expert annotations for each sentence indicating whether the sentence presents a scientific claim. We introduce a new model for claim extraction and compare it to several baseline models including rule-based and deep learning techniques. Moreover, we show that using a transfer learning approach with a fine-tuning step allows us to improve performance from a large discourse-annotated dataset. Our final model increases F1-score by over 14 percent points compared to a baseline model without transfer learning. We release a publicly accessible tool for discourse and claims prediction along with an annotation tool. We discuss further applications beyond biomedical literature.
△ Less
Submitted 16 January, 2020; v1 submitted 1 July, 2019;
originally announced July 2019.
-
Science Concierge: A fast content-based recommendation system for scientific publications
Authors:
Titipat Achakulvisut,
Daniel E. Acuna,
Tulakan Ruangrong,
Konrad Kording
Abstract:
Finding relevant publications is important for scientists who have to cope with exponentially increasing numbers of scholarly material. Algorithms can help with this task as they help for music, movie, and product recommendations. However, we know little about the performance of these algorithms with scholarly material. Here, we develop an algorithm, and an accompanying Python library, that implem…
▽ More
Finding relevant publications is important for scientists who have to cope with exponentially increasing numbers of scholarly material. Algorithms can help with this task as they help for music, movie, and product recommendations. However, we know little about the performance of these algorithms with scholarly material. Here, we develop an algorithm, and an accompanying Python library, that implements a recommendation system based on the content of articles. Design principles are to adapt to new content, provide near-real time suggestions, and be open source. We tested the library on 15K posters from the Society of Neuroscience Conference 2015. Human curated topics are used to cross validate parameters in the algorithm and produce a similarity metric that maximally correlates with human judgments. We show that our algorithm significantly outperformed suggestions based on keywords. The work presented here promises to make the exploration of scholarly material faster and more accurate.
△ Less
Submitted 11 May, 2016; v1 submitted 4 April, 2016;
originally announced April 2016.
