An Introduction to Natural Language Processing Techniques and Framework for Clinical Implementation in Radiation Oncology
Authors:
Reza Khanmohammadi,
Mohammad M. Ghassemi,
Kyle Verdecchia,
Ahmed I. Ghanem,
Luo Bing,
Indrin J. Chetty,
Hassan Bagher-Ebadian,
Farzan Siddiqui,
Mohamed Elshaikh,
Benjamin Movsas,
Kundan Thind
Abstract:
Natural Language Processing (NLP) is a key technique for develo** Medical Artificial Intelligence (AI) systems that leverage Electronic Health Record (EHR) data to build diagnostic and prognostic models. NLP enables the conversion of unstructured clinical text into structured data that can be fed into AI algorithms. The emergence of the transformer architecture and large language models (LLMs) h…
▽ More
Natural Language Processing (NLP) is a key technique for develo** Medical Artificial Intelligence (AI) systems that leverage Electronic Health Record (EHR) data to build diagnostic and prognostic models. NLP enables the conversion of unstructured clinical text into structured data that can be fed into AI algorithms. The emergence of the transformer architecture and large language models (LLMs) has led to remarkable advances in NLP for various healthcare tasks, such as entity recognition, relation extraction, sentence similarity, text summarization, and question answering. In this article, we review the major technical innovations that underpin modern NLP models and present state-of-the-art NLP applications that employ LLMs in radiation oncology research. However, these LLMs are prone to many errors such as hallucinations, biases, and ethical violations, which necessitate rigorous evaluation and validation before clinical deployment. As such, we propose a comprehensive framework for assessing the NLP models based on their purpose and clinical fit, technical performance, bias and trust, legal and ethical implications, and quality assurance, prior to implementation in clinical radiation oncology. Our article aims to provide guidance and insights for researchers and clinicians who are interested in develo** and using NLP models in clinical radiation oncology.
△ Less
Submitted 8 November, 2023; v1 submitted 3 November, 2023;
originally announced November 2023.
FocalUNETR: A Focal Transformer for Boundary-aware Segmentation of CT Images
Authors:
Chengyin Li,
Yao Qiang,
Rafi Ibn Sultan,
Hassan Bagher-Ebadian,
Prashant Khanduri,
Indrin J. Chetty,
Dongxiao Zhu
Abstract:
Computed Tomography (CT) based precise prostate segmentation for treatment planning is challenging due to (1) the unclear boundary of the prostate derived from CT's poor soft tissue contrast and (2) the limitation of convolutional neural network-based models in capturing long-range global context. Here we propose a novel focal transformer-based image segmentation architecture to effectively and ef…
▽ More
Computed Tomography (CT) based precise prostate segmentation for treatment planning is challenging due to (1) the unclear boundary of the prostate derived from CT's poor soft tissue contrast and (2) the limitation of convolutional neural network-based models in capturing long-range global context. Here we propose a novel focal transformer-based image segmentation architecture to effectively and efficiently extract local visual features and global context from CT images. Additionally, we design an auxiliary boundary-induced label regression task coupled with the main prostate segmentation task to address the unclear boundary issue in CT images. We demonstrate that this design significantly improves the quality of the CT-based prostate segmentation task over other competing methods, resulting in substantially improved performance, i.e., higher Dice Similarity Coefficient, lower Hausdorff Distance, and Average Symmetric Surface Distance, on both private and public CT image datasets. Our code is available at this \href{https://github.com/ChengyinLee/FocalUNETR.git}{link}.
△ Less
Submitted 18 July, 2023; v1 submitted 6 October, 2022;
originally announced October 2022.