-
Extracting Medication Changes in Clinical Narratives using Pre-trained Language Models
Authors:
Giridhar Kaushik Ramachandran,
Kevin Lybarger,
Yaya Liu,
Diwakar Mahajan,
Jennifer J. Liang,
Ching-Huei Tsou,
Meliha Yetisgen,
Özlem Uzuner
Abstract:
An accurate and detailed account of patient medications, including medication changes within the patient timeline, is essential for healthcare providers to provide appropriate patient care. Healthcare providers or the patients themselves may initiate changes to patient medication. Medication changes take many forms, including prescribed medication and associated dosage modification. These changes…
▽ More
An accurate and detailed account of patient medications, including medication changes within the patient timeline, is essential for healthcare providers to provide appropriate patient care. Healthcare providers or the patients themselves may initiate changes to patient medication. Medication changes take many forms, including prescribed medication and associated dosage modification. These changes provide information about the overall health of the patient and the rationale that led to the current care. Future care can then build on the resulting state of the patient. This work explores the automatic extraction of medication change information from free-text clinical notes. The Contextual Medication Event Dataset (CMED) is a corpus of clinical notes with annotations that characterize medication changes through multiple change-related attributes, including the type of change (start, stop, increase, etc.), initiator of the change, temporality, change likelihood, and negation. Using CMED, we identify medication mentions in clinical text and propose three novel high-performing BERT-based systems that resolve the annotated medication change characteristics. We demonstrate that our proposed systems improve medication change classification performance over the initial work exploring CMED.
△ Less
Submitted 12 January, 2023; v1 submitted 17 August, 2022;
originally announced August 2022.
-
Learning to Ask Like a Physician
Authors:
Eric Lehman,
Vladislav Lialin,
Katelyn Y. Legaspi,
Anne Janelle R. Sy,
Patricia Therese S. Pile,
Nicole Rose I. Alberto,
Richard Raymund R. Ragasa,
Corinna Victoria M. Puyat,
Isabelle Rose I. Alberto,
Pia Gabrielle I. Alfonso,
Marianne Taliño,
Dana Moukheiber,
Byron C. Wallace,
Anna Rumshisky,
Jenifer J. Liang,
Preethi Raghavan,
Leo Anthony Celi,
Peter Szolovits
Abstract:
Existing question answering (QA) datasets derived from electronic health records (EHR) are artificially generated and consequently fail to capture realistic physician information needs. We present Discharge Summary Clinical Questions (DiSCQ), a newly curated question dataset composed of 2,000+ questions paired with the snippets of text (triggers) that prompted each question. The questions are gene…
▽ More
Existing question answering (QA) datasets derived from electronic health records (EHR) are artificially generated and consequently fail to capture realistic physician information needs. We present Discharge Summary Clinical Questions (DiSCQ), a newly curated question dataset composed of 2,000+ questions paired with the snippets of text (triggers) that prompted each question. The questions are generated by medical experts from 100+ MIMIC-III discharge summaries. We analyze this dataset to characterize the types of information sought by medical experts. We also train baseline models for trigger detection and question generation (QG), paired with unsupervised answer retrieval over EHRs. Our baseline model is able to generate high quality questions in over 62% of cases when prompted with human selected triggers. We release this dataset (and all code to reproduce baseline model results) to facilitate further research into realistic clinical QA and QG: https://github.com/elehman16/discq.
△ Less
Submitted 6 June, 2022;
originally announced June 2022.
-
Toward Understanding Clinical Context of Medication Change Events in Clinical Narratives
Authors:
Diwakar Mahajan,
Jennifer J Liang,
Ching-Huei Tsou
Abstract:
Understanding medication events in clinical narratives is essential to achieving a complete picture of a patient's medication history. While prior research has explored classification of medication changes from clinical notes, studies to date have not considered the necessary clinical context needed for their use in real-world applications, such as medication timeline generation and medication rec…
▽ More
Understanding medication events in clinical narratives is essential to achieving a complete picture of a patient's medication history. While prior research has explored classification of medication changes from clinical notes, studies to date have not considered the necessary clinical context needed for their use in real-world applications, such as medication timeline generation and medication reconciliation. In this paper, we present the Contextualized Medication Event Dataset (CMED), a dataset for capturing relevant context of medication changes documented in clinical notes, which was developed using a novel conceptual framework that organizes context for clinical events into various orthogonal dimensions. In this process, we define specific contextual aspects pertinent to medication change events, characterize the dataset, and report the results of preliminary experiments. CMED consists of 9,013 medication mentions annotated over 500 clinical notes, and will be released to the community as a shared task in 2021.
△ Less
Submitted 19 May, 2021; v1 submitted 17 November, 2020;
originally announced November 2020.
-
Extracting Daily Dosage from Medication Instructions in EHRs: An Automated Approach and Lessons Learned
Authors:
Diwakar Mahajan,
Jennifer J. Liang,
Ching-Huei Tsou
Abstract:
Medication timelines have been shown to be effective in hel** physicians visualize complex patient medication information. A key feature in many such designs is a longitudinal representation of a medication's daily dosage and its changes over time. However, daily dosage as a discrete value is generally not provided and needs to be derived from free text instructions (Sig). Existing works in dail…
▽ More
Medication timelines have been shown to be effective in hel** physicians visualize complex patient medication information. A key feature in many such designs is a longitudinal representation of a medication's daily dosage and its changes over time. However, daily dosage as a discrete value is generally not provided and needs to be derived from free text instructions (Sig). Existing works in daily dosage extraction are narrow in scope, targeting dosage extraction for a single drug from clinical notes. Here, we present an automated approach to calculate daily dosage for all medications, combining deep learning-based named entity extractor with lexicon dictionaries and regular expressions, achieving 0.98 precision and 0.95 recall on an expert-generated dataset of 1,000 Sigs. We also analyze our expert-generated dataset, discuss the challenges in understanding the complex information contained in Sigs, and provide insights to guide future work in the general-purpose daily dosage calculation task.
△ Less
Submitted 28 October, 2021; v1 submitted 21 May, 2020;
originally announced May 2020.
-
Annotating Electronic Medical Records for Question Answering
Authors:
Preethi Raghavan,
Siddharth Patwardhan,
Jennifer J. Liang,
Murthy V. Devarakonda
Abstract:
Our research is in the relatively unexplored area of question answering technologies for patient-specific questions over their electronic health records. A large dataset of human expert curated question and answer pairs is an important pre-requisite for develo**, training and evaluating any question answering system that is powered by machine learning. In this paper, we describe a process for cr…
▽ More
Our research is in the relatively unexplored area of question answering technologies for patient-specific questions over their electronic health records. A large dataset of human expert curated question and answer pairs is an important pre-requisite for develo**, training and evaluating any question answering system that is powered by machine learning. In this paper, we describe a process for creating such a dataset of questions and answers. Our methodology is replicable, can be conducted by medical students as annotators, and results in high inter-annotator agreement (0.71 Cohen's kappa). Over the course of 11 months, 11 medical students followed our annotation methodology, resulting in a question answering dataset of 5696 questions over 71 patient records, of which 1747 questions have corresponding answers generated by the medical students.
△ Less
Submitted 17 May, 2018;
originally announced May 2018.
