Showing 1–50 of 55 results for author: Roberts, K

What's the Weight? Estimating Controlled Outcome Differences in Complex Surveys for Health Disparities Research

Authors: Stephen Salerno, Emily K. Roberts, Belinda L. Needham, Tyler H. McCormick, Bhramar Mukherjee, Xu Shi

Abstract: A basic descriptive question in statistics often asks whether there are differences in mean outcomes between groups based on levels of a discrete covariate (e.g., racial disparities in health outcomes). However, when this categorical covariate of interest is correlated with other factors related to the outcome, direct comparisons may lead to biased estimates and invalid inferential conclusions wit… ▽ More A basic descriptive question in statistics often asks whether there are differences in mean outcomes between groups based on levels of a discrete covariate (e.g., racial disparities in health outcomes). However, when this categorical covariate of interest is correlated with other factors related to the outcome, direct comparisons may lead to biased estimates and invalid inferential conclusions without appropriate adjustment. Propensity score methods are broadly employed with observational data as a tool to achieve covariate balance, but how to implement them in complex surveys is less studied - in particular, when the survey weights depend on the group variable under comparison. In this work, we focus on a specific example when sample selection depends on race. We propose identification formulas to properly estimate the average controlled difference (ACD) in outcomes between Black and White individuals, with appropriate weighting for covariate imbalance across the two racial groups and generalizability. Via extensive simulation, we show that our proposed methods outperform traditional analytic approaches in terms of bias, mean squared error, and coverage. We are motivated by the interplay between race and social determinants of health when estimating racial differences in telomere length using data from the National Health and Nutrition Examination Survey. We build a propensity for race to properly adjust for other social determinants while characterizing the controlled effect of race on telomere length. We find that evidence of racial differences in telomere length between Black and White individuals attenuates after accounting for confounding by socioeconomic factors and after utilizing appropriate propensity score and survey weighting techniques. Software to implement these methods can be found in the R package svycdiff at https://github.com/salernos/svycdiff. △ Less

Submitted 27 June, 2024; originally announced June 2024.

Leveraging Large Language Models for Knowledge-free Weak Supervision in Clinical Natural Language Processing

Authors: Enshuo Hsu, Kirk Roberts

Abstract: The performance of deep learning-based natural language processing systems is based on large amounts of labeled training data which, in the clinical domain, are not easily available or affordable. Weak supervision and in-context learning offer partial solutions to this issue, particularly using large language models (LLMs), but their performance still trails traditional supervised methods with mod… ▽ More The performance of deep learning-based natural language processing systems is based on large amounts of labeled training data which, in the clinical domain, are not easily available or affordable. Weak supervision and in-context learning offer partial solutions to this issue, particularly using large language models (LLMs), but their performance still trails traditional supervised methods with moderate amounts of gold-standard data. In particular, inferencing with LLMs is computationally heavy. We propose an approach leveraging fine-tuning LLMs and weak supervision with virtually no domain knowledge that still achieves consistently dominant performance. Using a prompt-based approach, the LLM is used to generate weakly-labeled data for training a downstream BERT model. The weakly supervised model is then further fine-tuned on small amounts of gold standard data. We evaluate this approach using Llama2 on three different n2c2 datasets. With no more than 10 gold standard notes, our final BERT models weakly supervised by fine-tuned Llama2-13B consistently outperformed out-of-the-box PubMedBERT by 4.7% to 47.9% in F1 scores. With only 50 gold standard notes, our models achieved close performance to fully fine-tuned systems. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Exploring the Generalization of Cancer Clinical Trial Eligibility Classifiers Across Diseases

Authors: Yumeng Yang, Ashley Gilliam, Ethan B Ludmir, Kirk Roberts

Abstract: Clinical trials are pivotal in medical research, and NLP can enhance their success, with application in recruitment. This study aims to evaluate the generalizability of eligibility classification across a broad spectrum of clinical trials. Starting with phase 3 cancer trials, annotated with seven eligibility exclusions, then to determine how well models can generalize to non-cancer and non-phase 3… ▽ More Clinical trials are pivotal in medical research, and NLP can enhance their success, with application in recruitment. This study aims to evaluate the generalizability of eligibility classification across a broad spectrum of clinical trials. Starting with phase 3 cancer trials, annotated with seven eligibility exclusions, then to determine how well models can generalize to non-cancer and non-phase 3 trials. To assess this, we have compiled eligibility criteria data for five types of trials: (1) additional phase 3 cancer trials, (2) phase 1 and 2 cancer trials, (3) heart disease trials, (4) type 2 diabetes trials, and (5) observational trials for any disease, comprising 2,490 annotated eligibility criteria across seven exclusion types. Our results show that models trained on the extensive cancer dataset can effectively handle criteria commonly found in non-cancer trials, such as autoimmune diseases. However, they struggle with criteria disproportionately prevalent in cancer trials, like prior malignancy. We also experiment with few-shot learning, demonstrating that a limited number of disease-specific examples can partially overcome this performance gap. We are releasing this new dataset of annotated eligibility statements to promote the development of cross-disease generalization in clinical trial classification. △ Less

Submitted 25 March, 2024; originally announced March 2024.

A 3-D Full-Wave Model to Study the Impact of Soybean Components and Structure on L-Band Backscatter

Authors: Kaiser Niknam, Jasmeet Judge, A. Kaleo Roberts, Alejandro Monsivais-Huertero, Robert Moore, Kamal Sarabandi, Jiayi Wu

Abstract: Microwave remote sensing offers a powerful tool for monitoring the growth of short, dense vegetation like soybean. As the plants mature, changes in their biomass and 3-D structure impact the electromagnetic (EM) backscatter signal. This backscatter information holds valuable insights into crop health and yield, prompting the need for a comprehensive understanding of how structural and biophysical… ▽ More Microwave remote sensing offers a powerful tool for monitoring the growth of short, dense vegetation like soybean. As the plants mature, changes in their biomass and 3-D structure impact the electromagnetic (EM) backscatter signal. This backscatter information holds valuable insights into crop health and yield, prompting the need for a comprehensive understanding of how structural and biophysical properties of soybeans as well as soil characteristics contribute to the overall backscatter signature. In this study, a full-wave model is developed for simulating L-band backscatter from soybean fields. Leveraging the ANSYS High-Frequency Structure Simulator (HFSS) framework, the model solves for the scattering of EM waves from realistic 3-D structural models of soybean, explicitly incorporating the interplant scattering effects. The model estimates of backscatter match well with the field observations from the SMAPVEX16-MicroWEX and SMAPVEX12, with average differences of 1-2 dB for co-pol and less than 4 dB for cross-pol. Furthermore, the model effectively replicates the temporal dynamics of crop backscatter throughout the growing season. The HFSS analysis revealed that the stems and pods are the primary contributors to HH-pol backscatter, while the branches contribute to VV-pol, and leaves impact the cross-pol signatures. In addition, a sensitivity study with 3-D bare soil surface resulted in an average variation of 8 dB in co- and cross-pol, even when the root mean square height and correlation length were held constant. △ Less

Submitted 3 February, 2024; originally announced February 2024.

Question Answering for Electronic Health Records: A Sco** Review of datasets and models

Authors: Jayetri Bardhan, Kirk Roberts, Daisy Zhe Wang

Abstract: Question Answering (QA) systems on patient-related data can assist both clinicians and patients. They can, for example, assist clinicians in decision-making and enable patients to have a better understanding of their medical history. Significant amounts of patient data are stored in Electronic Health Records (EHRs), making EHR QA an important research area. In EHR QA, the answer is obtained from t… ▽ More Question Answering (QA) systems on patient-related data can assist both clinicians and patients. They can, for example, assist clinicians in decision-making and enable patients to have a better understanding of their medical history. Significant amounts of patient data are stored in Electronic Health Records (EHRs), making EHR QA an important research area. In EHR QA, the answer is obtained from the medical record of the patient. Because of the differences in data format and modality, this differs greatly from other medical QA tasks that employ medical websites or scientific papers to retrieve answers, making it critical to research EHR question answering. This study aimed to provide a methodological review of existing works on QA over EHRs. We searched for articles from January 1st, 2005 to September 30th, 2023 in four digital sources including Google Scholar, ACL Anthology, ACM Digital Library, and PubMed to collect relevant publications on EHR QA. 4111 papers were identified for our study, and after screening based on our inclusion criteria, we obtained a total of 47 papers for further study. Out of the 47 papers, 25 papers were about EHR QA datasets, and 37 papers were about EHR QA models. It was observed that QA on EHRs is relatively new and unexplored. Most of the works are fairly recent. Also, it was observed that emrQA is by far the most popular EHR QA dataset, both in terms of citations and usage in other papers. Furthermore, we identified the different models used in EHR QA along with the evaluation metrics used for these models. △ Less

Submitted 7 November, 2023; v1 submitted 12 October, 2023; originally announced October 2023.

Comments: 5 tables, 6 figures

Text Classification of Cancer Clinical Trial Eligibility Criteria

Authors: Yumeng Yang, Soumya Jayaraj, Ethan B Ludmir, Kirk Roberts

Abstract: Automatic identification of clinical trials for which a patient is eligible is complicated by the fact that trial eligibility is stated in natural language. A potential solution to this problem is to employ text classification methods for common types of eligibility criteria. In this study, we focus on seven common exclusion criteria in cancer trials: prior malignancy, human immunodeficiency virus… ▽ More Automatic identification of clinical trials for which a patient is eligible is complicated by the fact that trial eligibility is stated in natural language. A potential solution to this problem is to employ text classification methods for common types of eligibility criteria. In this study, we focus on seven common exclusion criteria in cancer trials: prior malignancy, human immunodeficiency virus, hepatitis B, hepatitis C, psychiatric illness, drug/substance abuse, and autoimmune illness. Our dataset consists of 764 phase III cancer trials with these exclusions annotated at the trial level. We experiment with common transformer models as well as a new pre-trained clinical trial BERT model. Our results demonstrate the feasibility of automatically classifying common exclusion criteria. Additionally, we demonstrate the value of a pre-trained language model specifically for clinical trials, which yields the highest average performance across all criteria. △ Less

Submitted 15 September, 2023; v1 submitted 14 September, 2023; originally announced September 2023.

Comments: AMIA Annual Symposium Proceedings 2023

Solar Cells, Lambert W and the LogWright Functions

Authors: Prabhat Lankireddy, Sibibalan Jeevanandam, Aditya Chaudhary, P. C. Deshmukh, Ken Roberts, S. R. Valluri

Abstract: Algorithms that calculate the current-voltage (I-V) characteristics of a solar cell play an important role in processes that aim to improve the efficiency of a solar cell. I-V characteristics can be obtained from different models used to represent the solar cell, and the single diode model is a simple yet accurate model for common field implementations. However, the I-V characteristics are obtaine… ▽ More Algorithms that calculate the current-voltage (I-V) characteristics of a solar cell play an important role in processes that aim to improve the efficiency of a solar cell. I-V characteristics can be obtained from different models used to represent the solar cell, and the single diode model is a simple yet accurate model for common field implementations. However, the I-V characteristics are obtained by solving implicit equations, which involve repeated iterations and inherent errors associated with numerical methods used. Some methods use the Lambert W function to get an exact explicit formula, but often causes numerical overflow problems. The present work discusses an algorithm to calculate I-V characteristics using the LogWright function, a transformation of the Lambert W function, which addresses the problem of arithmetic overflow that occurs in the Lambert W implementation. An implementation of this algorithm is presented and compared against other algorithms in the literature. It is observed that in addition to addressing the numerical overflow problem, the algorithm based on the LogWright function offers speed benefits while retaining high precision. △ Less

Submitted 16 July, 2023; originally announced July 2023.

Comments: 6 pages, 3 figures. For associated code, see https://github.com/pace577/logwright-solar-cell.git

Evaluation of AI Chatbots for Patient-Specific EHR Questions

Authors: Alaleh Hamidi, Kirk Roberts

Abstract: This paper investigates the use of artificial intelligence chatbots for patient-specific question answering (QA) from clinical notes using several large language model (LLM) based systems: ChatGPT (versions 3.5 and 4), Google Bard, and Claude. We evaluate the accuracy, relevance, comprehensiveness, and coherence of the answers generated by each model using a 5-point Likert scale on a set of patien… ▽ More This paper investigates the use of artificial intelligence chatbots for patient-specific question answering (QA) from clinical notes using several large language model (LLM) based systems: ChatGPT (versions 3.5 and 4), Google Bard, and Claude. We evaluate the accuracy, relevance, comprehensiveness, and coherence of the answers generated by each model using a 5-point Likert scale on a set of patient-specific questions. △ Less

Submitted 4 June, 2023; originally announced June 2023.

Eye-SpatialNet: Spatial Information Extraction from Ophthalmology Notes

Authors: Surabhi Datta, Tasneem Kaochar, Hio Cheng Lam, Nelly Nwosu, Luca Giancardo, Alice Z. Chuang, Robert M. Feldman, Kirk Roberts

Abstract: We introduce an annotated corpus of 600 ophthalmology notes labeled with detailed spatial and contextual information of ophthalmic entities. We extend our previously proposed frame semantics-based spatial representation schema, Rad-SpatialNet, to represent spatial language in ophthalmology text, resulting in the Eye-SpatialNet schema. The spatially-grounded entities are findings, procedures, and d… ▽ More We introduce an annotated corpus of 600 ophthalmology notes labeled with detailed spatial and contextual information of ophthalmic entities. We extend our previously proposed frame semantics-based spatial representation schema, Rad-SpatialNet, to represent spatial language in ophthalmology text, resulting in the Eye-SpatialNet schema. The spatially-grounded entities are findings, procedures, and drugs. To accurately capture all spatial details, we add some domain-specific elements in Eye-SpatialNet. The annotated corpus contains 1715 spatial triggers, 7308 findings, 2424 anatomies, and 9914 descriptors. To automatically extract the spatial information, we employ a two-turn question answering approach based on the transformer language model BERT. The results are promising, with F1 scores of 89.31, 74.86, and 88.47 for spatial triggers, Figure, and Ground frame elements, respectively. This is the first work to represent and extract a wide variety of clinical information in ophthalmology. Extracting detailed information can benefit ophthalmology applications and research targeted toward disease progression and screening. △ Less

Submitted 19 May, 2023; originally announced May 2023.

Improving Large Language Models for Clinical Named Entity Recognition via Prompt Engineering

Authors: Yan Hu, Qingyu Chen, **gcheng Du, Xueqing Peng, Vipina Kuttichi Keloth, Xu Zuo, Yujia Zhou, Zehan Li, Xiaoqian Jiang, Zhiyong Lu, Kirk Roberts, Hua Xu

Abstract: Objective: This study quantifies the capabilities of GPT-3.5 and GPT-4 for clinical named entity recognition (NER) tasks and proposes task-specific prompts to improve their performance. Materials and Methods: We evaluated these models on two clinical NER tasks: (1) to extract medical problems, treatments, and tests from clinical notes in the MTSamples corpus, following the 2010 i2b2 concept extrac… ▽ More Objective: This study quantifies the capabilities of GPT-3.5 and GPT-4 for clinical named entity recognition (NER) tasks and proposes task-specific prompts to improve their performance. Materials and Methods: We evaluated these models on two clinical NER tasks: (1) to extract medical problems, treatments, and tests from clinical notes in the MTSamples corpus, following the 2010 i2b2 concept extraction shared task, and (2) identifying nervous system disorder-related adverse events from safety reports in the vaccine adverse event reporting system (VAERS). To improve the GPT models' performance, we developed a clinical task-specific prompt framework that includes (1) baseline prompts with task description and format specification, (2) annotation guideline-based prompts, (3) error analysis-based instructions, and (4) annotated samples for few-shot learning. We assessed each prompt's effectiveness and compared the models to BioClinicalBERT. Results: Using baseline prompts, GPT-3.5 and GPT-4 achieved relaxed F1 scores of 0.634, 0.804 for MTSamples, and 0.301, 0.593 for VAERS. Additional prompt components consistently improved model performance. When all four components were used, GPT-3.5 and GPT-4 achieved relaxed F1 socres of 0.794, 0.861 for MTSamples and 0.676, 0.736 for VAERS, demonstrating the effectiveness of our prompt framework. Although these results trail BioClinicalBERT (F1 of 0.901 for the MTSamples dataset and 0.802 for the VAERS), it is very promising considering few training samples are needed. Conclusion: While direct application of GPT models to clinical NER tasks falls short of optimal performance, our task-specific prompt framework, incorporating medical knowledge and training samples, significantly enhances GPT models' feasibility for potential clinical applications. △ Less

Submitted 24 January, 2024; v1 submitted 28 March, 2023; originally announced March 2023.

Comments: 17 pages, 5 tables, 6 figure

Application of an ontology for model cards to generate computable artifacts for linking machine learning information from biomedical research

Authors: Muhammad Amith, Licong Cui, Kirk Roberts, Cui Tao

Abstract: Model card reports provide a transparent description of machine learning models which includes information about their evaluation, limitations, intended use, etc. Federal health agencies have expressed an interest in model cards report for research studies using machine-learning based AI. Previously, we have developed an ontology model for model card reports to structure and formalize these report… ▽ More Model card reports provide a transparent description of machine learning models which includes information about their evaluation, limitations, intended use, etc. Federal health agencies have expressed an interest in model cards report for research studies using machine-learning based AI. Previously, we have developed an ontology model for model card reports to structure and formalize these reports. In this paper, we demonstrate a Java-based library (OWL API, FaCT++) that leverages our ontology to publish computable model card reports. We discuss future directions and other use cases that highlight applicability and feasibility of ontology-driven systems to support FAIR challenges. △ Less

Submitted 21 March, 2023; originally announced March 2023.

Journal ref: Companion Proceedings of the ACM Web Conference 2023

Surrogacy Validation for Time-to-Event Outcomes with Illness-Death Frailty Models

Authors: Emily K. Roberts, Michael R. Elliott, Jeremy M. G. Taylor

Abstract: A common practice in clinical trials is to evaluate a treatment effect on an intermediate endpoint when the true outcome of interest would be difficult or costly to measure. We consider how to validate intermediate endpoints in a causally-valid way when the trial outcomes are time-to-event. Using counterfactual outcomes, those that would be observed if the counterfactual treatment had been given,… ▽ More A common practice in clinical trials is to evaluate a treatment effect on an intermediate endpoint when the true outcome of interest would be difficult or costly to measure. We consider how to validate intermediate endpoints in a causally-valid way when the trial outcomes are time-to-event. Using counterfactual outcomes, those that would be observed if the counterfactual treatment had been given, the causal association paradigm assesses the relationship of the treatment effect on the surrogate $S$ with the treatment effect on the true endpoint $T$. In particular, we propose illness death models to accommodate the censored and semi-competing risk structure of survival data. The proposed causal version of these models involves estimable and counterfactual frailty terms. Via these multi-state models, we characterize what a valid surrogate would look like using a causal effect predictiveness plot. We evaluate the estimation properties of a Bayesian method using Markov Chain Monte Carlo and assess the sensitivity of our model assumptions. Our motivating data source is a localized prostate cancer clinical trial where the two survival endpoints are time to distant metastasis and time to death. △ Less

Submitted 28 November, 2022; originally announced November 2022.

Toward a Neural Semantic Parsing System for EHR Question Answering

Authors: Sarvesh Soni, Kirk Roberts

Abstract: Clinical semantic parsing (SP) is an important step toward identifying the exact information need (as a machine-understandable logical form) from a natural language query aimed at retrieving information from electronic health records (EHRs). Current approaches to clinical SP are largely based on traditional machine learning and require hand-building a lexicon. The recent advancements in neural SP… ▽ More Clinical semantic parsing (SP) is an important step toward identifying the exact information need (as a machine-understandable logical form) from a natural language query aimed at retrieving information from electronic health records (EHRs). Current approaches to clinical SP are largely based on traditional machine learning and require hand-building a lexicon. The recent advancements in neural SP show a promise for building a robust and flexible semantic parser without much human effort. Thus, in this paper, we aim to systematically assess the performance of two such neural SP models for EHR question answering (QA). We found that the performance of these advanced neural models on two clinical SP datasets is promising given their ease of application and generalizability. Our error analysis surfaces the common types of errors made by these models and has the potential to inform future research into improving the performance of neural SP models for EHR QA. △ Less

Submitted 8 November, 2022; originally announced November 2022.

Comments: Accepted at the AMIA Annual Symposium 2022 (10 pages, 5 tables, 1 figure)

Lambert W Lines and Finite Square Well Sensors

Authors: Ken Roberts, Najeh Jisrawi, J. Jeyasitharam, Shreyas Suresh, P. C. Deshmukh, S. R. Valluri

Abstract: The bound state energies of a 1-dimensional finite quantum square well (FSW) can be determined using a geometric method, involving a smooth map** between two copies of the complex plane. The method allows one to identify particular strengths of the FSW at which the system can become unusually sensitive to changes in the well depth or geometry. In the present paper we explore that sensitivity, an… ▽ More The bound state energies of a 1-dimensional finite quantum square well (FSW) can be determined using a geometric method, involving a smooth map** between two copies of the complex plane. The method allows one to identify particular strengths of the FSW at which the system can become unusually sensitive to changes in the well depth or geometry. In the present paper we explore that sensitivity, and exhibit a 3-D visualization of the solutions. △ Less

Submitted 12 October, 2022; originally announced October 2022.

Comments: 34 pages, 11 figures, 1 table

DrugEHRQA: A Question Answering Dataset on Structured and Unstructured Electronic Health Records For Medicine Related Queries

Authors: Jayetri Bardhan, Anthony Colas, Kirk Roberts, Daisy Zhe Wang

Abstract: This paper develops the first question answering dataset (DrugEHRQA) containing question-answer pairs from both structured tables and unstructured notes from a publicly available Electronic Health Record (EHR). EHRs contain patient records, stored in structured tables and unstructured clinical notes. The information in structured and unstructured EHRs is not strictly disjoint: information may be d… ▽ More This paper develops the first question answering dataset (DrugEHRQA) containing question-answer pairs from both structured tables and unstructured notes from a publicly available Electronic Health Record (EHR). EHRs contain patient records, stored in structured tables and unstructured clinical notes. The information in structured and unstructured EHRs is not strictly disjoint: information may be duplicated, contradictory, or provide additional context between these sources. Our dataset has medication-related queries, containing over 70,000 question-answer pairs. To provide a baseline model and help analyze the dataset, we have used a simple model (MultimodalEHRQA) which uses the predictions of a modality selection network to choose between EHR tables and clinical notes to answer the questions. This is used to direct the questions to the table-based or text-based state-of-the-art QA model. In order to address the problem arising from complex, nested queries, this is the first time Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers (RAT-SQL) has been used to test the structure of query templates in EHR data. Our goal is to provide a benchmark dataset for multi-modal QA systems, and to open up new avenues of research in improving question answering over EHR structured data by using context from unstructured clinical data. △ Less

Submitted 2 May, 2022; originally announced May 2022.

Comments: 15 pages (including Appendix section), 7 figures

${\tt simwave}$ -- A Finite Difference Simulator for Acoustic Waves Propagation

Authors: Jaime Freire de Souza, João Baptista Dias Moreira, Keith Jared Roberts, Roussian di Ramos Alves Gaioso, Edson Satoshi Gomi, Emílio Carlos Nelli Silva, Hermes Senger

Abstract: ${\tt simwave}$ is an open-source Python package to perform wave simulations in 2D or 3D domains. It solves the constant and variable density acoustic wave equation with the finite difference method and has support for domain truncation techniques, several boundary conditions, and the modeling of sources and receivers given a user-defined acquisition geometry. The architecture of ${\tt simwave}$ i… ▽ More ${\tt simwave}$ is an open-source Python package to perform wave simulations in 2D or 3D domains. It solves the constant and variable density acoustic wave equation with the finite difference method and has support for domain truncation techniques, several boundary conditions, and the modeling of sources and receivers given a user-defined acquisition geometry. The architecture of ${\tt simwave}$ is designed for applications with geophysical exploration in mind. Its Python front-end enables straightforward integration with many existing Python scientific libraries for the composition of more complex workflows and applications (e.g., migration and inversion problems). The back-end is implemented in C enabling performance portability across a range of computing hardware and compilers including both CPUs and GPUs. △ Less

Submitted 13 January, 2022; originally announced January 2022.

Deep learning-based NLP Data Pipeline for EHR Scanned Document Information Extraction

Authors: Enshuo Hsu, Ioannis Malagaris, Yong-Fang Kuo, Rizwana Sultana, Kirk Roberts

Abstract: Scanned documents in electronic health records (EHR) have been a challenge for decades, and are expected to stay in the foreseeable future. Current approaches for processing often include image preprocessing, optical character recognition (OCR), and text mining. However, there is limited work that evaluates the choice of image preprocessing methods, the selection of NLP models, and the role of doc… ▽ More Scanned documents in electronic health records (EHR) have been a challenge for decades, and are expected to stay in the foreseeable future. Current approaches for processing often include image preprocessing, optical character recognition (OCR), and text mining. However, there is limited work that evaluates the choice of image preprocessing methods, the selection of NLP models, and the role of document layout. The impact of each element remains unknown. We evaluated this method on a use case of two key indicators for sleep apnea, Apnea hypopnea index (AHI) and oxygen saturation (SaO2) values, from scanned sleep study reports. Our data that included 955 manually annotated reports was secondarily utilized from a previous study in the University of Texas Medical Branch. We performed image preprocessing: gray-scaling followed by 1 iteration of dilating and erode, and 20% contrast increasing. The OCR was implemented with the Tesseract OCR engine. A total of seven Bag-of-Words models (Logistic Regression, Ridge Regression, Lasso Regression, Support Vector Machine, k-Nearest Neighbor, Naïve Bayes, and Random Forest) and three deep learning-based models (BiLSTM, BERT, and Clinical BERT) were evaluated. We also evaluated the combinations of image preprocessing methods (gray-scaling, dilate & erode, increased contrast by 20%, increased contrast by 60%), and two deep learning architectures (with and without structured input that provides document layout information). Our proposed method using Clinical BERT reached an AUROC of 0.9743 and document accuracy of 94.76% for AHI, and an AUROC of 0.9523, and document accuracy of 91.61% for SaO2. We demonstrated the proper use of image preprocessing and document layout could be beneficial to scanned document processing. △ Less

Submitted 13 September, 2021; originally announced October 2021.

Comments: 6 tables, 7 figures

Full waveform inversion using triangular waveform adapted meshes

Authors: Keith J. Roberts, Alexandre Olender, Lucas Franceschini, Robert C. Kirby, Rafael S. Gioria, Bruno S. Carmo

Abstract: In this article, continuous Galerkin finite elements are applied to perform full waveform inversion (FWI) for seismic velocity model building. A time-domain FWI approach is detailed that uses meshes composed of variably sized triangular elements to discretize the domain. To resolve both the forward and adjoint-state equations, and to calculate a mesh-independent gradient associated with the FWI pr… ▽ More In this article, continuous Galerkin finite elements are applied to perform full waveform inversion (FWI) for seismic velocity model building. A time-domain FWI approach is detailed that uses meshes composed of variably sized triangular elements to discretize the domain. To resolve both the forward and adjoint-state equations, and to calculate a mesh-independent gradient associated with the FWI process, a fully-explicit, variable higher-order (up to degree $k=5$ in $2$D and $k=3$ in 3D) mass lum** method is used. By adapting the triangular elements to the expected peak source frequency and properties of the wavefield (e.g., local P-wavespeed) and by leveraging higher-order basis functions, the number of degrees-of-freedom necessary to discretize the domain can be reduced. Results from wave simulations and FWIs in both $2$D and 3D highlight our developments and demonstrate the benefits and challenges with using triangular meshes adapted to the material proprieties. Software developments are implemented an open source code built on top of Firedrake, a high-level Python package for the automated solution of partial differential equations using the finite element method. △ Less

Submitted 24 August, 2021; originally announced August 2021.

Searching for Scientific Evidence in a Pandemic: An Overview of TREC-COVID

Authors: Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen Voorhees, Lucy Lu Wang, William R Hersh

Abstract: We present an overview of the TREC-COVID Challenge, an information retrieval (IR) shared task to evaluate search on scientific literature related to COVID-19. The goals of TREC-COVID include the construction of a pandemic search test collection and the evaluation of IR methods for COVID-19. The challenge was conducted over five rounds from April to July, 2020, with participation from 92 unique tea… ▽ More We present an overview of the TREC-COVID Challenge, an information retrieval (IR) shared task to evaluate search on scientific literature related to COVID-19. The goals of TREC-COVID include the construction of a pandemic search test collection and the evaluation of IR methods for COVID-19. The challenge was conducted over five rounds from April to July, 2020, with participation from 92 unique teams and 556 individual submissions. A total of 50 topics (sets of related queries) were used in the evaluation, starting at 30 topics for Round 1 and adding 5 new topics per round to target emerging topics at that state of the still-emerging pandemic. This paper provides a comprehensive overview of the structure and results of TREC-COVID. Specifically, the paper provides details on the background, task structure, topic structure, corpus, participation, pooling, assessment, judgments, results, top-performing systems, lessons learned, and benchmark datasets. △ Less

Submitted 19 April, 2021; originally announced April 2021.

Three-level Hierarchical Transformer Networks for Long-sequence and Multiple Clinical Documents Classification

Authors: Yuqi Si, Kirk Roberts

Abstract: We present a Three-level Hierarchical Transformer Network (3-level-HTN) for modeling long-term dependencies across clinical notes for the purpose of patient-level prediction. The network is equipped with three levels of Transformer-based encoders to learn progressively from words to sentences, sentences to notes, and finally notes to patients. The first level from word to sentence directly applies… ▽ More We present a Three-level Hierarchical Transformer Network (3-level-HTN) for modeling long-term dependencies across clinical notes for the purpose of patient-level prediction. The network is equipped with three levels of Transformer-based encoders to learn progressively from words to sentences, sentences to notes, and finally notes to patients. The first level from word to sentence directly applies a pre-trained BERT model as a fully trainable component. While the second and third levels both implement a stack of transformer-based encoders, before the final patient representation is fed into a classification layer for clinical predictions. Compared to conventional BERT models, our model increases the maximum input length from 512 tokens to much longer sequences that are appropriate for modeling large numbers of clinical notes. We empirically examine different hyper-parameters to identify an optimal trade-off given computational resource limits. Our experiment results on the MIMIC-III dataset for different prediction tasks demonstrate that the proposed Hierarchical Transformer Network outperforms previous state-of-the-art models, including but not limited to BigBird. △ Less

Submitted 16 December, 2021; v1 submitted 17 April, 2021; originally announced April 2021.

Comments: Codes are available at https://github.com/Yuqi92/3-level-HTN-MIMIC

Generalized and Transferable Patient Language Representation for Phenoty** with Limited Data

Authors: Yuqi Si, Elmer V Bernstam, Kirk Roberts

Abstract: The paradigm of representation learning through transfer learning has the potential to greatly enhance clinical natural language processing. In this work, we propose a multi-task pre-training and fine-tuning approach for learning generalized and transferable patient representations from medical language. The model is first pre-trained with different but related high-prevalence phenotypes and furth… ▽ More The paradigm of representation learning through transfer learning has the potential to greatly enhance clinical natural language processing. In this work, we propose a multi-task pre-training and fine-tuning approach for learning generalized and transferable patient representations from medical language. The model is first pre-trained with different but related high-prevalence phenotypes and further fine-tuned on downstream target tasks. Our main contribution focuses on the impact this technique can have on low-prevalence phenotypes, a challenging task due to the dearth of data. We validate the representation from pre-training, and fine-tune the multi-task pre-trained models on low-prevalence phenotypes including 38 circulatory diseases, 23 respiratory diseases, and 17 genitourinary diseases. We find multi-task pre-training increases learning efficiency and achieves consistently high performance across the majority of phenotypes. Most important, the multi-task pre-training is almost always either the best-performing model or performs tolerably close to the best-performing model, a property we refer to as robust. All these results lead us to conclude that this multi-task transfer learning architecture is a robust approach for develo** generalized and transferable patient language representations for numerous phenotypes. △ Less

Submitted 24 February, 2021; originally announced March 2021.

Comments: Journal of Biomedical Informatics (in press)

Noise2Stack: Improving Image Restoration by Learning from Volumetric Data

Authors: Mikhail Papkov, Kenny Roberts, Lee Ann Madissoon, Omer Bayraktar, Dmytro Fishman, Kaupo Palo, Leopold Parts

Abstract: Biomedical images are noisy. The imaging equipment itself has physical limitations, and the consequent experimental trade-offs between signal-to-noise ratio, acquisition speed, and imaging depth exacerbate the problem. Denoising is, therefore, an essential part of any image processing pipeline, and convolutional neural networks are currently the method of choice for this task. One popular approach… ▽ More Biomedical images are noisy. The imaging equipment itself has physical limitations, and the consequent experimental trade-offs between signal-to-noise ratio, acquisition speed, and imaging depth exacerbate the problem. Denoising is, therefore, an essential part of any image processing pipeline, and convolutional neural networks are currently the method of choice for this task. One popular approach, Noise2Noise, does not require clean ground truth, and instead, uses a second noisy copy as a training target. Self-supervised methods, like Noise2Self and Noise2Void, relax data requirements by learning the signal without an explicit target but are limited by the lack of information in a single image. Here, we introduce Noise2Stack, an extension of the Noise2Noise method to image stacks that takes advantage of a shared signal between spatially neighboring planes. Our experiments on magnetic resonance brain scans and newly acquired multiplane microscopy data show that learning only from image neighbors in a stack is sufficient to outperform Noise2Noise and Noise2Void and close the gap to supervised denoising methods. Our findings point towards low-cost, high-reward improvement in the denoising pipeline of multiplane biomedical images. As a part of this work, we release a microscopy dataset to establish a benchmark for the multiplane image denoising. △ Less

Submitted 10 November, 2020; originally announced November 2020.

Leveraging Spatial Information in Radiology Reports for Ischemic Stroke Phenoty**

Authors: Surabhi Datta, Shekhar Khanpara, Roy F. Riascos, Kirk Roberts

Abstract: Classifying fine-grained ischemic stroke phenotypes relies on identifying important clinical information. Radiology reports provide relevant information with context to determine such phenotype information. We focus on stroke phenotypes with location-specific information: brain region affected, laterality, stroke stage, and lacunarity. We use an existing fine-grained spatial information extraction… ▽ More Classifying fine-grained ischemic stroke phenotypes relies on identifying important clinical information. Radiology reports provide relevant information with context to determine such phenotype information. We focus on stroke phenotypes with location-specific information: brain region affected, laterality, stroke stage, and lacunarity. We use an existing fine-grained spatial information extraction system--Rad-SpatialNet--to identify clinically important information and apply simple domain rules on the extracted information to classify phenotypes. The performance of our proposed approach is promising (recall of 89.62% for classifying brain region and 74.11% for classifying brain region, side, and stroke stage together). Our work demonstrates that an information extraction system based on a fine-grained schema can be utilized to determine complex phenotypes with the inclusion of simple domain rules. These phenotypes have the potential to facilitate stroke research focusing on post-stroke outcome and treatment planning based on the stroke location. △ Less

Submitted 10 October, 2020; originally announced October 2020.

Deep Representation Learning of Patient Data from Electronic Health Records (EHR): A Systematic Review

Authors: Yuqi Si, **gcheng Du, Zhao Li, Xiaoqian Jiang, Timothy Miller, Fei Wang, W. Jim Zheng, Kirk Roberts

Abstract: Patient representation learning refers to learning a dense mathematical representation of a patient that encodes meaningful information from Electronic Health Records (EHRs). This is generally performed using advanced deep learning methods. This study presents a systematic review of this field and provides both qualitative and quantitative analyses from a methodological perspective. We identified… ▽ More Patient representation learning refers to learning a dense mathematical representation of a patient that encodes meaningful information from Electronic Health Records (EHRs). This is generally performed using advanced deep learning methods. This study presents a systematic review of this field and provides both qualitative and quantitative analyses from a methodological perspective. We identified studies develo** patient representations from EHRs with deep learning methods from MEDLINE, EMBASE, Scopus, the Association for Computing Machinery (ACM) Digital Library, and Institute of Electrical and Electronics Engineers (IEEE) Xplore Digital Library. After screening 363 articles, 49 papers were included for a comprehensive data collection. We noticed a typical workflow starting with feeding raw data, applying deep learning models, and ending with clinical outcome predictions as evaluations of the learned representations. Specifically, learning representations from structured EHR data was dominant (37 out of 49 studies). Recurrent Neural Networks were widely applied as the deep learning architecture (LSTM: 13 studies, GRU: 11 studies). Disease prediction was the most common application and evaluation (31 studies). Benchmark datasets were mostly unavailable (28 studies) due to privacy concerns of EHR data, and code availability was assured in 20 studies. We show the importance and feasibility of learning comprehensive representations of patient EHR data through a systematic review. Advances in patient representation learning techniques will be essential for powering patient-level EHR analyses. Future work will still be devoted to leveraging the richness and potential of available EHR data. Knowledge distillation and advanced learning techniques will be exploited to assist the capability of learning patient representation further. △ Less

Submitted 16 November, 2020; v1 submitted 6 October, 2020; originally announced October 2020.

Extracting Concepts for Precision Oncology from the Biomedical Literature

Authors: Nicholas Greenspan, Yuqi Si, Kirk Roberts

Abstract: This paper describes an initial dataset and automatic natural language processing (NLP) method for extracting concepts related to precision oncology from biomedical research articles. We extract five concept types: Cancer, Mutation, Population, Treatment, Outcome. A corpus of 250 biomedical abstracts were annotated with these concepts following standard double-annotation procedures. We then experi… ▽ More This paper describes an initial dataset and automatic natural language processing (NLP) method for extracting concepts related to precision oncology from biomedical research articles. We extract five concept types: Cancer, Mutation, Population, Treatment, Outcome. A corpus of 250 biomedical abstracts were annotated with these concepts following standard double-annotation procedures. We then experiment with BERT-based models for concept extraction. The best-performing model achieved a precision of 63.8%, a recall of 71.9%, and an F1 of 67.1. Finally, we propose additional directions for research for improving extraction performance and utilizing the NLP system in downstream precision oncology applications. △ Less

Submitted 30 September, 2020; originally announced October 2020.

Towards real-time finite-strain anisotropic thermo-visco-elastodynamic analysis of soft tissues for thermal ablative therapy

Authors: **ao Zhang, Remi Jacob Lay, Stuart K. Roberts, Sunita Chauhan

Abstract: Accurate and efficient prediction of soft tissue temperatures is essential to computer-assisted treatment systems for thermal ablation. It can be used to predict tissue temperatures and ablation volumes for personalised treatment planning and image-guided intervention. Numerically, it requires full nonlinear modelling of the coupled computational bioheat transfer and biomechanics, and efficient so… ▽ More Accurate and efficient prediction of soft tissue temperatures is essential to computer-assisted treatment systems for thermal ablation. It can be used to predict tissue temperatures and ablation volumes for personalised treatment planning and image-guided intervention. Numerically, it requires full nonlinear modelling of the coupled computational bioheat transfer and biomechanics, and efficient solution procedures; however, existing studies considered the bioheat analysis alone or the coupled linear analysis, without the fully coupled nonlinear analysis. We present a coupled thermo-visco-hyperelastic finite element algorithm, based on finite-strain thermoelasticity and total Lagrangian explicit dynamics. It considers the coupled nonlinear analysis of (i) bioheat transfer under soft tissue deformations and (ii) soft tissue deformations due to thermal expansion/shrinkage. The presented method accounts for anisotropic, finite-strain, temperature-dependent, thermal, and viscoelastic behaviours of soft tissues, and it is implemented using GPU acceleration for real-time computation. We also demonstrate the translational benefits of the presented method for clinical applications using a simulation of thermal ablation in the liver. The key advantage of the presented method is that it enables full nonlinear modelling of the anisotropic, finite-strain, temperature-dependent, thermal, and viscoelastic behaviours of soft tissues, instead of linear elastic, linear viscoelastic, and thermal-only modelling in the existing methods. It also provides high computational speeds for computer-assisted treatment systems towards enabling the operator to simulate thermal ablation accurately and visualise tissue temperatures and ablation zones immediately. △ Less

Submitted 31 December, 2021; v1 submitted 22 September, 2020; originally announced September 2020.

Comments: Submitted to Computer Methods and Programs in Biomedicine

Journal ref: Computer Methods and Programs in Biomedicine, vol. 198, pp. 105789, 2021

RadLex Normalization in Radiology Reports

Authors: Surabhi Datta, Jordan Godfrey-Stovall, Kirk Roberts

Abstract: Radiology reports have been widely used for extraction of various clinically significant information about patients' imaging studies. However, limited research has focused on standardizing the entities to a common radiology-specific vocabulary. Further, no study to date has attempted to leverage RadLex for standardization. In this paper, we aim to normalize a diverse set of radiological entities t… ▽ More Radiology reports have been widely used for extraction of various clinically significant information about patients' imaging studies. However, limited research has focused on standardizing the entities to a common radiology-specific vocabulary. Further, no study to date has attempted to leverage RadLex for standardization. In this paper, we aim to normalize a diverse set of radiological entities to RadLex terms. We manually construct a normalization corpus by annotating entities from three types of reports. This contains 1706 entity mentions. We propose two deep learning-based NLP methods based on a pre-trained language model (BERT) for automatic normalization. First, we employ BM25 to retrieve candidate concepts for the BERT-based models (re-ranker and span detector) to predict the normalized concept. The results are promising, with the best accuracy (78.44%) obtained by the span detector. Additionally, we discuss the challenges involved in corpus construction and propose new RadLex terms. △ Less

Submitted 10 September, 2020; originally announced September 2020.

Comments: Accepted at the AMIA Annual Symposium 2020

Patient Cohort Retrieval using Transformer Language Models

Authors: Sarvesh Soni, Kirk Roberts

Abstract: We apply deep learning-based language models to the task of patient cohort retrieval (CR) with the aim to assess their efficacy. The task of CR requires the extraction of relevant documents from the electronic health records (EHRs) on the basis of a given query. Given the recent advancements in the field of document retrieval, we map the task of CR to a document retrieval task and apply various de… ▽ More We apply deep learning-based language models to the task of patient cohort retrieval (CR) with the aim to assess their efficacy. The task of CR requires the extraction of relevant documents from the electronic health records (EHRs) on the basis of a given query. Given the recent advancements in the field of document retrieval, we map the task of CR to a document retrieval task and apply various deep neural models implemented for the general domain tasks. In this paper, we propose a framework for retrieving patient cohorts using neural language models without the need of explicit feature engineering and domain expertise. We find that a majority of our models outperform the BM25 baseline method on various evaluation metrics. △ Less

Submitted 10 September, 2020; originally announced September 2020.

Comments: Accepted at the AMIA Annual Symposium 2020

An Evaluation of Two Commercial Deep Learning-Based Information Retrieval Systems for COVID-19 Literature

Authors: Sarvesh Soni, Kirk Roberts

Abstract: The COVID-19 pandemic has resulted in a tremendous need for access to the latest scientific information, primarily through the use of text mining and search tools. This has led to both corpora for biomedical articles related to COVID-19 (such as the CORD-19 corpus (Wang et al., 2020)) as well as search engines to query such data. While most research in search engines is performed in the academic f… ▽ More The COVID-19 pandemic has resulted in a tremendous need for access to the latest scientific information, primarily through the use of text mining and search tools. This has led to both corpora for biomedical articles related to COVID-19 (such as the CORD-19 corpus (Wang et al., 2020)) as well as search engines to query such data. While most research in search engines is performed in the academic field of information retrieval (IR), most academic search engines$\unicode{x2013}$though rigorously evaluated$\unicode{x2013}$are sparsely utilized, while major commercial web search engines (e.g., Google, Bing) dominate. This relates to COVID-19 because it can be expected that commercial search engines deployed for the pandemic will gain much higher traction than those produced in academic labs, and thus leads to questions about the empirical performance of these search tools. This paper seeks to empirically evaluate two such commercial search engines for COVID-19, produced by Google and Amazon, in comparison to the more academic prototypes evaluated in the context of the TREC-COVID track (Roberts et al., 2020). We performed several steps to reduce bias in the available manual judgments in order to ensure a fair comparison of the two systems with those submitted to TREC-COVID. We find that the top-performing system from TREC-COVID on bpref metric performed the best among the different systems evaluated in this study on all the metrics. This has implications for develo** biomedical retrieval systems for future health crises as well as trust in popular health search engines. △ Less

Submitted 27 July, 2020; v1 submitted 6 July, 2020; originally announced July 2020.

TREC-COVID: Constructing a Pandemic Information Retrieval Test Collection

Authors: Ellen Voorhees, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, William R Hersh, Kyle Lo, Kirk Roberts, Ian Soboroff, Lucy Lu Wang

Abstract: TREC-COVID is a community evaluation designed to build a test collection that captures the information needs of biomedical researchers using the scientific literature during a pandemic. One of the key characteristics of pandemic search is the accelerated rate of change: the topics of interest evolve as the pandemic progresses and the scientific literature in the area explodes. The COVID-19 pandemi… ▽ More TREC-COVID is a community evaluation designed to build a test collection that captures the information needs of biomedical researchers using the scientific literature during a pandemic. One of the key characteristics of pandemic search is the accelerated rate of change: the topics of interest evolve as the pandemic progresses and the scientific literature in the area explodes. The COVID-19 pandemic provides an opportunity to capture this progression as it happens. TREC-COVID, in creating a test collection around COVID-19 literature, is building infrastructure to support new research and technologies in pandemic search. △ Less

Submitted 9 May, 2020; originally announced May 2020.

Comments: 10 pages, 5 figures. TREC-COVID web site: http://ir.nist.gov/covidSubmit/ Will also appear in June 2020 issue of ACM SIGIR Forum

ACM Class: H.3.0

Understanding Spatial Language in Radiology: Representation Framework, Annotation, and Spatial Relation Extraction from Chest X-ray Reports using Deep Learning

Authors: Surabhi Datta, Yuqi Si, Laritza Rodriguez, Sonya E Shooshan, Dina Demner-Fushman, Kirk Roberts

Abstract: We define a representation framework for extracting spatial information from radiology reports (Rad-SpRL). We annotated a total of 2000 chest X-ray reports with 4 spatial roles corresponding to the common radiology entities. Our focus is on extracting detailed information of a radiologist's interpretation containing a radiographic finding, its anatomical location, corresponding probable diagnoses,… ▽ More We define a representation framework for extracting spatial information from radiology reports (Rad-SpRL). We annotated a total of 2000 chest X-ray reports with 4 spatial roles corresponding to the common radiology entities. Our focus is on extracting detailed information of a radiologist's interpretation containing a radiographic finding, its anatomical location, corresponding probable diagnoses, as well as associated hedging terms. For this, we propose a deep learning-based natural language processing (NLP) method involving both word and character-level encodings. Specifically, we utilize a bidirectional long short-term memory (Bi-LSTM) conditional random field (CRF) model for extracting the spatial roles. The model achieved average F1 measures of 90.28 and 94.61 for extracting the Trajector and Landmark roles respectively whereas the performance was moderate for Diagnosis and Hedge roles with average F1 of 71.47 and 73.27 respectively. The corpus will soon be made available upon request. △ Less

Submitted 13 August, 2019; originally announced August 2019.

An Analytic Study of the Wiedemann-Franz Law and the Thermoelectric Figure of Merit

Authors: Aakash Yadav, PC Deshmukh, Ken Roberts, NM Jisrawi, SR Valluri

Abstract: Advances in optimizing thermoelectric material efficiency have seen a parallel activity in theoretical and computational advances. In the current work, it is shown that the calculation of exact Fermi-Dirac integrals enables the generalization of the Wiedemann-Franz law (WF) to optimize the dimensionless thermoelectric figure of merit ZT. This is done by optimizing the Seebeck coefficient, the elec… ▽ More Advances in optimizing thermoelectric material efficiency have seen a parallel activity in theoretical and computational advances. In the current work, it is shown that the calculation of exact Fermi-Dirac integrals enables the generalization of the Wiedemann-Franz law (WF) to optimize the dimensionless thermoelectric figure of merit ZT. This is done by optimizing the Seebeck coefficient, the electrical conductivity and the thermal conductivity. In the calculation of the thermal conductivity, both electronic and phononic contributions are included. The solutions provide insight into the relevant parameter space including the physical significance of complex solutions and their dependence on the scattering parameter r and the reduced chemical potential. △ Less

Submitted 7 April, 2019; originally announced April 2019.

A frame semantic overview of NLP-based information extraction for cancer-related EHR notes

Authors: Surabhi Datta, Elmer V Bernstam, Kirk Roberts

Abstract: Objective: There is a lot of information about cancer in Electronic Health Record (EHR) notes that can be useful for biomedical research provided natural language processing (NLP) methods are available to extract and structure this information. In this paper, we present a sco** review of existing clinical NLP literature for cancer. Methods: We identified studies describing an NLP method to extra… ▽ More Objective: There is a lot of information about cancer in Electronic Health Record (EHR) notes that can be useful for biomedical research provided natural language processing (NLP) methods are available to extract and structure this information. In this paper, we present a sco** review of existing clinical NLP literature for cancer. Methods: We identified studies describing an NLP method to extract specific cancer-related information from EHR sources from PubMed, Google Scholar, ACL Anthology, and existing reviews. Two exclusion criteria were used in this study. We excluded articles where the extraction techniques used were too broad to be represented as frames and also where very low-level extraction methods were used. 79 articles were included in the final review. We organized this information according to frame semantic principles to help identify common areas of overlap and potential gaps. Results: Frames were created from the reviewed articles pertaining to cancer information such as cancer diagnosis, tumor description, cancer procedure, breast cancer diagnosis, prostate cancer diagnosis and pain in prostate cancer patients. These frames included both a definition as well as specific frame elements (i.e. extractable attributes). We found that cancer diagnosis was the most common frame among the reviewed papers (36 out of 79), with recent work focusing on extracting information related to treatment and breast cancer diagnosis. Conclusion: The list of common frames described in this paper identifies important cancer-related information extracted by existing NLP techniques and serves as a useful resource for future researchers requiring cancer information extracted from EHR notes. We also argue, due to the heavy duplication of cancer NLP systems, that a general purpose resource of annotated cancer frames and corresponding NLP tools would be valuable. △ Less

Submitted 2 April, 2019; originally announced April 2019.

Comments: 2 figures, 4 tables

Enhancing Clinical Concept Extraction with Contextual Embeddings

Authors: Yuqi Si, **gqi Wang, Hua Xu, Kirk Roberts

Abstract: Neural network-based representations ("embeddings") have dramatically advanced natural language processing (NLP) tasks, including clinical NLP tasks such as concept extraction. Recently, however, more advanced embedding methods and representations (e.g., ELMo, BERT) have further pushed the state-of-the-art in NLP, yet there are no common best practices for how to integrate these representations in… ▽ More Neural network-based representations ("embeddings") have dramatically advanced natural language processing (NLP) tasks, including clinical NLP tasks such as concept extraction. Recently, however, more advanced embedding methods and representations (e.g., ELMo, BERT) have further pushed the state-of-the-art in NLP, yet there are no common best practices for how to integrate these representations into clinical tasks. The purpose of this study, then, is to explore the space of possible options in utilizing these new models for clinical concept extraction, including comparing these to traditional word embedding methods (word2vec, GloVe, fastText). Both off-the-shelf open-domain embeddings and pre-trained clinical embeddings from MIMIC-III are evaluated. We explore a battery of embedding methods consisting of traditional word embeddings and contextual embeddings, and compare these on four concept extraction corpora: i2b2 2010, i2b2 2012, SemEval 2014, and SemEval 2015. We also analyze the impact of the pre-training time of a large language model like ELMo or BERT on the extraction performance. Last, we present an intuitive way to understand the semantic information encoded by contextual embeddings. Contextual embeddings pre-trained on a large clinical corpus achieves new state-of-the-art performances across all concept extraction tasks. The best-performing model outperforms all state-of-the-art methods with respective F1-measures of 90.25, 93.18 (partial), 80.74, and 81.65. We demonstrate the potential of contextual embeddings through the state-of-the-art performance these methods achieve on clinical concept extraction. Additionally, we demonstrate contextual embeddings encode valuable semantic information not accounted for in traditional word representations. △ Less

Submitted 14 August, 2019; v1 submitted 22 February, 2019; originally announced February 2019.

Comments: Journal of the American Medical Informatics Association

Quantized Dehydration and the Determinants of Selectivity in the NaChBac Bacterial Sodium Channel

Authors: O. A. Fedorenko, I. Kh. Kaufman, W. A. T. Gibby, D. G. Luchinsky, S. K. Roberts, P. V. E. McClintock

Abstract: A discrete electrostatic/diffusion model has been developed to describe the selective permeation of ion channels, based on ionic Coulomb blockade (ICB) and quantised dehydration (QD). It has been applied to describe selectivity phenomena measured in the bacterial NaChBac sodium channel and some of its mutants. Site-directed mutagenesis and the whole-cell patch-clamp technique were used to investig… ▽ More A discrete electrostatic/diffusion model has been developed to describe the selective permeation of ion channels, based on ionic Coulomb blockade (ICB) and quantised dehydration (QD). It has been applied to describe selectivity phenomena measured in the bacterial NaChBac sodium channel and some of its mutants. Site-directed mutagenesis and the whole-cell patch-clamp technique were used to investigate how the value $Q_f$ of the fixed charge at the selectivity filter (SF) affected both valence and alike-charge selectivity. The new ICB/QD model predicts that increasing ${Q_f}$ should lead to a shift of selectivity sequences towards larger ion sizes and charges, a result that agrees with the present experiments and with earlier work. Comparison of the model with experimental data provides evidence for an {\it effective charge} $Q_f^*$ at the SF that is smaller in magnitude than the nominal $Q_f$ corresponding to the charge on the isolated protein residues. Furthermore, $Q_f^*$ was different for aspartate and glutamate charged rings and also depended on their position within the SF. It is suggested that protonation of the residues within the restricted space is an important factor in significantly reducing the effective charge of the EEEE ring. Values of $Q_f^*$ derived from experiments on the anomalous mole fraction effect (AMFE) agree well with expectations based on the ICB/QD model and have led to the first clear demonstration of the expected ICB oscillations in Ca$^{2+}$ conduction as a function of the fixed charge. Pilot studies of the dependence of Ca$^{2+}$ conduction on pH are consistent with the predictions of the model. △ Less

Submitted 19 March, 2018; originally announced March 2018.

Comments: 13 pages 7 figure + Supplemental Information

Multiple scattering dynamics of fermions at an isolated p-wave resonance

Authors: Ryan Thomas, Kris O. Roberts, Eite Tiesinga, Andrew C. J. Wade, P. Blair Blakie, Amita B. Deb, Niels Kjærgaard

Abstract: The wavefunction for indistinguishable fermions is anti-symmetric under particle exchange, which directly leads to the Pauli exclusion principle, and hence underlies the structure of atoms and the properties of almost all materials. In the dynamics of collisions between two indistinguishable fermions this requirement strictly prohibits scattering into 90 degree angles. Here we experimentally inves… ▽ More The wavefunction for indistinguishable fermions is anti-symmetric under particle exchange, which directly leads to the Pauli exclusion principle, and hence underlies the structure of atoms and the properties of almost all materials. In the dynamics of collisions between two indistinguishable fermions this requirement strictly prohibits scattering into 90 degree angles. Here we experimentally investigate the collisions of ultracold clouds fermionic $\rm^{40}K$ atoms by directly measuring scattering distributions. With increasing collision energy we identify the Wigner threshold for p-wave scattering with its tell-tale dumb-bell shape and no $90^\circ$ yield. Above this threshold effects of multiple scattering become manifest as deviations from the underlying binary p-wave shape, adding particles either isotropically or axially. A shape resonance for $\rm^{40}K$ facilitates the separate observation of these two processes. The isotropically enhanced multiple scattering mode is a generic p-wave threshold phenomenon, while the axially enhanced mode should occur in any colliding particle system with an elastic scattering resonance. △ Less

Submitted 13 July, 2016; originally announced July 2016.

Comments: 7 pages, 4 figures, link to supplementary material

Journal ref: Nature Communications 7, 12069 (2016)

Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation

Authors: Hoo-Chang Shin, Kirk Roberts, Le Lu, Dina Demner-Fushman, Jianhua Yao, Ronald M Summers

Abstract: Despite the recent advances in automatically describing image contents, their applications have been mostly limited to image caption datasets containing natural images (e.g., Flickr 30k, MSCOCO). In this paper, we present a deep learning model to efficiently detect a disease from an image and annotate its contexts (e.g., location, severity and the affected organs). We employ a publicly available r… ▽ More Despite the recent advances in automatically describing image contents, their applications have been mostly limited to image caption datasets containing natural images (e.g., Flickr 30k, MSCOCO). In this paper, we present a deep learning model to efficiently detect a disease from an image and annotate its contexts (e.g., location, severity and the affected organs). We employ a publicly available radiology dataset of chest x-rays and their reports, and use its image annotations to mine disease names to train convolutional neural networks (CNNs). In doing so, we adopt various regularization techniques to circumvent the large normal-vs-diseased cases bias. Recurrent neural networks (RNNs) are then trained to describe the contexts of a detected disease, based on the deep CNN features. Moreover, we introduce a novel approach to use the weights of the already trained pair of CNN/RNN on the domain-specific image/text dataset, to infer the joint image/text contexts for composite image labeling. Significantly improved image annotation results are demonstrated using the recurrent neural cascade model by taking the joint image/text contexts into account. △ Less

Submitted 28 March, 2016; originally announced March 2016.

On Calculating the Current-Voltage Characteristic of Multi-Diode Models for Organic Solar Cells

Authors: Ken Roberts, S. R. Valluri

Abstract: We provide an alternative formulation of the exact calculation of the current-voltage characteristic of solar cells which have been modeled with a lumped parameters equivalent circuit with one or two diodes. Such models, for instance, are suitable for describing organic solar cells whose current-voltage characteristic curve has an inflection point, also known as an S-shaped anomaly. Our formulatio… ▽ More We provide an alternative formulation of the exact calculation of the current-voltage characteristic of solar cells which have been modeled with a lumped parameters equivalent circuit with one or two diodes. Such models, for instance, are suitable for describing organic solar cells whose current-voltage characteristic curve has an inflection point, also known as an S-shaped anomaly. Our formulation avoids the risk of numerical overflow in the calculation. It is suitable for implementation in Fortran, C or on micro-controllers. △ Less

Submitted 16 December, 2015; originally announced January 2016.

Comments: 21 pages, 11 figures

On the Hurwitz action in finite Coxeter groups

Authors: Barbara Baumeister, Thomas Gobet, Kieran Roberts, Patrick Wegener

Abstract: We provide a necessary and sufficient condition on an element of a finite Coxeter group to ensure the transitivity of the Hurwitz action on its set of reduced decompositions into products of reflections. We show that this action is transitive if and only if the element is a parabolic quasi-Coxeter element, that is, if and only if it has a reduced decomposition into a product of reflections that ge… ▽ More We provide a necessary and sufficient condition on an element of a finite Coxeter group to ensure the transitivity of the Hurwitz action on its set of reduced decompositions into products of reflections. We show that this action is transitive if and only if the element is a parabolic quasi-Coxeter element, that is, if and only if it has a reduced decomposition into a product of reflections that generate a parabolic subgroup. △ Less

Submitted 15 December, 2015; originally announced December 2015.

Comments: 21 pages

Band structure and transport studies of half Heusler compound DyPdBi: An efficient thermoelectric material

Authors: S. Krishnaveni, M. Sundareswari, P. C. Deshmukh, S. R. Valluri, Ken Roberts

Abstract: The discovery of Heusler alloys has revolutionized the research field of intermetallics due to the ease with which one can derive potential candidates for multifunctional applications. During recent years, many half Heusler alloys have been investigated for their thermoelectric properties. The f electron based rare earth ternary half Heusler compound DyPdBi has its f energy levels located close to… ▽ More The discovery of Heusler alloys has revolutionized the research field of intermetallics due to the ease with which one can derive potential candidates for multifunctional applications. During recent years, many half Heusler alloys have been investigated for their thermoelectric properties. The f electron based rare earth ternary half Heusler compound DyPdBi has its f energy levels located close to the Fermi energy level. Other research efforts have emphasized that such materials have good thermoelectric capabilities. We have explored using first principles the electronic band structure of DyPdBi by use of different exchange correlation potentials in the density functional theoretical framework. Transport coefficients that arise in the study of thermoelectric properties of DyPdBi have been calculated and illustrate its potential as an efficient thermoelectric material. Both the theoretically estimated Seebeck coefficient and the power factor agree well with the available experimental results. Our calculations illustrate that it is essential to include spin-orbit coupling in these models of f electron half Heusler materials. △ Less

Submitted 30 November, 2015; originally announced November 2015.

Comments: 26 pages, 9 figures

A Robust Approximation to a Lambert-Type Function

Authors: Ken Roberts

Abstract: The function $y = g(x) = \mathrm{log}\big(W(e^x)\big)$, where $W()$ denotes the Lambert W function, is the solution to the equation $y + e^y = x$. It appears in various problem situations, for instance the calculation of current-voltage curves for solar cells. A direct calculation of $g(x)$ may be inaccurate because of arithmetic underflow or overflow. We present a simple algorithm for calculating… ▽ More The function $y = g(x) = \mathrm{log}\big(W(e^x)\big)$, where $W()$ denotes the Lambert W function, is the solution to the equation $y + e^y = x$. It appears in various problem situations, for instance the calculation of current-voltage curves for solar cells. A direct calculation of $g(x)$ may be inaccurate because of arithmetic underflow or overflow. We present a simple algorithm for calculating $g(x)$ that is robust, in that it will work for almost all $x$ values which are representable in the arithmetic of one's chosen computer language. The algorithm does not assume that the chosen computer language implements the Lambert W function. △ Less

Submitted 8 April, 2015; originally announced April 2015.

Recovering the Lie algebra from its extremal geometry

Authors: Hans Cuypers, Kieran Roberts, Sergey Shpectorov

Abstract: An element $x$ of a Lie algebra $L$ over the field $F$ is extremal if $[x,[x,L]]=Fx$. Under minor assumptions, it is known that, for a simple Lie algebra $L$, the extremal geometry ${\cal{E}}(L)$ is a subspace of the projective geometry of $L$ and either has no lines or is the root shadow space of an irreducible spherical building $Δ$. We prove that if $Δ$ is of simply-laced type, then $L$ is a qu… ▽ More An element $x$ of a Lie algebra $L$ over the field $F$ is extremal if $[x,[x,L]]=Fx$. Under minor assumptions, it is known that, for a simple Lie algebra $L$, the extremal geometry ${\cal{E}}(L)$ is a subspace of the projective geometry of $L$ and either has no lines or is the root shadow space of an irreducible spherical building $Δ$. We prove that if $Δ$ is of simply-laced type, then $L$ is a quotient of a Chevalley algebra of the same type. △ Less

Submitted 22 October, 2014; originally announced October 2014.

Comments: 24 pages

MSC Class: 51E24; 17B20

Demonstration of an 8D Modulation Format with Reduced Inter-Channel Nonlinearities in a Polarization Multiplexed Coherent System

Authors: A. D. Shiner, M. Reimer, A. Borowiec, S. Oveis Gharan, J. Gaudette, P. Mehta, D. Charlton, K. Roberts, M. O'Sullivan

Abstract: We demonstrate a polarization-managed 8-dimensional modulation format that is time domain coded to reduce inter-channel nonlinearity. Simulation results show a 2.33 dB improvement in maximum net system margin (NSM) relative to polarization multiplexed (PM)-BPSK, and a 1.0 dB improvement relative to time interleaved return to zero (RZ)-PM-BPSK, for a five channel fill propagating on 20x80 km spans… ▽ More We demonstrate a polarization-managed 8-dimensional modulation format that is time domain coded to reduce inter-channel nonlinearity. Simulation results show a 2.33 dB improvement in maximum net system margin (NSM) relative to polarization multiplexed (PM)-BPSK, and a 1.0 dB improvement relative to time interleaved return to zero (RZ)-PM-BPSK, for a five channel fill propagating on 20x80 km spans of 90% compensated ELEAF. In contrast to the other modulations considered, the new 8-dimentional (8D) format has negligible sensitivity to the polarization states of the neighboring channels. Laboratory results from High-density WDM (HD-WDM) propagation experiments on a 5000 km dispersion-managed link show a 1 dB improvement in net system margin relative to PM-BPSK. △ Less

Submitted 5 June, 2014; originally announced June 2014.

Solution of the quantum finite square well problem using the Lambert W function

Authors: Ken Roberts, S. R. Valluri

Abstract: We present a solution of the quantum mechanics problem of the allowable energy levels of a bound particle in a one-dimensional finite square well. The method is a geometric-analytic technique utilizing the conformal map** $w \to z = w e^w$ between two complex domains. The solution of the finite square well problem can be seen to be described by the images of simple geometric shapes, lines and ci… ▽ More We present a solution of the quantum mechanics problem of the allowable energy levels of a bound particle in a one-dimensional finite square well. The method is a geometric-analytic technique utilizing the conformal map** $w \to z = w e^w$ between two complex domains. The solution of the finite square well problem can be seen to be described by the images of simple geometric shapes, lines and circles, under this map and its inverse image. The technique can also be described using the Lambert W function. One can work in either of the complex domains, thereby obtaining additional insight into the finite square well problem and its bound energy states. There are many opportunities to follow up, and we present the method in a pedagogical manner to stimulate further research in this and related avenues. △ Less

Submitted 4 February, 2017; v1 submitted 26 March, 2014; originally announced March 2014.

Comments: Published, with slight revisions, Feb-2017 in Canadian Journal of Physics, vol 95, pp 105-110 under the title: "Tutorial: The quantum finite square well and the Lambert W function"

Steerable optical tweezers for ultracold atom studies

Authors: Kris O. Roberts, Thomas McKellar, Julia Fekete, Ana Rakonjac, Amita B. Deb, Niels Kjærgaard

Abstract: We report on the implementation of an optical tweezer system for controlled transport of ultracold atoms along a narrow, static confinement channel. The tweezer system is based on high-efficiency acousto-optical deflectors and offers two-dimensional control over beam position. This opens up the possibility for tracking the transport channel when shuttling atomic clouds along the guide, forestallin… ▽ More We report on the implementation of an optical tweezer system for controlled transport of ultracold atoms along a narrow, static confinement channel. The tweezer system is based on high-efficiency acousto-optical deflectors and offers two-dimensional control over beam position. This opens up the possibility for tracking the transport channel when shuttling atomic clouds along the guide, forestalling atom spilling. Multiple clouds can be tracked independently by time-shared tweezer beams addressing individual sites in the channel. The deflectors are controlled using a multichannel direct digital synthesizer, which receives instructions on a sub-microsecond time scale from a field-programmable gate array. Using the tweezer system, we demonstrate sequential binary splitting of an ultracold $\rm^{87}Rb$ cloud into $2^5$ clouds. △ Less

Submitted 19 December, 2013; originally announced December 2013.

Comments: 4 pages, 5 figures, 1 movie link

Journal ref: Optics Letters, Vol. 39, Issue 7, pp. 2012-2015 (2014)

The Lambert W Function, Laguerre Polynomials, and the Zeros of the QCD Partition Function

Authors: Ken Roberts, S. R. Valluri

Abstract: We study solutions of a transcendental equation for the complex chemical potential at which a random-matrix QCD model can undergo a phase transition at zero mass. An explicit solution is obtained in terms of the Lambert W function. We also provide a closed form expression for a QCD random matrix model partition function, as a sum of Laguerre polynomials, for complex chemical potential and non-zero… ▽ More We study solutions of a transcendental equation for the complex chemical potential at which a random-matrix QCD model can undergo a phase transition at zero mass. An explicit solution is obtained in terms of the Lambert W function. We also provide a closed form expression for a QCD random matrix model partition function, as a sum of Laguerre polynomials, for complex chemical potential and non-zero mass. △ Less

Submitted 28 October, 2014; v1 submitted 3 July, 2013; originally announced July 2013.

Comments: 7 pages, 1 figure. Resubmitted 28-Oct-2014 to correct typographical errors in equations (9) and (11). Also reformatted as single column, and provided article titles in the references. No other changes to content

Numerical study of the stability regions for half-quantum vortices in superconducting Sr2RuO4

Authors: Kevin Roberts, Raffi Budakian, Michael Stone

Abstract: We numerically solve the coupled Landau-Ginzburg-Maxwell equations for a model of a spin triplet px + ipy superconductor in which whole or half-quanta of flux thread through a hole. We recover the pattern of stable and unstable regions for the half-flux quanta observed in a recent experiment. We numerically solve the coupled Landau-Ginzburg-Maxwell equations for a model of a spin triplet px + ipy superconductor in which whole or half-quanta of flux thread through a hole. We recover the pattern of stable and unstable regions for the half-flux quanta observed in a recent experiment. △ Less

Submitted 16 April, 2013; originally announced April 2013.

Comments: 15 pages, 6 figures

A class of 2-groups admitting an action of the symmetric group of degree 3

Authors: Kieran Roberts, Sergey Shpectorov

Abstract: A biextraspecial group of rank $m$ is an extension of a special 2-group $Q$ of the form $2^{2 + 2m}$ by $L\cong L_2(2)$, such that the 3-element from $L$ acts on $Q$ fixed-point-freely. Subgroups of this type appear in at least the sporadic groups $J_2$, $J_3$, $McL$, $Suz$, and $Co_1$. In this paper we completely classify biextraspecial groups, namely, we show that the rank $m$ must be even and f… ▽ More A biextraspecial group of rank $m$ is an extension of a special 2-group $Q$ of the form $2^{2 + 2m}$ by $L\cong L_2(2)$, such that the 3-element from $L$ acts on $Q$ fixed-point-freely. Subgroups of this type appear in at least the sporadic groups $J_2$, $J_3$, $McL$, $Suz$, and $Co_1$. In this paper we completely classify biextraspecial groups, namely, we show that the rank $m$ must be even and for each such $m$ there exist exactly two biextraspecial groups $B^\varepsilon(m)$ up to isomorphism where $\varepsilon\in{+,-}$. We also prove that $\Out(B^\varepsilon(m))$ is an extension of the $m$-dimensional orthogonal GF(2)-space of type $\varepsilon$ by the corresponding orthogonal group. The extension is non-split except in a few small cases. △ Less

Submitted 22 January, 2013; v1 submitted 2 January, 2013; originally announced January 2013.

Comments: 23 pages

MSC Class: 20D99

Note: Computer controlled rotation mount for large diameter optics

Authors: Ana Rakonjac, Kris O. Roberts, Amita B. Deb, Niels Kjærgaard

Abstract: We describe the construction of a motorized optical rotation mount with a 40 mm clear aperture. The device is used to remotely control the power of large diameter laser beams for a magneto-optical trap (MOT). A piezo-electric ultrasonic motor on a printed circuit board (PCB) provides rotation with a precision better than 0.03 deg and allows for a very compact design. The rotation unit is controlle… ▽ More We describe the construction of a motorized optical rotation mount with a 40 mm clear aperture. The device is used to remotely control the power of large diameter laser beams for a magneto-optical trap (MOT). A piezo-electric ultrasonic motor on a printed circuit board (PCB) provides rotation with a precision better than 0.03 deg and allows for a very compact design. The rotation unit is controlled from a computer via serial communication, making integration into most software control platforms straightforward. △ Less

Submitted 29 January, 2013; v1 submitted 7 December, 2012; originally announced December 2012.

Comments: 3 pages, 4 figures, 1 movie link, supplementary files link, accepted for publication in RSI

Journal ref: Review of Scientific Instruments {\bf 84} 026107 (2013)

Comment on "Quantum oscillations in nanofabricated rings of spin-triplet superconductor Sr2RuO4"

Authors: V. Vakaryuk, K. Roberts, D. G. Ferguson, J. Jang, R. Budakian, S. B. Chung

Abstract: Recently Jang et al. reported the observation of half-height magnetization steps in cantilever magnetometry measurements of mesoscopic annular Sr2RuO4 particles. Such magnetization features were interpreted as the presence of half-quantum vortices. In an attempt to examine our findings, very recently Cai et al. (1202.3146) have performed magnetotransport measurements of micron-size rings fabricate… ▽ More Recently Jang et al. reported the observation of half-height magnetization steps in cantilever magnetometry measurements of mesoscopic annular Sr2RuO4 particles. Such magnetization features were interpreted as the presence of half-quantum vortices. In an attempt to examine our findings, very recently Cai et al. (1202.3146) have performed magnetotransport measurements of micron-size rings fabricated from small Sr2RuO4 crystals. While fabrication of such samples and subsequent verification of our findings is highly desirable, we would like to point out that, at the current state of affairs, the direct comparison is incomplete partly due to the fact that the measurements of Cai et al. were lacking an important ingredient -- the in-plane magnetic field. We would also like to offer clarification on few questionable statements made by the authors of 1202.3146. △ Less

Submitted 30 March, 2012; v1 submitted 26 March, 2012; originally announced March 2012.

Comments: Updated references