AD-BERT: Using Pre-trained contextualized embeddings to Predict the Progression from Mild Cognitive Impairment to Alzheimer's Disease
Authors:
Chengsheng Mao,
Jie Xu,
Luke Rasmussen,
Yikuan Li,
Prakash Adekkanattu,
Jennifer Pacheco,
Borna Bonakdarpour,
Robert Vassar,
Guoqian Jiang,
Fei Wang,
Jyotishman Pathak,
Yuan Luo
Abstract:
Objective: We develop a deep learning framework based on the pre-trained Bidirectional Encoder Representations from Transformers (BERT) model using unstructured clinical notes from electronic health records (EHRs) to predict the risk of disease progression from Mild Cognitive Impairment (MCI) to Alzheimer's Disease (AD). Materials and Methods: We identified 3657 patients diagnosed with MCI togethe…
▽ More
Objective: We develop a deep learning framework based on the pre-trained Bidirectional Encoder Representations from Transformers (BERT) model using unstructured clinical notes from electronic health records (EHRs) to predict the risk of disease progression from Mild Cognitive Impairment (MCI) to Alzheimer's Disease (AD). Materials and Methods: We identified 3657 patients diagnosed with MCI together with their progress notes from Northwestern Medicine Enterprise Data Warehouse (NMEDW) between 2000-2020. The progress notes no later than the first MCI diagnosis were used for the prediction. We first preprocessed the notes by deidentification, cleaning and splitting, and then pretrained a BERT model for AD (AD-BERT) based on the publicly available Bio+Clinical BERT on the preprocessed notes. The embeddings of all the sections of a patient's notes processed by AD-BERT were combined by MaxPooling to compute the probability of MCI-to-AD progression. For replication, we conducted a similar set of experiments on 2563 MCI patients identified at Weill Cornell Medicine (WCM) during the same timeframe. Results: Compared with the 7 baseline models, the AD-BERT model achieved the best performance on both datasets, with Area Under receiver operating characteristic Curve (AUC) of 0.8170 and F1 score of 0.4178 on NMEDW dataset and AUC of 0.8830 and F1 score of 0.6836 on WCM dataset. Conclusion: We developed a deep learning framework using BERT models which provide an effective solution for prediction of MCI-to-AD progression using clinical note analysis.
△ Less
Submitted 6 November, 2022;
originally announced December 2022.
The Full-sky Astrometric Map** Explorer -- Astrometry for the New Millennium
Authors:
Scott D. Horner,
Marvin E. Germain,
Thomas P. Greene,
Fred H. Harris,
Mark S. Johnson,
Kenneth J. Johnston,
David G. Monet,
Marc A. Murison,
James D. Phillips,
Robert D. Reasenberg,
P. Kenneth Seidelmann,
Sean E. Urban,
Richard H. Vassar
Abstract:
FAME is designed to perform an all-sky, astrometric survey with unprecedented accuracy. It will create a rigid astrometric catalog of 4x10^7 stars with 5 < m_V < 15. For bright stars, 5 < m_V < 9, FAME will determine positions and parallaxes accurate to < 50 microarcseconds, with proper motion errors < 50 microarcseconds/year. For fainter stars, 9 < m_V < 15, FAME will determine positions and pa…
▽ More
FAME is designed to perform an all-sky, astrometric survey with unprecedented accuracy. It will create a rigid astrometric catalog of 4x10^7 stars with 5 < m_V < 15. For bright stars, 5 < m_V < 9, FAME will determine positions and parallaxes accurate to < 50 microarcseconds, with proper motion errors < 50 microarcseconds/year. For fainter stars, 9 < m_V < 15, FAME will determine positions and parallaxes accurate to < 500 microarcseconds, with proper motion errors < 500 microarcseconds/year. It will also collect photometric data on these 4 x 10^7 stars in four Sloan DSS colors.
△ Less
Submitted 15 July, 1999;
originally announced July 1999.
