-
SleepFM: Multi-modal Representation Learning for Sleep Across Brain Activity, ECG and Respiratory Signals
Authors:
Rahul Thapa,
Bryan He,
Magnus Ruud Kjaer,
Hyatt Moore,
Gauri Ganjoo,
Emmanuel Mignot,
James Zou
Abstract:
Sleep is a complex physiological process evaluated through various modalities recording electrical brain, cardiac, and respiratory activities. We curate a large polysomnography dataset from over 14,000 participants comprising over 100,000 hours of multi-modal sleep recordings. Leveraging this extensive dataset, we developed SleepFM, the first multi-modal foundation model for sleep analysis. We sho…
▽ More
Sleep is a complex physiological process evaluated through various modalities recording electrical brain, cardiac, and respiratory activities. We curate a large polysomnography dataset from over 14,000 participants comprising over 100,000 hours of multi-modal sleep recordings. Leveraging this extensive dataset, we developed SleepFM, the first multi-modal foundation model for sleep analysis. We show that a novel leave-one-out approach for contrastive learning significantly improves downstream task performance compared to representations from standard pairwise contrastive learning. A logistic regression model trained on SleepFM's learned embeddings outperforms an end-to-end trained convolutional neural network (CNN) on sleep stage classification (macro AUROC 0.88 vs 0.72 and macro AUPRC 0.72 vs 0.48) and sleep disordered breathing detection (AUROC 0.85 vs 0.69 and AUPRC 0.77 vs 0.61). Notably, the learned embeddings achieve 48% top-1 average accuracy in retrieving the corresponding recording clips of other modalities from 90,000 candidates. This work demonstrates the value of holistic multi-modal sleep modeling to fully capture the richness of sleep recordings. SleepFM is open source and available at https://github.com/rthapa84/sleepfm-codebase.
△ Less
Submitted 27 May, 2024;
originally announced May 2024.
-
Nepal Himalaya Offers Considerable Potential for Pumped Storage Hydropower
Authors:
Rupesh Baniya,
Rocky Talchabhadel,
Jeeban Panthi,
Ganesh R Ghimire,
Sanjib Sharma,
Prithvi Dhwoj Khadka,
Sanghoon Shin,
Yadu Pokhrel,
Utsav Bhattarai,
Rajaram Prajapati,
Bhesh Raj Thapa,
Ramesh Kumar Maskey
Abstract:
There is a pressing need for a transition from fossil fuel to renewable energy to meet the increasing energy demands and reduce greenhouse gas (GHG) emissions. The Himalayas possess substantial renewable energy potential that can be harnessed through hydropower projects due to its peculiar topographic characteristics and abundant water resources. However, the current exploitation rate is low owing…
▽ More
There is a pressing need for a transition from fossil fuel to renewable energy to meet the increasing energy demands and reduce greenhouse gas (GHG) emissions. The Himalayas possess substantial renewable energy potential that can be harnessed through hydropower projects due to its peculiar topographic characteristics and abundant water resources. However, the current exploitation rate is low owing to the predominance of run-of-river hydropower systems to support the power system. The utility-scale storage facility is crucial in the load scenario of an integrated power system to manage diurnal variation, peak demand, and penetration of intermittent energy sources. In this study, we first identify the potential of pumped storage hydropower across Nepal (a central Himalayan country) under multiple configurations by pairing lakes, hydropower projects, rivers, and available flat terrains. We then identify technically feasible pairs from those of potential locations. Infrastructural, environmental, operational, and other technical constraints govern the choice of feasible locations. We find the flat land-to-river configuration most promising than other configurations. Our results provide insight into the potential of pumped storage hydropower and are of practical importance in planning sustainable power systems in the Himalayas and beyond.
△ Less
Submitted 14 February, 2023; v1 submitted 23 November, 2022;
originally announced November 2022.
-
The Plant Pathology 2020 challenge dataset to classify foliar disease of apples
Authors:
Ranjita Thapa,
Noah Snavely,
Serge Belongie,
Awais Khan
Abstract:
Apple orchards in the U.S. are under constant threat from a large number of pathogens and insects. Appropriate and timely deployment of disease management depends on early disease detection. Incorrect and delayed diagnosis can result in either excessive or inadequate use of chemicals, with increased production costs, environmental, and health impacts. We have manually captured 3,651 high-quality,…
▽ More
Apple orchards in the U.S. are under constant threat from a large number of pathogens and insects. Appropriate and timely deployment of disease management depends on early disease detection. Incorrect and delayed diagnosis can result in either excessive or inadequate use of chemicals, with increased production costs, environmental, and health impacts. We have manually captured 3,651 high-quality, real-life symptom images of multiple apple foliar diseases, with variable illumination, angles, surfaces, and noise. A subset, expert-annotated to create a pilot dataset for apple scab, cedar apple rust, and healthy leaves, was made available to the Kaggle community for 'Plant Pathology Challenge'; part of the Fine-Grained Visual Categorization (FGVC) workshop at CVPR 2020 (Computer Vision and Pattern Recognition). We also trained an off-the-shelf convolutional neural network (CNN) on this data for disease classification and achieved 97% accuracy on a held-out test set. This dataset will contribute towards development and deployment of machine learning-based automated plant disease classification algorithms to ultimately realize fast and accurate disease detection. We will continue to add images to the pilot dataset for a larger, more comprehensive expert-annotated dataset for future Kaggle competitions and to explore more advanced methods for disease classification and quantification.
△ Less
Submitted 24 April, 2020;
originally announced April 2020.
