-
Generative Pre-Trained Transformer for Cardiac Abnormality Detection
Authors:
Pierre Louis Gaudilliere,
Halla Sigurthorsdottir,
Clémentine Aguet,
Jérôme Van Zaen,
Mathieu Lemay,
Ricard Delgado-Gonzalo
Abstract:
ECG heartbeat classification plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid doctors in the diagnoses of different heart conditions. Transformers have had great success in the field of natural language processing in the past years. Our tea…
▽ More
ECG heartbeat classification plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid doctors in the diagnoses of different heart conditions. Transformers have had great success in the field of natural language processing in the past years. Our team, CinCSEM, proposes to draw the parallel between text and periodic time series signals by viewing the repeated period as words and the whole signal as a sequence of such words. In this way, the attention mechanisms of the transformers can be applied to periodic time series signals. In our implementation, we follow the Transformer Encoder architecture, which combines several encoder layers followed by a dense layer with linear or sigmoid activation for generative pre-training or classification, respectively. The use case presented here is multi-label classification of heartbeat abnormalities of ECG recordings shared by the challenge. Our best entry, not exceeding the challenge's hardware limitations, achieved a score of 0.12, 0.07, 0.10, 0.10 and 0.07 on 12-lead, 6-lead, 4-lead, 3-lead and 2-lead test set respectively. Unfortunately, our team was unable to be ranked because of a missing pre-print.
△ Less
Submitted 7 October, 2021;
originally announced October 2021.
-
Cardiac Arrhythmia Detection from ECG with Convolutional Recurrent Neural Networks
Authors:
Jérôme Van Zaen,
Ricard Delgado-Gonzalo,
Damien Ferrario Mathieu Lemay
Abstract:
Except for a few specific types, cardiac arrhythmias are not immediately life-threatening. However, if not treated appropriately, they can cause serious complications. In particular, atrial fibrillation, which is characterized by fast and irregular heart beats, increases the risk of stroke. We propose three neural network architectures to detect abnormal rhythms from single-lead ECG signals. These…
▽ More
Except for a few specific types, cardiac arrhythmias are not immediately life-threatening. However, if not treated appropriately, they can cause serious complications. In particular, atrial fibrillation, which is characterized by fast and irregular heart beats, increases the risk of stroke. We propose three neural network architectures to detect abnormal rhythms from single-lead ECG signals. These architectures combine convolutional layers to extract high-level features pertinent for arrhythmia detection from sliding windows and recurrent layers to aggregate these features over signals of varying durations. We applied the neural networks to the dataset used for the challenge of Computing in Cardiology 2017 and a dataset built by joining three databases available on PhysioNet. Our architectures achieved an accuracy of 86.23% on the first dataset, similar to the winning entries of the challenge, and an accuracy of 92.02% on the second dataset.
△ Less
Submitted 7 October, 2020;
originally announced October 2020.
-
ECG Classification with a Convolutional Recurrent Neural Network
Authors:
Halla Sigurthorsdottir,
Jérôme Van Zaen,
Ricard Delgado-Gonzalo,
Mathieu Lemay
Abstract:
We developed a convolutional recurrent neural network to classify 12-lead ECG signals for the challenge of PhysioNet/ Computing in Cardiology 2020 as team Pink Irish Hat. The model combines convolutional and recurrent layers, takes sliding windows of ECG signals as input and yields the probability of each class as output. The convolutional part extracts features from each sliding window. The bi-di…
▽ More
We developed a convolutional recurrent neural network to classify 12-lead ECG signals for the challenge of PhysioNet/ Computing in Cardiology 2020 as team Pink Irish Hat. The model combines convolutional and recurrent layers, takes sliding windows of ECG signals as input and yields the probability of each class as output. The convolutional part extracts features from each sliding window. The bi-directional gated recurrent unit (GRU) layer and an attention layer aggregate these features from all windows into a single feature vector. Finally, a dense layer outputs class probabilities. The final decision is made using test time augmentation (TTA) and an optimized decision threshold. Several hyperparameters of our architecture were optimized, the most important of which turned out to be the choice of optimizer and the number of filters per convolutional layer. Our network achieved a challenge score of 0.511 on the hidden validation set and 0.167 on the full hidden test set, ranking us 23rd out of 41 in the official ranking.
△ Less
Submitted 6 October, 2020; v1 submitted 28 September, 2020;
originally announced September 2020.
-
Convolutional-Recurrent Neural Networks on Low-Power Wearable Platforms for Cardiac Arrhythmia Detection
Authors:
Antonino Faraone,
Ricard Delgado-Gonzalo
Abstract:
Low-power sensing technologies, such as wearables, have emerged in the healthcare domain since they enable continuous and non-invasive monitoring of physiological signals. In order to endow such devices with clinical value, classical signal processing has encountered numerous challenges. However, data-driven methods, such as machine learning, offer attractive accuracies at the expense of being res…
▽ More
Low-power sensing technologies, such as wearables, have emerged in the healthcare domain since they enable continuous and non-invasive monitoring of physiological signals. In order to endow such devices with clinical value, classical signal processing has encountered numerous challenges. However, data-driven methods, such as machine learning, offer attractive accuracies at the expense of being resource and memory demanding. In this paper, we focus on the inference of neural networks running in microcontrollers and low-power processors which wearable sensors and devices are generally equipped with. In particular, we adapted an existing convolutional-recurrent neural network, designed to detect and classify cardiac arrhythmias from a single-lead electrocardiogram, to the low-power embedded System-on-Chip nRF52 from Nordic Semiconductor with an ARM's Cortex-M4 processing core. We show our implementation in fixed-point precision, using the CMSIS-NN libraries, yields a drop of $F_1$ score from 0.8 to 0.784, from the original implementation, with a memory footprint of 195.6KB, and a throughput of 33.98MOps/s.
△ Less
Submitted 8 January, 2020;
originally announced January 2020.
-
Classification of Cardiac Arrhythmias from Single Lead ECG with a Convolutional Recurrent Neural Network
Authors:
Jérôme Van Zaen,
Olivier Chételat,
Mathieu Lemay,
Enric M. Calvo,
Ricard Delgado-Gonzalo
Abstract:
While most heart arrhythmias are not immediately harmful, they can lead to severe complications. In particular, atrial fibrillation, the most common arrhythmia, is characterized by fast and irregular heart beats and increases the risk of suffering a stroke. To detect such abnormal heart conditions, we propose a system composed of two main parts: a smart vest with two cooperative sensors to collect…
▽ More
While most heart arrhythmias are not immediately harmful, they can lead to severe complications. In particular, atrial fibrillation, the most common arrhythmia, is characterized by fast and irregular heart beats and increases the risk of suffering a stroke. To detect such abnormal heart conditions, we propose a system composed of two main parts: a smart vest with two cooperative sensors to collect ECG data and a neural network architecture to classify heart rhythms. The smart vest uses two dry bi-electrodes to record a single lead ECG signal. The biopotential signal is then streamed via a gateway to the cloud where a neural network detects and classifies the heart arrhythmias. We selected an architecture that combines convolutional and recurrent layers. The convolutional layers extract relevant features from sliding windows of ECG and the recurrent layer aggregates them for a final softmax layer that performs the classification. Our neural network achieves an accuracy of 87.50% on the dataset of the challenge of Computing in Cardiology 2017.
△ Less
Submitted 25 June, 2019;
originally announced July 2019.
-
Embedded Deep Learning for Sleep Staging
Authors:
Engin Türetken,
Jérôme Van Zaen,
Ricard Delgado-Gonzalo
Abstract:
The rapidly-advancing technology of deep learning (DL) into the world of the Internet of Things (IoT) has not fully entered in the fields of m-Health yet. Among the main reasons are the high computational demands of DL algorithms and the inherent resource-limitation of wearable devices. In this paper, we present initial results for two deep learning architectures used to diagnose and analyze sleep…
▽ More
The rapidly-advancing technology of deep learning (DL) into the world of the Internet of Things (IoT) has not fully entered in the fields of m-Health yet. Among the main reasons are the high computational demands of DL algorithms and the inherent resource-limitation of wearable devices. In this paper, we present initial results for two deep learning architectures used to diagnose and analyze sleep patterns, and we compare them with a previously presented hand-crafted algorithm. The algorithms are designed to be reliable for consumer healthcare applications and to be integrated into low-power wearables with limited computational resources.
△ Less
Submitted 18 June, 2019;
originally announced June 2019.
-
Detection of Beat-to-Beat Intervals from Wrist Photoplethysmography in Patients with Sinus Rhythm and Atrial Fibrillation after Surgery
Authors:
Adrian Tarniceriu,
Jarkko Harju,
Antti Vehkaoja,
Jakub Parak,
Ricard Delgado-Gonzalo,
Philippe Renevey,
Arvi Yli-Hankala,
Ilkka Korhonen
Abstract:
Wrist photoplethysmography (PPG) allows unobtrusive monitoring of the heart rate (HR). PPG is affected by the capillary blood perfusion and the pum** function of the heart, which generally deteriorate with age and due to presence of cardiac arrhythmia. The performance of wrist PPG in monitoring beat-to-beat HR in older patients with arrhythmia has not been reported earlier. We monitored PPG from…
▽ More
Wrist photoplethysmography (PPG) allows unobtrusive monitoring of the heart rate (HR). PPG is affected by the capillary blood perfusion and the pum** function of the heart, which generally deteriorate with age and due to presence of cardiac arrhythmia. The performance of wrist PPG in monitoring beat-to-beat HR in older patients with arrhythmia has not been reported earlier. We monitored PPG from wrist in 18 patients recovering from surgery in the post anesthesia care unit, and evaluated the inter-beat interval (IBI) detection accuracy against ECG based R-to-R intervals (RRI). Nine subjects had sinus rhythm (SR, 68.0y$\pm$10.2y, 6 males) and nine subjects had atrial fibrillation (AF, 71.3y$\pm$7.8y, 4 males) during the recording. For the SR group, 99.44% of the beats were correctly identified, 2.39% extra beats were detected, and the mean absolute error (MAE) was 7.34 ms. For the AF group, 97.49% of the heartbeats were correctly identified, 2.26% extra beats were detected, and the MAE was 14.31 ms. IBI from the PPG were hence in close agreement with the ECG reference in both groups. The results suggest that wrist PPG provides a comfortable alternative to ECG and can be used for long-term monitoring and screening of AF episodes.
△ Less
Submitted 8 November, 2017;
originally announced November 2017.
-
Learning a Physical Activity Classifier for a Low-power Embedded Wrist-located Device
Authors:
Ricard Delgado-Gonzalo,
Philippe Renevey,
Adrian Tarniceriu,
Jakub Parak,
Mattia Bertschi
Abstract:
This article presents and evaluates a novel algorithm for learning a physical activity classifier for a low-power embedded wrist-located device. The overall system is designed for real-time execution and it is implemented in the commercial low-power System-on-Chips nRF51 and nRF52. Results were obtained using a database composed of 140 users containing more than 340 hours of labeled raw accelerati…
▽ More
This article presents and evaluates a novel algorithm for learning a physical activity classifier for a low-power embedded wrist-located device. The overall system is designed for real-time execution and it is implemented in the commercial low-power System-on-Chips nRF51 and nRF52. Results were obtained using a database composed of 140 users containing more than 340 hours of labeled raw acceleration data. The final precision achieved for the most important classes, (Rest, Walk, and Run), was of 96%, 94%, and 99% and it generalizes to compound activities such as XC skiing or Housework. We conclude with a benchmarking of the system in terms of memory footprint and power consumption.
△ Less
Submitted 7 November, 2017;
originally announced November 2017.
-
Respiratory and cardiac monitoring at night using a wrist wearable optical system
Authors:
Philippe Renevey,
Ricard Delgado-Gonzalo,
Alia Lemkaddem,
Christophe Verjus,
Selina Combertaldi,
Björn Rasch,
Brigitte Leeners,
Franziska Dammeier,
Florian Kübler
Abstract:
Sleep monitoring provides valuable insights into the general health of an individual and helps in the diagnostic of sleep-derived illnesses. Polysomnography, is considered the gold standard for such task. However, it is very unwieldy and therefore not suitable for long-term analysis. Here, we present a non-intrusive wearable system that, by using photoplethysmography, it can estimate beat-to-beat…
▽ More
Sleep monitoring provides valuable insights into the general health of an individual and helps in the diagnostic of sleep-derived illnesses. Polysomnography, is considered the gold standard for such task. However, it is very unwieldy and therefore not suitable for long-term analysis. Here, we present a non-intrusive wearable system that, by using photoplethysmography, it can estimate beat-to-beat intervals, pulse rate, and breathing rate reliably during the night. The performance of the proposed approach was evaluated empirically in the Department of Psychology at the University of Fribourg. Each participant was wearing two smart-bracelets from Ava as well as a complete polysomnographic setup as reference. The resulting mean absolute errors are 17.4 ms (MAPE 1.8%) for the beat-to-beat intervals, 0.13 beats-per-minute (MAPE 0.20%) for the pulse rate, and 0.9 breaths-per-minute (MAPE 6.7%) for the breath rate.
△ Less
Submitted 2 May, 2018; v1 submitted 30 October, 2017;
originally announced October 2017.