-
A Pilot Study on Visually Stimulated Cognitive Tasks for EEG-Based Dementia Recognition
Authors:
Supavit Kongwudhikunakorn,
Suktipol Kiatthaveephong,
Kamonwan Thanontip,
Pitshaporn Leelaarporn,
Maytus Piriyajitakonkij,
Thananya Charoenpattarawut,
Phairot Autthasan,
Rattanaphon Chaisaen,
Pathitta Dujada,
Thapanun Sudhawiyangkul,
Vorapun Senanarong,
Theerawit Wilaiprasitporn
Abstract:
In the status quo, dementia is yet to be cured. Precise diagnosis prior to the onset of the symptoms can prevent the rapid progression of the emerging cognitive impairment. Recent progress has shown that Electroencephalography (EEG) is the promising and cost-effective test to facilitate the detection of neurocognitive disorders. However, most of the existing works have been using only resting-stat…
▽ More
In the status quo, dementia is yet to be cured. Precise diagnosis prior to the onset of the symptoms can prevent the rapid progression of the emerging cognitive impairment. Recent progress has shown that Electroencephalography (EEG) is the promising and cost-effective test to facilitate the detection of neurocognitive disorders. However, most of the existing works have been using only resting-state EEG. The efficiencies of EEG signals from various cognitive tasks, for dementia classification, have yet to be thoroughly investigated. In this study, we designed four cognitive tasks that engage different cognitive performances: attention, working memory, and executive function. We investigated these tasks by using statistical analysis on both time and frequency domains of EEG signals from three classes of human subjects: Dementia (DEM), Mild Cognitive Impairment (MCI), and Normal Control (NC). We also further evaluated the classification performances of two features extraction methods: Principal Component Analysis (PCA) and Filter Bank Common Spatial Pattern (FBCSP). We found that the working memory related tasks yielded good performances for dementia recognition in both cases using PCA and FBCSP. Moreover, FBCSP with features combination from four tasks revealed the best sensitivity of 0.87 and the specificity of 0.80. To our best knowledge, this is the first work that concurrently investigated several cognitive tasks for dementia recognition using both statistical analysis and classification scores. Our results yielded essential information to design and aid in conducting further experimental tasks to early diagnose dementia patients.
△ Less
Submitted 13 September, 2021; v1 submitted 5 March, 2021;
originally announced March 2021.
-
SleepPoseNet: Multi-View Learning for Sleep Postural Transition Recognition Using UWB
Authors:
Maytus Piriyajitakonkij,
Patchanon Warin,
Payongkit Lakhan,
Pitsharponrn Leelaarporn,
Theerasarn Pianpanit,
Nakorn Kumchaiseemak,
Supasorn Suwajanakorn,
Nattee Niparnan,
Subhas Chandra Mukhopadhyay,
Theerawit Wilaiprasitporn
Abstract:
Recognizing movements during sleep is crucial for the monitoring of patients with sleep disorders, and the utilization of ultra-wideband (UWB) radar for the classification of human sleep postures has not been explored widely. This study investigates the performance of an off-the-shelf single antenna UWB in a novel application of sleep postural transition (SPT) recognition. The proposed Multi-View…
▽ More
Recognizing movements during sleep is crucial for the monitoring of patients with sleep disorders, and the utilization of ultra-wideband (UWB) radar for the classification of human sleep postures has not been explored widely. This study investigates the performance of an off-the-shelf single antenna UWB in a novel application of sleep postural transition (SPT) recognition. The proposed Multi-View Learning, entitled SleepPoseNet or SPN, with time series data augmentation aims to classify four standard SPTs. SPN exhibits an ability to capture both time and frequency features, including the movement and direction of slee** positions. The data recorded from 38 volunteers displayed that SPN with a mean accuracy of $73.7 \pm 0.8 \%$ significantly outperformed the mean accuracy of $59.9 \pm 0.7 \%$ obtained from deep convolution neural network (DCNN) in recent state-of-the-art work on human activity recognition using UWB. Apart from UWB system, SPN with the data augmentation can ultimately be adopted to learn and classify time series data in various applications.
△ Less
Submitted 23 August, 2020; v1 submitted 2 May, 2020;
originally announced May 2020.
-
MetaSleepLearner: A Pilot Study on Fast Adaptation of Bio-signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning
Authors:
Nannapas Banluesombatkul,
Pichayoot Ouppaphan,
Pitshaporn Leelaarporn,
Payongkit Lakhan,
Busarakum Chaitusaney,
Nattapong Jaimchariyatam,
Ekapol Chuangsuwanich,
Wei Chen,
Huy Phan,
Nat Dilokthanakul,
Theerawit Wilaiprasitporn
Abstract:
Identifying bio-signals based-sleep stages requires time-consuming and tedious labor of skilled clinicians. Deep learning approaches have been introduced in order to challenge the automatic sleep stage classification conundrum. However, the difficulties can be posed in replacing the clinicians with the automatic system due to the differences in many aspects found in individual bio-signals, causing…
▽ More
Identifying bio-signals based-sleep stages requires time-consuming and tedious labor of skilled clinicians. Deep learning approaches have been introduced in order to challenge the automatic sleep stage classification conundrum. However, the difficulties can be posed in replacing the clinicians with the automatic system due to the differences in many aspects found in individual bio-signals, causing the inconsistency in the performance of the model on every incoming individual. Thus, we aim to explore the feasibility of using a novel approach, capable of assisting the clinicians and lessening the workload. We propose the transfer learning framework, entitled MetaSleepLearner, based on Model Agnostic Meta-Learning (MAML), in order to transfer the acquired sleep staging knowledge from a large dataset to new individual subjects. The framework was demonstrated to require the labelling of only a few sleep epochs by the clinicians and allow the remainder to be handled by the system. Layer-wise Relevance Propagation (LRP) was also applied to understand the learning course of our approach. In all acquired datasets, in comparison to the conventional approach, MetaSleepLearner achieved a range of 5.4\% to 17.7\% improvement with statistical difference in the mean of both approaches. The illustration of the model interpretation after the adaptation to each subject also confirmed that the performance was directed towards reasonable learning. MetaSleepLearner outperformed the conventional approaches as a result from the fine-tuning using the recordings of both healthy subjects and patients. This is the first work that investigated a non-conventional pre-training method, MAML, resulting in a possibility for human-machine collaboration in sleep stage classification and easing the burden of the clinicians in labelling the sleep stages through only several epochs rather than an entire recording.
△ Less
Submitted 10 November, 2020; v1 submitted 8 April, 2020;
originally announced April 2020.
-
Decoding EEG Rhythms During Action Observation, Motor Imagery, and Execution for Standing and Sitting
Authors:
Rattanaphon Chaisaen,
Phairot Autthasan,
Nopparada Mingchinda,
Pitshaporn Leelaarporn,
Narin Kunaseth,
Suppakorn Tammajarung,
Poramate Manoonpong,
Subhas Chandra Mukhopadhyay,
Theerawit Wilaiprasitporn
Abstract:
Event-related desynchronization and synchronization (ERD/S) and movement-related cortical potential (MRCP) play an important role in brain-computer interfaces (BCI) for lower limb rehabilitation, particularly in standing and sitting. However, little is known about the differences in the cortical activation between standing and sitting, especially how the brain's intention modulates the pre-movemen…
▽ More
Event-related desynchronization and synchronization (ERD/S) and movement-related cortical potential (MRCP) play an important role in brain-computer interfaces (BCI) for lower limb rehabilitation, particularly in standing and sitting. However, little is known about the differences in the cortical activation between standing and sitting, especially how the brain's intention modulates the pre-movement sensorimotor rhythm as they do for switching movements. In this study, we aim to investigate the decoding of continuous EEG rhythms during action observation (AO), motor imagery (MI), and motor execution (ME) for the actions of standing and sitting. We developed a behavioral task in which participants were instructed to perform both AO and MI/ME in regard to the transitioning actions of sit-to-stand and stand-to-sit. Our results demonstrated that the ERD was prominent during AO, whereas ERS was typical during MI at the alpha band across the sensorimotor area. A combination of the filter bank common spatial pattern (FBCSP) and support vector machine (SVM) for classification was used for both offline and classifier testing analyses. The offline analysis indicated the classification of AO and MI providing the highest mean accuracy at 82.73$\pm$2.54\% in the stand-to-sit transition. By applying the classifier testing analysis, we demonstrated the higher performance of decoding neural intentions from the MI paradigm in comparison to the ME paradigm. These observations led us to the promising aspect of using our developed tasks based on the integration of both AO and MI to build future exoskeleton-based rehabilitation systems.
△ Less
Submitted 27 June, 2020; v1 submitted 7 April, 2020;
originally announced April 2020.
-
Improving Heart Rate Estimation on Consumer Grade Wrist-Worn Device Using Post-Calibration Approach
Authors:
Tanut Choksatchawathi,
Puntawat Ponglertnapakorn,
Apiwat Ditthapron,
Pitshaporn Leelaarporn,
Thayakorn Wisutthisen,
Maytus Piriyajitakonkij,
Theerawit Wilaiprasitporn
Abstract:
The technological advancement in wireless health monitoring through the direct contact of the skin allows the development of light-weight wrist-worn wearable devices to be equipped with different sensors such as photoplethysmography (PPG) sensors. However, the motion artifact (MA) is possible to occur during daily activities. In this study, we attempted to perform a post-calibration of the heart r…
▽ More
The technological advancement in wireless health monitoring through the direct contact of the skin allows the development of light-weight wrist-worn wearable devices to be equipped with different sensors such as photoplethysmography (PPG) sensors. However, the motion artifact (MA) is possible to occur during daily activities. In this study, we attempted to perform a post-calibration of the heart rate (HR) estimation during the three possible states of average daily activity (resting, \textcolor{red}{laying down}, and intense treadmill activity states) in 29 participants (130 minutes/person) on four popular wearable devices: Fitbit Charge HR, Apple Watch Series 4, TicWatch Pro, and Empatica E4. In comparison to the standard measurement (HR$_\text{ECG}$), HR provided by Fitbit Charge HR (HR$_\text{Fitbit}$) yielded the highest error of $3.26 \pm 0.34$ bpm in resting, $2.33 \pm 0.23$ bpm in \textcolor{red}{laying down}, $9.53 \pm 1.47$ bpm in intense treadmill activity states, and $5.02 \pm 0.64$ bpm in all states combined among the four chosen devices. Following our improving HR estimation model with rolling windows as feature (HR$_\text{R}$), the mean absolute error (MAE) was significantly reduced by $33.44\%$ in resting, $15.88\%$ in \textcolor{red}{laying down}, $9.55\%$ in intense treadmill activity states, and $18.73\%$ in all states combined. This demonstrates the feasibility of our proposed methods in order to correct and provide HR monitoring post-calibrated with high accuracy, raising further awareness of individual fitness in the daily application.
△ Less
Submitted 5 March, 2020; v1 submitted 14 October, 2019;
originally announced October 2019.
-
Drowsiness Detection for Office-based Workload with Mouse and Keyboard Data
Authors:
Sanurak Natnithikarat,
Sirakorn Lamyai,
Pitshaporn Leelaarporn,
Narin Kunaseth,
Phairot Autthasan,
Thayakorn Wisutthisen,
Theerawit Wilaiprasitporn
Abstract:
Non-invasive devices involved in the detection of drowsiness generally include infrared camera and Electroencephalography (EEG), of which sometimes are constrained in an actual real-life scenario deployments and implementations such as in the working office environment. This study proposes a combination using the biometric features of keyboard and mouse movements and eye tracking during an office-…
▽ More
Non-invasive devices involved in the detection of drowsiness generally include infrared camera and Electroencephalography (EEG), of which sometimes are constrained in an actual real-life scenario deployments and implementations such as in the working office environment. This study proposes a combination using the biometric features of keyboard and mouse movements and eye tracking during an office-based tasks to detect and evaluate drowsiness according to the self-report Karolinska sleepiness scale (KSS) questionnaire. Using machine learning models, the results demonstrate a correlation between the predicted KSS from the biometrics and the actual KSS from the user input, indicating the feasibility of evaluating the office workers' drowsiness level of the proposed approach.
△ Less
Submitted 8 October, 2019; v1 submitted 10 September, 2019;
originally announced September 2019.
-
Consumer Grade Brain Sensing for Emotion Recognition
Authors:
Payongkit Lakhan,
Nannapas Banluesombatkul,
Vongsagon Changniam,
Ratwade Dhithijaiyratn,
Pitshaporn Leelaarporn,
Ekkarat Boonchieng,
Supanida Hompoonsup,
Theerawit Wilaiprasitporn
Abstract:
For several decades, electroencephalography (EEG) has featured as one of the most commonly used tools in emotional state recognition via monitoring of distinctive brain activities. An array of datasets have been generated with the use of diverse emotion-eliciting stimuli and the resulting brainwave responses conventionally captured with high-end EEG devices. However, the applicability of these dev…
▽ More
For several decades, electroencephalography (EEG) has featured as one of the most commonly used tools in emotional state recognition via monitoring of distinctive brain activities. An array of datasets have been generated with the use of diverse emotion-eliciting stimuli and the resulting brainwave responses conventionally captured with high-end EEG devices. However, the applicability of these devices is to some extent limited by practical constraints and may prove difficult to be deployed in highly mobile context omnipresent in everyday happenings. In this study, we evaluate the potential of OpenBCI to bridge this gap by first comparing its performance to research grade EEG system, employing the same algorithms that were applied on benchmark datasets. Moreover, for the purpose of emotion classification, we propose a novel method to facilitate the selection of audio-visual stimuli of high/low valence and arousal. Our setup entailed recruiting 200 healthy volunteers of varying years of age to identify the top 60 affective video clips from a total of 120 candidates through standardized self assessment, genre tags, and unsupervised machine learning. Additional 43 participants were enrolled to watch the pre-selected clips during which emotional EEG brainwaves and peripheral physiological signals were collected. These recordings were analyzed and extracted features fed into a classification model to predict whether the elicited signals were associated with a high or low level of valence and arousal. As it turned out, our prediction accuracies were decidedly comparable to those of previous studies that utilized more costly EEG amplifiers for data acquisition.
△ Less
Submitted 9 August, 2019; v1 submitted 10 October, 2018;
originally announced October 2018.
