An Interpretable and Efficient Sleep Staging Algorithm: DetectsleepNet

Abstract

Sleep quality directly impacts human health and quality of life, so accurate sleep staging is essential for assessing sleep quality. However, most traditional methods are inefficient and time-consuming due to segmenting different sleep cycles by manual labeling. In contrast, automated sleep staging technology not only directly assesses sleep quality but also helps sleep specialists analyze sleep status, significantly improving efficiency and reducing the cost of sleep monitoring, especially for continuous sleep monitoring. Most of the existing models, however, are deficient in computational efficiency, lightweight design, and model interpretability. In this paper, we propose a neural network architecture based on the prior knowledge of sleep experts. Specifically, 1) Propose an end-to-end model named DetectsleepNet that uses single-channel EEG signals without additional data processing, which has achieved an impressive 80.9% accuracy on the SHHS dataset and an outstanding 88.0% accuracy on the Physio2018 dataset. 2) Constructure an efficient lightweight sleep staging model named DetectsleepNet-tiny based on DetectsleepNet, which has just 6% of the parameter numbers of existing models, but its accuracy exceeds 99% of state-of-the-art models, 3) Introducing a specific inference header to assess the attention given to a specific EEG segment in each sleep frame, enhancing the transparency in the decisions of models. Our model comprises fewer parameters compared to existing ones and ulteriorly explores the interpretability of the model to facilitate its application in healthcare. The code is available at https://github.com/komdec/DetectSleepNet.git.

1 Introduction

Sleep consists of non-REM and REM sleep, which are then classified into different sleep stages by sleep experts stage sleep based on electroencephalography (EEG), electrooculography (EOG), and sub-chin (chin) electromyography (chin EMG)[1]. Since 1968, sleep staging studies have followed the guidelines developed by Rechtschaffen and Kales in the Handbook of Standardized Terminology, Techniques, and Scoring Systems for Sleep Staging in Human Subjects (R&K Handbook)[2]. It divides NREM sleep into stages I, II, III, and IV and refers to REM sleep as stage REM. Following this, NREM stage 3 and stage 4 were merged into a new stage called N3 by the American Academy of Sleep Medicine Manual for the Scoring of Sleep and Associated Events (AASM)[3]. Sleep staging and assessment currently depend primarily on the analysis and interpretation of polysomnogram (PSG) data by sleep experts, who usually divide the data into 30-second segments (referred to as one sleep frame). This manual process is known as sleep stage scoring or sleep stage classification. However, for one thing, this method is not only time-consuming and prone to human errors, but it cannot be applied on a large scale due to the limitations of experts. For another thing, if we use the manual method mentioned above, patients with sleep disorders would need to be placed in a specialized environment with expensive equipment and supervised by specialists to monitor their health conditions regularly. This process is both tiring and financially burdensome. Hence, automated sleep staging is essential.

Researchers have paid significant attention to the advantages of profound learning technology breakthroughs in various fields. These include the ability to automatically classify sleep stages without manual feature extraction and its powerful representation and adaptability to different types of data. Recent research indicates an increasing interest in using deep learning for sleep staging. A. Supratak et al. proposed the DeepSleepNet, which utilizes convolutional neural network (CNN) to learn local features first and then the recurrent neural networks (RNN) to learn temporal transformation rules for these features[4]. A. Supratak further proposed the TinySleepNet, applying simpler single-pipelined CNN and unidirectional Long Short-Term Memory Networks (LSTM) to enhance classification accuracy while reducing parameters[5]. H. Seo et al. proposed the IITNet model, which divides each 30-second EEG feature segment into overlap** subsegments and encodes them into corresponding feature vectors. The model utilizes a modified ResNet-50 for feature extraction and applies Bi-LSTM for sleep stage classification[6]. U-Time utilizes a fully convolutional encoder-decoder network to analyze raw EEG signals of any length for sleep stage classification[7]. In the SeqSleepNet, researchers begin by applying a short-time Fourier transform (STFT) to PSG signals to create spectrograms[8]. Then, they use a Hamming window and fast Fourier transform (FFT) for logarithmic scaling and filter out unimportant subbands using a filter module. Finally, the RNN and an attention module are employed to classify multiple sleep stages. XSleepNet uses raw EEG signals and power spectra as inputs for sleep staging with CNN and RNN[9]. SleepTransformer uses power spectra as inputs for sleep staging and analyzes the confidence level of each element throughout the sleep night for interpretability[10]. SleePyCo first obtains a pre-trained model through comparison learning and then fine-tunes by the transformer to learn sequence information[11].

Although deep learning has facilitated significant advances in automatic sleep stage classification and has continuously improved the classification performance by applying cellular neural network, RNN, Transformer, etc., these methods still face many challenges and difficulties in practical applications:

(1) Complexity and computational requirements, such as using the Window Fourier Transform (WFT) to convert one-dimensional physiological signals into two-dimensional images for classification. This process increases the computational resource requirements for model training and inference, making it difficult to embed models directly into small devices with limited computational power.

(2) Model Interpretability: Deep learning models are usually referred to as "black boxes," especially in medicine and healthcare, where the decision-making process requires transparency to both professionals and patients in order to build trust and enhance usefulness.

Hence, research should prioritize develo** lightweight models with enhanced interpretability. This involves simplifying deep learning model structures, reducing parameters for small devices, and exploring new interpretability techniques. These improvements can make automated sleep stage classification more effective in clinical settings and provide more accurate tools for advancing sleep medicine.

This research aims to use deep learning to identify key signal features and transformation rules during sleep and propose a highly accurate and lightweight algorithm for automatic sleep stage classification. The algorithm will substitute traditional manual sleep staging methods, allowing their widespread use in human life and contributing to the realization of AI-driven healthcare services. The main contributions of this work are as follows:

(1) We develop a concise end-to-end neural network model named DetectsleepNet, employing only single-channel EEG signals as inputs and achieving excellent classification accuracy on two large, publicly available sleep staging datasets.

(2) We develop a lightweight model named DetectsleepNet-tiny to address the problem of a large number of parameters and the difficulty of deployment on mobile devices. The model reduces its size to 6% of existing sleep stage models, maintaining over 99% accuracy compared to state-of-the-art (SOTA) models in the meantime. This significantly improves efficiency and deployability.

(3) To facilitate visualization of the decision-making process, specific structural inference heads have been introduced to assess the attention of EEG data to specific data segments. This structure enhances transparency and persuasiveness of the "black box" in real-world applications and assistants sleep experts perform sleep staging quickly and effectively.

2 DetectSleepNet

During the process of sleep staging, EEG feature plays a crucial role. As shown in Figure 1, a frame of the EEG signal from the O2-M1 channel demonstrates that during the awake state with eyes open, the EEG predominantly exhibits $\beta$ waves and $\alpha$ waves (8-13Hz, typically most pronounced in the occipital leads). If $\alpha$ waves are present when the eyes are closed, and the $\alpha$ wave activity in the O2-M1 channel EEG signal exceeds 50%, it is marked as the awake (W) stage. Figure 1 shows that if the $\alpha$ wave activity in a frame is less than 50% and is replaced by low-amplitude mixed-frequency waves (LAMF), it is marked as the N1 stage.

(a) O2-M1 EEG signals during stage W

(b) O2-M1 EEG signals during stage N1

Figure 1: The analysis of single channel EEG raw signal

2.1 Model Architecture and Mathematical Derivation

The model architecture depicted in the Figure 2 is known as DetectSleepNet. DetectSleepNet commences by employing multi-channel convolutional layers to process the one-dimensional raw EEG data (time-series signals), and introduces an additional dimension during the feature extraction process. Subsequently, in the representation learning phase, the model utilizes global average pooling to condense the two-dimensional EEG feature matrix of each time segment into a one-dimensional feature vector, ensuring precise description of the features of each time segment by a single vector.

Figure 2: The architecture of DetectSleepNet

DetectSleepNet further utilizes the global average pooling in the sequence learning part to merge the feature vectors of multiple time segments into a single feature vector representing the entire sleep frame. The process are as follows:

$$\left\{x_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}=split\left({{X}^{t}}\right)$$ (1)

$$f\_rep_{i}^{t}=Avg1\left(Rep\left(x_{i}^{t}\right)\right)$$ (2)

$$\left\{f\_gs_{i}^{t}\right\}=Global\_Seq\left(\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\},t\in\left\{1,2,\ldots,M\right\}\right\}\right)$$ (3)

$$\left\{f\_ls_{i}^{t}\right\}=Local\_Seq\left(\left\{f\_gs_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}\right)$$ (4)

$$f\_se{{q}^{t}}=Avg2\left(\left\{f\_ls_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}\right)$$ (5)

$$\left\{{{c}^{t}}\right\}=\left\{classifier\text{ }\left(f\_se{{q}^{t}}\right)|t\in\left\{1,2,\ldots,M\right\}\right\}$$ (6)

Where, ${{X}^{t}}$ denotes the single-channel EEG data at time step $t$. Through the function $split$, it is split into $N$ subsets $x_{i}^{t}$. For each subset $x_{i}^{t}$, the representation learning structure $Rep$ extracts the feature matrix. Following this, global average pooling $Avg1$ is applied to condense this into a one-dimensional feature vector $f\_rep_{i}^{t}$.

The feature vectors are processed by the global sequence learning structure $Global\_Seq$ and the local sequence learning structure $Local\_Seq$ to derive the vector $f\_ls_{i}^{t}$ corresponding to each subset $x_{i}^{t}$. Subsequently, the global average pooling $Avg2$ is employed to obtain the feature vector $f\_seq^{t}$ for each sleep frame. Finally, the classifier $classifier$ transforms the feature vector of each sleep frame into the category vector ${{c}^{t}}$, enabling precise analysis and identification of various sleep stages. The collection of category vectors for $M$ sleep frames is represented as $\left\{{{c}^{t}}|t\in\left\{1,2,\ldots,M\right\}\right\}$.

To effectively extract these features, this paper developed a parameter-shared local feature extractor as the fundamental structure for representation learning. Each local time series is processed through this feature extractor to generate feature vectors that capture the waveform characteristics of the local time. These features are then integrated using a sequence learning architecture to produce the final sleep stage categories. As illustrated in Figure 3, this simplified model architecture outlines the entire process from feature extraction to classification.

Figure 3: The architecture of DetectSleepNet

Given a series of $M$ continuous sleep frames, wherein each frame is subdivided into $N$ time segments, the forward computation steps are determined as follows:

$$\left\{x_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}=split\left({{X}^{t}}\right).$$ (7)

$$f\_rep_{i}^{t}=Rep\left(x_{i}^{t}\right).$$ (8)

$$\left\{f\_se{{q}^{t}},t\in\left\{1,2,\ldots,M\right\}\right\}=Seq(\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\},t\in\left\{1,2,\ldots,M\right\}\right\}).$$ (9)

$${{c}^{t}}=classifier\text{ }\left(f\_se{{q}^{t}}\right).$$ (10)

where $i\in\left\{1,2,\ldots,N\right\}$ and $t\in\left\{1,2,\ldots,M\right\}$ represent the indices of the time segments and sleep frames, respectively. The variable ${{X}^{t}}$ represents the single-channel EEG data of the $t$th sleep frame, and $x_{i}^{t}$ represents the EEG data of the $i$th time segment of the $i$th sleep frame subsequent to segmentation. $Rep$ is the representation learning structure that converts the data of each time segment $x_{i}^{t}$ into the corresponding feature vector $f\_rep_{i}^{t}$. $Seq$ is the sequence learning structure that integrates the feature vectors of continuous sleep frames to generate the composite feature vector $f\_se{{q}^{t}}$ for each sleep frame. The classifier $classifier$ converts the feature vector of each sleep frame into the corresponding category vector ${{c}^{t}}$.

This process involves segmentation, feature extraction, serialization, and classification, ensuring continuity and efficiency.

2.2 Representation Learning

To effectively capture the unique frequency features of different EEG rhythms, we have introduced a multi-scale feature extraction module (MCFEM). The module, as illustrated in Figure 4, is designed with multiple convolutional layers and feature extraction paths to capture and integrate features from different receptive fields.

Figure 4: The module of multi scale feature extraction

In the Multi-Channel Feature Extraction Module (MCFEM), the first convolutional layer (Conv Layer 1) is set with a kernel size of 3 to effectively capture features from smaller receptive fields. Subsequently, two dilated convolutional layers (Dilated Conv 1 and Dilated Conv 2) leverage dilation rates of 3 and 5, respectively, to encompass broader receptive fields and capture a more comprehensive hierarchical feature representation. Furthermore, Conv Layer 2 employs a kernel size of 1 primarily to regulate the number of data channels and feature dimensions, thereby ensuring the efficient fusion of outputs from diverse pathways. Each feature extraction pathway comprises two convolutional layers, thereby enhancing the module’s fitting capacity.

The module incorporates batch normalization and nonlinear activation functions to enhance the model’s training efficiency and overall effectiveness. Furthermore, it seamlessly integrates features from diverse receptive fields through summation operations, deftly avoiding an increase in feature dimension. The final pooling layer diminishes feature dimensions while fortifying the model’s robustness and its capacity to generalize amidst variations in input data. These design elements work together to make the extracted features more comprehensive and suitable for complex EEG signal analysis tasks.

2.3 Sequence Learning

This paper utilizes a six-layer bidirectional gated recurrent unit (Bi-GRU) structure for sequence learning. Among them, five layers are responsible for capturing global sequence information and analyzing the connections between consecutive sleep frames, while the remaining layer focuses on processing local sequence information and examining the detailed relationships between time segments within a single sleep frame. The specific computation process is as follows:

$$\left\{f\_gs_{i}^{t}\right\}=Global\_Seq\left(\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\},t\in\left\{1,2,\ldots,M\right\}\right\}\right).$$ (11)

$$\left\{f\_ls_{i}^{t}\right\}=Local\_Seq\left(\left\{f\_gs_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}\right).$$ (12)

the set $\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\},t\in\left\{1,2,\ldots,M\right\}\right\}$ denotes the features extracted from an N x M matrix of data points, each containing single-channel EEG data within a specific time segment. The global sequence learning structure, $Global\_Seq$, integrates the sequence features of multiple sleep frames from a global perspective, resulting in global sequence features $\left\{f\_gs_{i}^{t}\right\}$. The local sequence learning structure, $Local\_Seq$, further processes these global features to refine the sequence dynamics within each time segment of a single sleep frame, producing local sequence features $\left\{f\_ls_{i}^{t}\right\}$. This design allows the model to capture global dynamics and local variations, thereby enhancing the accuracy and reliability of sleep stage determination.

3 Experiment

3.1 Datasets

In this paper, we have opted to work with the SHHS and Physio2018 datasets[12, 13, 14]. These datasets offer the advantage of large sample sizes, enabling comprehensive testing and validation of model performance and stability. Moreover, the standardization of the above datasets allows for easy comparison with other studies, thus enhancing the reliability and reproducibility of research. The specific dataset evaluation scheme is exhibited in Table 1.

Table 1: Number of samples

Dataset	Scoring manual	Sample	Channel
Physio2018	AASM	994	${{\text{C}}_{\text{3}}}\text{-}{{\text{A}}_{\text{2}}}$
SHHS	R&K	5793	${{\text{C}}_{\text{4}}}\text{-}{{\text{M}}_{\text{1}}}$

The processing of both datasets followed the methods of existing research. Specifically, the SHHS dataset was refined by combining sleep stage 3 and 4 into a single N3 stage and removing movement periods and unknown stages to maintain data consistency and precision. The comprehensive evaluation framework of the datasets and the categorization distribution will be explicated in subsequent sections. The distribution of labeled categories for sleep epochs is presented in Table 2.

Table 2: Distribution Information of Physio2018 and SHHS Datasets

Dataset	Sleep frame category distribution
	W	N1	N2	N3	R	Total
Physio2018	157,945	157,945	377,870	102,592	116,877	892,262
	(17.7%)	(15.4%)	(42.3%)	(11.5%)	(13.1%)	(100%)
SHHS	1,691,288	217,583	2,397,460	739,403	817,473	5,863,207
	(28.8%)	(3.7%)	(40.9%)	12.6(%)	(13.9%)	(100%)

3.2 Experimental Setting

In this paper, the SHHS dataset is preprocessed to adhere to the AASM scoring manual. The sleep staging model was trained using 20 consecutive single-channel EEG sleep frames, incorporating data from both the Physio2018 and SHHS datasets. The ReLU6 activation function was chosen for its ability to remain linear for positive values and truncate for negative values, effectively mitigating the vanishing gradient problem and improving training efficiency. The model utilizes the cross-entropy loss function, as illustrated in the formula:

$$C{{E}_{Loss}}\left(y,\hat{y}\right)=-[y\log\hat{y}+(1-y)\log(1-\hat{y})]$$ (13)

This paper employed the AdamW optimizer, which incorporates a weight decay mechanism in addition to the original Adam optimizer[15, 16]. The approach addressed overfitting issues and enhanced the generalization ability of model. AdamW combines adaptive learning rates and momentum optimization, thereby improving the stability and efficiency of the training process. Furthermore, the paper implemented the CyclicLR learning rate scheduling method, which intermittently adjusts the learning rate to facilitate the avoidance of local optima and expedite convergence. Such a strategy effectively safeguards the model against becoming ensnared in local minima by modifying the learning rate during training[17].

Overall, we combined utilization of AdamW and CyclicLR optimizes the learning process and improves the model’s capacity to handle complex sleep data through a meticulously designed loss function and activation function. This enhances prediction accuracy and model generalization, resulting in more precise and stable performance in sleep staging tasks.

3.3 Performance Comparison and Analysis

DetectSleepNet has demonstrated outstanding performance on the Physio2018 and SHHS datasets. As shown in Table 3, is a comparison with the top algorithms in single-channel sleep staging.

Table 3: Comparison between DetectsleepNet and other state-of-the-art methods

Dataset	Method	Overall			F1 score
		OA	MF1	$\kappa$	W	N1	N2	N3	R
Physio2018	DetectSleepNet	$\mathbf{80.9}$	$\mathbf{79.0}$	$\mathbf{0.739}$	$\mathbf{84.6}$	$\underline{59.0}$	$\underline{85.1}$	$\mathbf{80.2}$	$\mathbf{86.3}$
	SleePyCo[11]	$\mathbf{80.9}$	$\underline{78.9}$	$\underline{0.737}$	$\underline{84.4}$	$\mathbf{59.3}$	$\mathbf{85.3}$	$\underline{79.4}$	$\mathbf{86.3}$
	XSleepNet[9]	$\underline{80.3}$	78.6	0.732	-	-	-	-	-
	SeqSleepNet[8]	79.4	77.6	0.719	-	-	-	-	-
	U-time[7]	78.8	77.4	0.714	82.5	$\underline{59.0}$	83.1	79.0	$\underline{83.5}$
SHHS	DetectSleepNet	$\mathbf{88.0}$	$\mathbf{80.7}$	$\mathbf{0.831}$	$\mathbf{92.9}$	48.5	$\mathbf{88.5}$	84.8	$\mathbf{88.7}$
	SleePyCo	$\mathbf{87.9}$	$\mathbf{80.7}$	$\underline{0.830}$	$\underline{92.6}$	$\underline{49.2}$	$\mathbf{88.5}$	84.5	$\underline{88.6}$
	SleepTransformer[10]	87.7	$\underline{80.1}$	0.828	92.2	46.1	88.3	$\mathbf{85.2}$	$\underline{88.6}$
	XSleepNet	87.6	$\mathbf{80.7}$	0.826	92.0	$\mathbf{49.9}$	88.3	$\underline{85.0}$	88.2
	IITNet[6]	86.7	79.8	0.812	90.1	48.1	$\underline{88.4}$	$\mathbf{85.2}$	87.2
	SeqSleepNet	86.5	78.5	0.81	-	-	-	-	-

In Table 3, the bold indicates the best performance, and the underlined indicates the second-best. Notably, DetectSleepNet achieved superior results across multiple classification tasks. Conversely, SleePyCo, XSleepNet, and SleepTransformer employ more intricate technical methodologies. SleePyCo uses a contrastive learning strategy for pre-training rather than a direct end-to-end architecture. XSleepNet and SleepTransformer transform raw EEG signals into time-frequency graphs, extracting features through Fourier transforms. DetectSleepNet employs an end-to-end structure, directly processing raw EEG signals and effectively utilizing waveform information. This approach not only reduces the complexity of preprocessing steps but also improves the accuracy and generalization capability of the model in sleep staging tasks, demonstrating its potential and advantages in the field of sleep staging.

Despite the overall effectiveness of current automatic sleep staging methods, there are specific challenges in accurately classifying the N1 stage. This can be attributed to several factors:

1. Annotation Bias: Sleep experts rely on the proportion of alpha rhythms in the occipital leads (O1-M2 or O2-M1) to determine sleep stages. The AASM scoring manual dictates that more than 50% alpha rhythm is classified as the W stage, while less than 50% is marked as the N1 stage. However, subtle variations around the 50% threshold can result in manual annotation errors.

2. Signal Modality: About 10% of the population does not produce alpha waves and requires alternative signals (e.g., EMG signals) to determine the N1 stage. Interpretation of these signals may vary among sleep experts based on personal experience and preference.

3. EEG Lead Selection: This paper primarily utilizes central leads (C4-M2 or C3-M1) for single-channel sleep staging. While central leads can capture EEG characteristics from multiple regions, the proportion of alpha rhythms may differ from the occipital leads, potentially impacting classification accuracy.

The confusion matrix of the DetectSleepNet method is shown in the Figure 5, which illustrates the matching between the actual predictions and the true labels of the DetectSleepNet model on the test set. This visualization comprehensively showcases the model’s prediction accuracy across different sleep stages and its misclassification scenarios, encompassing true positives, false positives, true negatives, and false negatives. The confusion matrix serves as a crucial instrument for gaining insights into the real-world performance of models, offering an intuitive portrayal of its strengths and weaknesses within each classification label.

Figure 5: The module of multi scale feature extraction

With the proposed multi-scale feature extraction module, our DetectSleepNet model can process one-dimensional EEG signals of varying frequencies. The comparison experiments are displayed in the Figure 6. In these experiments, TinySleepNet adjusts the sizes of its convolutional kernels based on the input EEG signal frequencies, resulting in changes to the model parameters. In contrast, the architecture of DetectSleepNet remains consistent.

Figure 6: The accuracy comparison of TinySleepNet and DetectSleepNet

4 Lightweight Processing

Previous experiments have shown that the number of model parameters in the sequence learning part far exceeds that in the representation learning part. This phenomenon is reminiscent of visual-text multimodal tasks, where the parameter count of the visual feature extractor surpasses that of the text feature extractor. To tackle this issue, a transfer learning strategy was implemented for the DetectSleepNet model. Specifically, the strategy entailed the fixation of the weights within the representation learning component while retraining the sequence learning component. A detailed exposition of this methodology and the model’s architecture is provided in Figure 7.

Figure 7: The architecture of DetectSleepNet-tiny

The Figure 7 shows the architecture of the DetectSleepNet-tiny model, a lightweight version of DetectSleepNet. Notably, the original 6-layer bidirectional gated recurrent unit (Bi-GRU) has been simplified to a single-layer Bi-GRU, resulting in a substantial reduction in model size and concurrent enhancements in training efficiency. The sequence of computation steps is as follows:

$$\left\{x_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}=split\left({{X}^{t}}\right)$$ (14)

$$f\_rep_{i}^{t}=Avg1\left(Rep\left(x_{i}^{t}\right)\right)$$ (15)

$$\left\{f\_ts_{i}^{t}\right\}=Tiny\_Seq\left(\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\},t\in\left\{1,2,\ldots,M\right\}\right\}\right)$$ (16)

$$f\_av{{g}^{t}}=Avg2\left(\left\{f\_ts_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}\right)$$ (17)

$$\left\{{{c}^{t}}\right\}=\left\{classifier\text{ }\left(f\_av{{g}^{t}}\right)|t\in\left\{1,2,\ldots,M\right\}\right\}$$ (18)

$$\left\{{{{\hat{y}}}^{t}}\right\}=\left\{argmax({{c}^{t}})\right\}$$ (19)

$$L=\frac{1}{M}\sum\limits_{t=1}^{M}{CELoss\left(\left\{{{{\hat{y}}}^{t}}\right\},\left\{{{y}^{t}}\right\}\right)}$$ (20)

$${{\theta}_{Tiny\_Seq}}\leftarrow{{\theta}_{Tiny\_Seq}}-\eta\cdot\frac{\partial L}{\partial{{\theta}_{Tiny\_Seq}}}$$ (21)

where $Tiny\_Seq$ represents the new sequence learning structure introduced in this chapter. $f\_ts_{i}^{t}$ represents the feature vector corresponding to each subset $x_{i}^{t}$ after being processed by the $Tiny\_Seq$ structure. $f\_av{{g}^{t}}$ represents the feature vector for each sleep frame. The function $argmax$ is used to obtain the category label with the highest probability. $\left\{{{{\hat{y}}}^{t}}\right\}$ is the set of predicted labels for multiple sleep frames, and $\left\{{{y}^{t}}\right\}$ is the set of true labels for multiple sleep frames. $CELoss$ is the cross-entropy loss function, $L$ represents the mean of the loss function, and $\eta$ represents the learning rate. The model parameters $Tiny\_Seq$ of ${{\theta}_{Tiny\_Seq}}$ are iteratively updated through gradient descent to optimize performance.

The comparison results for accuracy between DetectSleepNet and DetectSleepNet-tiny are illustrated in Table 4. It is evident from the table that, despite a slight decrease in performance on the Physio2018 and SHHS1 datasets, DetectSleepNet-tiny still maintains high accuracy at 99.5% and 99.3% of DetectSleepNet’s accuracy, respectively. This indicates that even with a significant reduction in the number of parameters, DetectSleepNet-tiny remains effective in performing the sleep staging task. (In the table, 80.5% and 80.9% represent the accuracy of DetectSleepNet-tiny and DetectSleepNet on the Physio2018 dataset, respectively.)

Table 4: Number of samples

Method	Parameter
DetectsleepNet-tiny	0.049M
DetectsleepNet	0.43M
SalientSleepNet[18]	0.9M
U-time[7]	1.1M
TinySleepNet[5]	1.3M
SleepEEGNet[19]	2.1M
DeepSleepNet[4]	21M

To further evaluate the lightweight design of DetectSleepNet-tiny, this paper also compares its model parameters with those of other models published in recent years, as outlined in Table 5. The results reveal that the model parameters of DetectSleepNet-tiny are only 0.049M, significantly lower than those of the other comparison models. This validates that while maintaining high accuracy, DetectSleepNet-tiny effectively enhances the model’s efficiency and adaptability, especially in scenarios with limited resources or the necessity for mobile deployment.

Table 5: Number of samples

Dataset	Method	Accuracy
Physio2018	DetectsleepNet-tiny	80.5(99.5%)
	DetectsleepNet	80.9(100%)
SHHS	DetectsleepNet-tiny	87.4(99.3%)
	DetectsleepNet	88.0(100%)

The comparison results demonstrate that DetectSleepNet-tiny achieves model lightweight while maintaining excellent performance, highlighting its potential applications in sleep staging. Through the optimization of the sequence learning component’s design, DetectSleepNet-tiny mitigates the computational load, rendering the model better suited for deployment in resource-constrained environments, such as mobile devices or remote medical monitoring systems. In summary, the successful development of DetectSleepNet-tiny exemplifies a harmonious blend of performance and resource efficiency, offering a feasible and effective solution for forthcoming sleep monitoring technologies.

5 Interpretability Analysis

The interpretability of neural networks is gaining increasing attention in the field of deep learning, especially in the medical field, where decision transparency and verifiability are of utmost importance. While researchers have developed various techniques to elucidate the decision-making processes of convolutional neural networks in image classification tasks, the application of these methods in the specialized field of sleep staging still requires further exploration[20, 21].

In this section, we aim to enhance the interpretability of the DetectSleepNet model introduced in section 2. We will retain its representation learning component and optimize the decision reasoning process by implementing various reasoning heads to augment the explanatory capability of model. These reasoning heads are specifically designed to offer clear decision logic, thereby rendering the model’s prediction process more transparent.

5.1 Voting based decision model

In the vote-based decision model, each individual sleep frame ${{X}^{t}}$ is subdivided into $N$ sample blocks $x_{i}^{t}$. Each sample block $x_{i}^{t}$ independently undergoes the representation learning module to extract the feature vector $f\_rep_{i}^{t}$. These feature vectors are then separately fed into the classifier, resulting in an independent classification for each time segment. To determine the final sleep frame category, a voting mechanism is implemented by applying global average pooling to these classification results. The forward process is illustrated in Figure 8.

Figure 8: The forward process of the voting based decision model

The detailed calculation process of this model follows:

$$\left\{x_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}=split\left({{X}^{t}}\right)$$ (22)

$$f\_rep_{i}^{t}=Rep\left(x_{i}^{t}\right)$$ (23)

$$c_{i}^{t}=classifier\left(f\_rep_{i}^{t}\right)$$ (24)

$${{c}^{t}}=\frac{1}{N}\sum\limits_{i=1}^{N}{c_{i}^{t}}$$ (25)

$$pre{{d}^{t}}=argmax({{c}^{t}})$$ (26)

where $f\_rep_{i}^{t}$ represents the feature vector of the sample block $x_{i}^{t}$ that is extracted by the representation learning module $Rep$. $c_{i}^{t}$ denotes the classification vector (i.e., the classification result) for each time segment within the sleep frame after the feature vector $f\_rep_{i}^{t}$ is input into the classifier. The final category result for the sleep frame ${{c}^{t}}$ is obtained by averaging (i.e., voting) the classification results $c_{i}^{t}$ across the $N$ time segments. The final classification vector $pre{{d}^{t}}$ is obtained from the final category result ${{c}_{i}}$ of the sleep frame using the maximum value index function $argmax$. $pre{{d}^{t}}$ is a scalar representing the final classification result.

The process enables the decision-making of the model to be transparent, allowing for the analysis and verification of each sample block’s specific contribution to the final decision. The feature vector $f\_rep_{i}^{t}$ of each sample block can be considered independent of other blocks, providing a unique opportunity to track and understand the model’s decision vectors throughout the entire sleep frame. The specific decision vector expression is as follows:

$$Att_{x}^{t}=Att_{c}^{t}=\left\{c_{i}^{t}\left[pre{{d}^{t}}\right]|i\in\left\{1,2,\ldots,N\right\}\right\}$$ (27)

where ${{c}_{i}}\left[pre{{d}^{t}}\right]$ represents the scalar of the final category, which is also the maximum value of the classification vector ${{c}_{i}}$. $Att_{c}^{t}$ represents the decision vector of the category vector group $\left\{c_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}$, and $Att_{x}^{t}$ represents the decision vector of the sample set $\left\{x_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}$. Similarly, the value of $pre{{d}^{t}}$ can be changed to observe the process of the model classifying the slee** frame into other categories.

Specifically, researchers can adjust the observed metrics in order to uncover alternative paths and inference processes in decision-making. By analyzing the features and weights that the model utilizes to classify sleep frames into different categories, researchers can gain a deeper understanding of the decision-making of the model approach and the factors involved in various scenarios. This analysis is essential for revealing the decision behavior of the model, as well as the perception and interpretation of different categories.

Additionally, to facilitate the visualization of the decision vector $Att_{x}^{t}$ in the form of a heatmap, it is transformed during display as follows:

$$Att_{show}^{t}=interp\left(relu\left(\frac{Att_{x}^{t}}{\max\left(Att_{x}^{t}\right)}\right)\right)$$ (28)

where the $\max$ function is used to obtain the maximum value in the decision vector $Att_{x}^{t}$ (the maximum scalar in a one-dimensional matrix). The $relu$ function sets negative numbers in the one-dimensional vector to zero. The expression $relu\left(\frac{Att_{x}^{t}}{\max\left(Att_{x}^{t}\right)}\right)$ maps the decision vector $Att_{x}^{t}$ to the [0,1] interval. The $interp$ function is an interpolation function used to adjust the vector’s size to improve the resolution of the heatmap. $Att_{show}^{t}$ is the final one-dimensional decision vector used for plotting the heatmap for observation.

5.2 Sleep Staging Decision Model Based on Feature Vectors

Expanding on section 5.1, this section develops a feature vector-based decision model aimed at addressing the limitations of the vote-based model’s voting (global average pooling) structure. The vote-based model utilizes shorter feature vectors (equivalent in length to the category vector) in each sample block for global average pooling, leading to reduced information during decision-making. Therefore, the feature vector-based decision model employs a simple architecture to integrate the feature vectors of all sample blocks, resulting in a more informative and comprehensive global feature representation.

5.2.1 Calculating Decision Vectors Based on Forward Propagation

The feature vector-based decision model involves dividing the data of each single sleep frame ${{X}^{t}}$ into $N$ sample blocks $x_{i}^{t}$. Each sample block is then transformed into the corresponding feature vector $f\_rep_{i}^{t}$ through the representation learning module. Unlike the previous model, rather than classifying each sample block individually, all feature vectors are merged into a global feature vector using global average pooling. The final classification result is then produced through a fully connected layer. The process is depicted in Figure 9.

Figure 9: The forward process

The detailed forward process of the model architecture is as follows:

$$f_{global}^{t}=\frac{1}{N}\sum\limits_{i=1}^{N}{f\_rep_{i}^{t}}$$ (29)

$${{c}^{t}}=classifier(f_{global}^{t})$$ (30)

$$pre{{d}^{t}}=argmax({{c}^{t}})$$ (31)

where the feature vectors $f\_rep_{i}^{t}$ corresponding to all sample blocks $x_{i}^{t}$ are averaged to obtain $f_{global}^{t}$. $f_{global}^{t}$ represents the global feature vector for this sleep frame. The category vector ${{c}^{t}}$ is obtained by passing the global feature vector $f_{global}^{t}$ through a single-layer fully connected classifier $classifier$. The final classification result $pre{{d}^{t}}$ is determined by identifying the index of the maximum value in the classification vector ${{c}^{t}}$. The computation process of the fully connected classifier $classifier$ is as follows:

$$classifier(f_{global}^{t})=f_{global}^{t}{{\mathbf{W}}_{\mathbf{fc}}}^{\mathbf{T}}+{{\mathbf{b}}_{\mathbf{fc}}}$$ (32)

where ${{\mathbf{W}}_{\mathbf{fc}}}$ and ${{\mathbf{b}}_{\mathbf{fc}}}$, the symbols $W$ and $b$ denote the weight and bias parameters of the fully connected layer of the classifier, respectively. If $L$ represents the length of $f_{global}^{t}$ and $C$ signifies the length of ${{c}^{t}}$, then ${{\mathbf{W}}_{\mathbf{fc}}}$ is a two-dimensional matrix with dimensions $C\times L$, and ${{\mathbf{b}}_{\mathbf{fc}}}$ is a one-dimensional matrix with a length of $C$.

$$Att_{f\_global}^{t}=f_{global}^{t}\cdot{{\mathbf{W}}_{\mathbf{fc}}}{{[pre{{d}^{t}}]}^{\text{T}}}+{{\mathbf{b}}_{\mathbf{fc}}}[pre{{d}^{t}}]$$ (33)

$$\sim f_{global}^{t}\cdot{{\mathbf{W}}_{\mathbf{fc}}}{{[pre{{d}^{t}}]}^{\text{T}}}$$ (34)

$$Att_{x}^{t}=Att_{f}^{t}=\frac{1}{N}\sum\limits_{i=1}^{N}{\left\{f_{i}^{t}/f_{global}^{t}\cdot Att_{f\_global}^{t}\right\}}$$ (35)

$$\sim\frac{1}{N}\sum\limits_{i=1}^{N}{\left\{f_{i}^{t}\cdot{{\mathbf{W}}_{\mathbf{fc}}}{{[pre{{d}^{t}}]}^{\text{T}}}\right\}}$$ (36)

where $Att_{f\_global}^{t}$ represents the decision vector of the global vector $f_{global}^{t}$ for the classification result $pred$, with a length of $L$. ${{\mathbf{W}}_{\mathbf{fc}}}[pre{{d}^{t}}]$ is the $pre{{d}^{t}}$-th row of the weight matrix of the fully connected layer, which is a one-dimensional vector of length $L$. ${{\mathbf{b}}_{\mathbf{fc}}}[pre{{d}^{t}}]$ is the $pre{{d}^{t}}$-th row of the bias matrix of the fully connected layer, which is a scalar (a constant during model inference). $Att_{f}^{t}$ represents the decision vector of the feature vector group $\left\{f_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}$, and $Att_{x}^{t}$ represents the decision vector of the sample set $\left\{x_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}$.

However, we have omitted the bias term ${{\mathbf{b}}_{\mathbf{fc}}}[pre{{d}^{t}}]$ for simplicity. The decision vector for the feature vector of each sample block can be calculated using the above method and then visualized to illustrate the model’s decision basis and focus at different sleep stages. Heatmaps are generated using the same method as previously described to visually display the contribution of each sample block to the final decision.

5.2.2 Calculating Decision Vectors Based on Back Propagation

When dealing with intricate neural network models such as those featuring multi-layer fully connected structures or recurrent neural network architectures directly deriving decision vectors through forward propagation is often unfeasible. These models exhibit high non-linearity and complex parameter structures, making the decision-making process challenging to parse.

Neural networks typically employ the backpropagation algorithm to optimize model parameters. This method guides parameter adjustments by computing the gradient of the loss function with respect to the model parameters to minimize the loss. This is valuable during the model training phase, offering insights into the model’s decision process. The backpropagation algorithm can also calculate the gradients of the loss function with respect to not only the model parameters, but also the input features, quantifying the influence of each input feature on the model’s prediction. The paradigm of the back propagation process is as follows:

$$f\_rep_{i}^{t}=encoder(x_{i}^{t})$$ (37)

$${{c}^{t}}=decoder(\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\})$$ (38)

$$pre{{d}^{t}}=argmax({{c}^{t}})$$ (39)

where each sample block $x_{i}^{t}$ is processed by the feature extractor $encoder$ to obtain the corresponding feature vector $f\_rep_{i}^{t}$. The feature vectors of all sample blocks in a single sleep frame $\left\{x_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}$ are then processed by the classifier $decoder$ to obtain the classification vector ${{c}^{t}}$ for that sleep frame. The final classification result for the sleep frame is $pre{{d}^{t}}$. The decision vector of the model is derived according to the following paradigm:

$$Att_{f_{-}\text{set }}^{t} =-\frac{\partial c^{t}[pred]}{\partial f_{-}set^{t}}$$ (40)

$$Att_{x}^{t} =Avg_{L}\left(f_{\_}set^{t}\cdot Att_{f_{-}set}^{t}\right)$$

where $f\_set^{t}=\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}$ represents the feature vectors of all sample blocks. If $L$ is defined as the length of $f_{global}^{t}$, then $f\_set^{t}$ can also be considered a feature matrix of size $N\times L$. $Att_{f}^{t}$ is the partial derivative of $f\_set^{t}$ with respect to ${{c}^{t}}[pred]$, representing the sensitivity of the classifier $decoder$ to $f\_set^{t}$, and is of the same size as $f\_set^{t}$. $Av{{g}_{L}}$ is the average of the decision matrix $f\_set^{t}\cdot Att_{f}^{t}$ along the L dimension, yielding the decision vector $Att_{x}^{t}$ of length N.

5.3 Sleep Staging Decision Model Based on Temporal Information

The sleep staging task involves capturing the temporal information of adjacent sleep frames. When dealing with data that has temporal characteristics, such as time series data or sequential data, the decision models from section 2 are unable to capture the temporal correlation and dynamic changes in adjacent sleep frames. Therefore, this section introduces a decision model that is temporally correlated, specifically optimized and designed for the characteristics of sequential data.

The temporally correlated decision model leverages temporal information in sequential data to more accurately infer and predict events or states within the sequence. Unlike traditional feature aggregation and global decision-making, temporal models take into account the time order in the data, enabling them to adapt more effectively to the dynamics and trends of time series data. This section will delve into the introduction of a temporally correlated decision model, as illustrated in Figure 10.

Figure 10: Decision models with temporal correlation

The forward propagation process is as follows:

$$f_{global}^{t}=Seq\_local\left(\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}\right)$$ (41)

$$f_{seq}^{t}=Seq\_global(\overrightarrow{f_{seq}^{(t-1)}},f_{global}^{t},\overleftarrow{f_{seq}^{(t+1)}})$$ (42)

$${{c}^{t}}=classifier(f_{seq}^{t})$$ (43)

$$pre{{d}^{t}}=argmax({{c}^{t}})$$ (44)

where the local temporal learning structure $Seq\_local$ first integrates the feature vectors of the sample blocks within a single sleep frame ${{X}^{t}}$, represented as $\left\{f\_rep_{i}^{t}|i\in\left\{1,2,\ldots,N\right\}\right\}$, to obtain a global feature vector $f_{global}^{t}$ that contains temporal information. Then, the global temporal learning structure $Seq\_global$ processes the global feature vector $f_{global}^{t}$ in conjunction with the forward sequence feature of the previous sleep frame $\overrightarrow{f_{seq}^{(t-1)}}$ and the backward sequence feature of the next sleep frame $\overleftarrow{f_{seq}^{(t+1)}}$, resulting in a sequence feature that comprehensively incorporates the temporal dependencies.

5.4 Analysis of Interpretability Model Results

In this section, we will conduct a comprehensive analysis and performance comparison of the previously introduced models, namely the vote-based decision model, the feature vector-based decision model, and the temporally correlated decision model. These models underwent rigorous testing using five-fold cross-validation on the initial fold of the Physio2018 dataset. The specific accuracy results are meticulously presented in Table 6 for detailed evaluation and comparison.

Table 6: Number of samples

Method	Accuracy
Decision model based on voting	73.2
Decision model based on feature vectors	73.2
Decision model related to time series	81.5

In the experiment, it was noted that decision models predicated on voting and feature vectors demonstrated diminished accuracy. This phenomenon primarily emanated from their inadequate capacity to effectively capture both localized and global temporal features. Notwithstanding their disparate structural configurations, both models evinced limitations in assimilating input features during forward propagation, culminating in commensurate accuracy outcomes.

The decision vectors abstracted from a segment of the Physio2018 dataset are delineated in Figure 11. These depictions illustrate the decision vectors corresponding to the 6th, 8th, 70th, and 76th sleep frames in sample tr03-0005 from the Physio2018 dataset. (The choice to feature these sleep frames was predicated on their manifestation of prototypical waveform characteristics, rendering them more amenable to scrutiny.)

The sleep stages are designated as W (wakefulness), N1 (light sleep), N2 (intermediate sleep), and N3 (deep sleep). A single-channel EEG data from the central lead C4-M1 is employed as the data channel. Heatmaps labelled a, b, c, and d correspond to varying models: the vote-based model, feature vector-based forward propagation model, feature vector-based backpropagation model, and temporally correlated decision model. Within the heatmaps, regions with greater darkness signify the features upon which the models concentrate, in accordance with the sleep staging criteria articulated in the AASM scoring manual. The results depicted in Figure 11 illustrate a notable similarity in outcomes between models employing forward propagation (heatmap b) and backpropagation (heatmap c), affirming the effectiveness and accuracy of backpropagation in elucidating the model’s decision-making process.

In Figure 11(a), the decision vectors a, b, c, and d are indicative of the alpha rhythm, as emphasized in the heatmap. This finding aligns with the methodology employed by sleep experts for identifying the W stage as per the AASM scoring manual.

Figure 11(b) displays decision vectors a, b, c, and d pointing towards the low-amplitude mixed-frequency (LAMF) waves. Nevertheless, decision vector d demonstrates limited coverage of the LAMF waves, indicative of a more focused range.

(a) Comparison of interpretable methods for stage W

(b) Comparison of interpretable methods for stage N1

(c) Comparison of interpretable methods for stage N2

(d) Comparison of interpretable methods for stage N3

Figure 11: The analysis of single channel EEG raw signal

In Figures 11(c) and 11(d), all models successfully identify slow waves. However, the temporally correlated model only partially encompasses all regions of slow waves, potentially attributed to excessive reliance on temporal information.

Despite achieving higher accuracy, the temporally correlated decision model integrates an excessive amount of temporal information from adjacent frames, consequently leading to decreased consistency with the decisions outlined in the AASM scoring manual. Conversely, non-temporally correlated decision models demonstrate more robust alignment with the AASM scoring manual.

6 Conclusion

Sleep is a crucial physiological phenomenon for humans, and the quality of sleep affects various aspects of daily life. Good sleep quality can promote metabolism, maintain cardiovascular health, and improve attention and reaction capabilities. Sleep monitoring is an important means of analyzing sleep quality, with sleep stage classification (sleep staging) being a key component. Therefore, an efficient automatic sleep staging algorithm is of great significance for health monitoring.

This paper proposes a neural network model architecture based on the prior knowledge of sleep experts and deeply analyzes the model’s lightweight nature and interpretability. Additionally, a set of interpretable sleep staging systems has been developed to achieve low-cost, efficient automatic sleep stage classification and describe the sleep cycle, aiming to improve the prevalence and efficiency of sleep monitoring in both home and clinical environments. By adopting the latest machine learning technologies, this paper not only enhances the level of automation in sleep staging but also increases the system’s interpretability, enabling medical professionals to better understand and trust the model’s decision-making process. The main contributions of this paper include:

1. High-performance sleep staging model: The DetectSleepNet model developed in this study utilizes single-channel EEG signals and achieves competitive accuracy on publicly available large sleep staging datasets without additional processing. This result showcases that the proposed method streamlines operations while maintaining high accuracy, offering a robust tool for sleep research and clinical applications.

2. Lightweight model DetectSleepNet-tiny: To better cater to the requirements of home and mobile devices, this study introduces a lightweight model with a minimal parameter count. This model significantly reduces computational resource requirements while retaining high accuracy.

3. Decision visualization: By integrating a model inference head capable of evaluating the attention level of each sleep frame to specific EEG segments, this system enhances result interpretability and provides medical professionals with an intuitive decision support tool.

Through these efforts, we look forward to extending automatic sleep staging technology from clinical laboratories to homes and mobile devices, more broadly serving public health and the development of sleep science.

Acknowledgements Extend the sincerest gratitude to Associate Professor Sun Guobing of Heilongjiang University for the invaluable guidance provided.

Declarations