Alertness-based subject-dependent and subject-independent filter optimization for improving classification efficiency of SSVEP detection

1.Introduction

EEG-based brain computer interface (BCI) technology had been developed for medical equipment and artificial intelligence applications [1, 2]. EEG signals are commonly applied to BCI tasks including the P300 potential [3, 4], SSVEPs [5, 6, 7] and event-related desynchronization/synchronization (ERD/ERS) produced by motor imagery tasks [8, 9].

Conventionally, users of BCI have heavy mental workloads which manipulates relevant applications [10, 11]. In the task requiring sustained attention, human alertness was difficult or impossible to retain for a constant level for a long time [12]. Fortunately, EEG signal was not only used for BCI control but was also related to the changes of mental status [13, 14]. During the past half century, many studies of vigilance demonstrated that EEG rhythm was an effective indicator to reflect the fluctuation at the level of alertness [15].

As known, SSVEP signal was typically related to the EEG spectrum [16]. Canonical correlation analysis (CCA), using several harmonics of the stimuli frequencies, was the most popular method for SSVEP recognition [17]. Bin et al. [18] conducted the experiments of character spelling to verify the high efficiency of this algorithm in comparison with other methods. However, there were no effective methods that could be used for evaluating mental states in the task of SSVEP-BCI.

Traditional alertness supervising made use of subject-dependent pilot EEG data which combined features of spectral power and machine learning methods [19, 20]. Subject-dependent manner was described as constructing the classifier based on prior data. In contrast, the subject-independent model was trained by irrelevant data from other subjects and tested by his/her own data [19, 21]. The normalization was applied to unify the evaluation rule at a standard level of data dimensions. On this basis, the features of EEG rhythms would be extracted for constructing the subject-independent alert-model. Furthermore, the sleepiness propensity was a transient period occurring after a long period of monotonous or heavy attention-demanding tasks [22]. It could be used for vigilance assessment reflected the process from wakefulness to sleepiness [23]. In this paper, we used two subject-independent models and one subject-dependent model for alertness evaluation in the task of SSVEP-BCI.

2.Methodology

2.1Data process

The alertness predictor was developed for identifying non-effective trials from SSVEP task. As shown in Fig. 1, the predictor was used for assessing the subjects’ mental state by SVM classifier.

Figure 1.

Flowchart of the data process for classification. The subject-dependent method utilized 80% of task data for training and 20% for testing. Two subject-independent models were developed for classifying all task trials into fatigue state and wakeful state, which represented non-effective and effective recognition. After alertness-model filtering, the CCA algorithm was employed for detecting SSVEP signal for labeling these effective trials.

We compared two subject-independent methods with subject-dependent alert-model to construct the alertness predictor. Moreover, the non-model classification method (i.e., CCA) without the alertness-model filtering was used for contrasting with the above three methods. The subject-dependent approach utilized 80% of task data for training and 20% for testing. The 10-fold cross validation was applied to verify the efficiency of this model.

On the other hand, two subject-independent models trained by task data except for his/her own data and Sleep-EDF dataset for training, respectively. We made a reasonable assumption for the subject to be fatigued in the experiment of error detection. Thus, all trials could be divided into two portions which represented wakeful and fatigue states. Sleeping-EDF dataset which was obtained from the PhysioBank online resource is a standard public data which recorded subjects from wakeful state to sleeping state [24]. We only made use of four recordings: sc4002e0, sc4012e0, sc4102e0 and sc4112e0 from healthy subjects recorded in 1989. Also a typical SVM classifier was applied to classification tasks. Similarly, both subject-independent models were developed for classifying all task trials into fatigue state and wakeful state, which represented non-effective and effective recognition. Then, CCA algorithm was employed for detecting SSVEP signal for labeling these effective trials.

3.Experiment and result analysis

4.Discussion

In our study, CCA algorithm was used for SSVEP detection. It was reported that the method obtained good results in SSVEP-based BCIs [18, 17]. In order to verify the algorithm validity, we analyzed the spectral feature of subject 4’s EEG signals. Figure 2 shows the power spectra of channel Oz separated for each evoked frequency. It was indicated that this algorithm was effective for frequency recognition of SSVEP signals.

Figure 2.

The power spectra of channel Oz separated for each evoked frequency by subject 4. Sequentially, the target frequencies were 6 Hz, 7 Hz, 8 Hz and 9 Hz.

Previously, the recognition strategy (feature extraction and classification algorithm) was considered as the only one factor that influenced the efficient of BCI systems. Nevertheless, the physiological status of the subject directly influenced the performance of BCI tasks. The control effect of BCI went worse while the subject could not afford the heavy load in spirit. This is why we applied alertness assessment for detecting the subject’s mental status to exclude the subjective disturbance.

In this paper, three alertness models were presented for improving the efficiency of our BCI system. From the viewpoint of classification, the subject-dependent model was most suitable for detecting error-sorted trials. The method of AOSD-SM was inferior to the non-model method. Besides, the outstanding performance of the SD-SM model was a novel finding for alertness model-based SSVEP detection. Except for the SD-SM model, other models conformed to the experimental expectation. Previous studies had shown that subject-dependent models were feasible for identifying the low-alert state [12]. For most subjects, group statistics could not be utilized to precisely predict changes in mental states [25]. However, the result of the SD-SM model-based approach suggested that low-alert cognitive states and sleepy mental states have similar spectral features.

Figure 3.

Comparison of the mean values of delta, theta, the ratio of delta and total power, the ratio of theta and total power and theta/theta between fatigue condition and wakeful condition.

For clarifying the theoretical principle of the SD-SM model, the means of all features were statistically analyzed between fatigue condition (FC) and wakeful condition (WC). We found that the means of delta, theta, the ratio of delta and total power, the ratio of theta and total power as well as theta/theta were less in FC for all subjects (Fig. 3). Meanwhile, Fig. 4 shows the statistical result of the numbers of correct trials between the first half and the second one of the task. The classification accuracies of first half trials were not less than those of last half trials for most subjects (8 of 10 subjects). It was indicated that the performance of the mental task seemed to be worse over time. This phenomenon was consistent with prior conclusions about the spectral power change from the wakeful state to the sleepy state [22, 26]. It was implied that work difficulty was crucial to maintain the high efficiency of the task performance.

Figure 4.

The numbers of correct trials between the first half and second half of the SSVEP task. The classification accuracies of the first 30 trials were no more than those of the second half for most subjects.

The subject-dependent and subject-independent alertness models proved to play a positive role in SSVEP detection. They could be applied for different monitor conditions with or without pilot data. The subject-dependent model was more suitable for intra-session vigilance monitoring at the basis of beforehand data acquisition, whereas the subject-independent model was more suitable for application to cross-session alertness evaluation without detailed information about the user’s cognitive state. However, there are several issues that need to be resolved to improve the performance. Firstly, the quantity of data must be increased to verify the universality to avoid overfitting. Therefore, thorough analyses would require more studies with a larger amount of subjects. Secondly, the process control needs to be considered for online BCI tests. The balance between transmission speed and systematical efficiency should be kept for meeting actual demands.

5.Conclusions

This paper introduced a novel method for identifying non-effective trials of SSVEP-based BCI by subject-dependent and subject-independent alertness models. These models were used for filtering ineffective trials. The result implied that the subject-dependent alertness model was most useful for improving classification trials. However, the subject-independent alertness model could raise the classification accuracy.