Wavelet Packet Feature Extraction And Support Vector Machine Psychology Essay

ripple Packet bear filiation And Support Vector Machine Psychology EssayABSTRACT- The aim of this give way on is an automatic mixed bag of the pneumoencephalogram ( encephalogram) intercommunicates by victimization statistical frisks stock and support transmitter motorcar. From a real entropybase, 2 sets of pneumoencephalogram polaritys argon used pneumoencephalogram recorded from a healthy person and from an epileptic person during epileptic seizures. Three important statistical features ar computed at dispa crop sub-bands clear-cut ripple and riffle mailboat decomposition of encephalogram recordings. In this study, to select the best riffle for our application, five wavelet rear end functions atomic shape 18 considered for processing pneumoencephalogram signals. After reducing the mark of the obtained information by linear discriminant abridgment and principal member synopsis, feature vectors atomic number 18 used to model and to train the efficien t support vector machine pickifier. In effect to show the efficiency of this approach, the statistical potpourri performances are evaluated, and a crop of 100% for the best mixture truth is obtained and is compared with those obtained in other studies for the same data set.Keywords- encephalogram Discrete Wavelet Transform, Wavelet Packet Transform, Support Vector Machine, Statistical analysis, variety.1. IntroductionIn neurology, the electroencephalogram (EEG) is a non-invasive test of brain function that is mostly used for the diagnosing and miscellanea of epilepsy. The epilepsy episodes are a result of excessive electrical discharges in a group of brain cells. Epilepsy is a chronic neurological trouble oneself of the brain that affects over 50 million people worldwide and in developing countries, one-third fourths of people with epilepsy may non receive the treatment they need 1. In clinical decisions, the EEG is related to initiation of therapy to amend quality of epileptic patients life. However, EEG signals occupy a huge account book and the scoring of long-term EEG recordings by visual inspection, in straddle to classify epilepsy, is usually a time consuming task. Therefore, many researchers pitch addressed the problem of automatic detection and classification of epileptic EEG signals 2, 3. Different studies have shown that EEG signal is a non-stationary process and non-linear features are extracted from brain activity recordings in order to specific signal characteristics 2, 4, 5, 6. thusly these features are used as remark of classifiers 11. Subasi in 7 used the decided wavelet transform (DWT) coefficient of familiar and epileptic EEG segments in a modular neural network called mixture of expert. For the same EEG data set, Polat and Gnes 8 used the feature reduction methods including DWT, autoregressive and discrete Fourier transform. In Subasi and Gursoy 9, the dimensionality ofthe DWT features was lessen victimisation princi pal component analysis (PCA), independent component analysis (ICA) and linear discriminant analysis (LDA). The resultant features were used to classify normal and epilepsy EEG signals utilize support vector machine. Jahankhani, Kodogiannis and Revett 10 have obtained feature vectors from EEG signals by DWT and performed the classification by multilayer perceptron (MLP) and radial tail function network. Wavelet megabucks transform (WPT) appears as one of most promising methods as shown by a great number of works in the literature 11 in particular for ECG signals and relatively fewer, for EEG signals. In 12, Wang, Miao and Xie used wavelet packet entropy method to extract features and K-nearest neighbor (K-NN) classifier. In this work, both DWT and WPT sunder non stationary EEG signals into relative frequency sub-bands. Then a set of statistical features such as standard deviation, energy and entropy from real database EEG recordings were computed from each decomposition train to represent time-frequency distribution of wavelet coefficients. LDA and PCA are applied to these various disceptations al crusheding a data reduction. These features were used as an commentary to efficient SVM classifier with two discrete outputs normal person and epileptic subject. A stripe of the performances of these methods is presented. The rest of this paper is organized as follows portion 2 describes the data set of EEG signals used in our work. In Section 3, preliminaries are presented for immediate reference. This is followed by the step up of our experiments and the results in ingredient 4. Finally, some concluding remarks are given in Section 5.2. entropy SELECTIONWe have used the EEG data taken from the artifact free EEG time series database available at the discussion section of Epileptology, University of Bonn 23. The complete dataset consists of five sets (denoted A-B-C-D-E). Each set contains100 single-channel EEG signals of 23,6s. The normal EEG data was obtained from five healthy volunteers who were in the relaxed awake tell apart with their eyes open (set A). These signals were obtained from extra-cranially surface EEG recordings in accordance with a standardized electrode placement. Set E contains seizure activity, selected from all recording sites exhibiting ictic activity. All EEG signals were recorded with the same 128 channel amplifier system and digitized at 173.61Hz sampling. 12 bit analog-to-digital conversion and band-pass (0.53-40 Hz) dawn settings were used. For a more elaborated description, the reader coffin nail refer to 13. In our study, we used set A and set E from the complete dataset.Raw EEG signalFeature extraction Energy, Entropy and Standard deviation from DWT and WPT decom-position coefficientsDimensionality reduction by LDA and PCA potpourri andPerformance measureHealthyEpileptic consider 1 The persist chart of the proposed system3. methodsThe proposed method consists of ternion main parts (i) statist ical feature extraction from DWT and from WPT decomposition coefficients, (ii) dimensionality reduction use PCA and LDA, and (iii) EEG classification use SVM. The flow chart of the proposed method is given in strain 1. Details of the pre-processing and classification steps are examined in the following subsections.3.1 abridgment using DWT and WPTSince the EEG is a highly non-stationary signal, it has been recently recommended the use of time-frequency bowl methods 14. Wavelet transform depose be used to decompose a signal into sub-bands with low frequency (approximate coefficients) and sub-bands with high frequency (detailed coefficients) 15, 16, 17. Under discrete wavelet transform (DWT), only approximation coefficients are decomposed iteratively by two filters and then down-sampled by 2. The first filter h. is a high-pass filter which is the mirror of the second low pass filter l.. DWT gives a left recursive binary tree structure. We neat 16 DWT coefficients. Wavelet packe t transform (WPT) is an extension of DWT that gives a more informative signal analysis. By using WPT, the lower, as well as the higher frequency bands are decomposed fully grown a balanced tree structure. The wavelet packet transform generates a full decomposition tree, as shown in figure 2. In this work, we performed five-level wavelet packet decomposition.The two wavelet packet orthogonal bases at a parent node (i, p) are obtained from the following recursive relationships Eq. (1) and (2),where ln and hn are low (scale) and high (wavelet) pass filter, respectively i is the index of a sub lays erudition and p is the number of sub offices 15. The wavelet packet coefficients corresponding to the signal x(t) can be obtained from Eq. (3),l(3,0) (3,1)(3,6) (3,7)hl h l hl hh l hl hlSIGNAL(0,0)(1,0)(1,1)(2,0)(2,1)(2,2)(2,3)Figure 2 Third level wavelet packet decomposition of EEG signalTable 1 gives the frequency bands for each level of WPT decomposition. Figures 3 and 4 show the fifth l evel wavelet packet decomposition of EEG segments, according to figure 2. We processed 32 WPT coefficients.Therefore, in this study, three statistical parameters energy feature (En), the measure of Shannon entropy (Ent) and standard deviation (Std) are computed,(4)(5)(6)3.2 Principal component analysisTo make a classifier system more effective, we use principal component analysis (PCA) for dimensionality reduction. The purpose of its implementation is to derive a small number of uncorrelated principal components from a larger set of zero-mean variables, retaining the maximum workable amount of information from the original data. Formally, the most common derivation of PCA is in terms of standardized linear projection, which maximizes the variance in the projected space 18, 19. For a given p-dimensional data set X, the m principal axes W1,,Wm where 1 m p, are orthogonal axes onto which the retained variance is maximum in the projected space. Generally, W1,,Wm can be given by the m stellar(a) eigenvectors of the sampleTable1 Frequency band of each wavelet decomposition level. corruptionlevelFrequency band (Hz)123450-86.8 86.8-173.60-43.5 43.5-86.8 86.3-130.2 130.2-173.60-21.75 21.75-43.5 43.5-54.375 54.375-86.3 86.3-108.05 108.05-130.2 130.2 130.2-151.95 151.95-173.60-10.875 10.875-21.75 21.75-32.625 32.625-43.5 43.5-54.375 54.375-65.25 65.25-76.125 76.125-87 87-97.875 97.875-108.75 108.75-119.625 119.625-130.5 130.5-141.375 141.375-152.25 152.25-163.125 163.125-173.60-5.44 5.44-10.875 10.875-16.31 16.31-21.75 21.75-27.19 27.19-32.625 32.625-38.06 38.06-43.5 43.5-48.94 48.94-54.375 54.375-59.81 59.81-65.25 65.25-70.69 70.69-76.125 76.125-81.5681.56-87 87-92.44 92.44-97.87 97.87-103.3 103.3-108.75 108.75-114.19 114.19-119.625 119.625-125.06 125.06-130.5 130.5-135.94 135.94-141.38 141.38-146.81 146.81-152.25 152.25-157.69 157.69-163.125 163.125-168.56 168.56-173.6covariance matrix where is the sample mean and N is the number of samples, so that SWi= iWi, where i is the ith largest eigenvalue of S. The m principal components of a given observation vector xi are given by the reduced feature vector .3.3 Linear discriminant analysisLinear discriminant analysis (LDA) projects high-dimensional data onto a low-dimensional space where the data can achieve maximum class separability 19. The aim of LDA is to hit a new variable that is a faction of the original predictors, i.e. the derived features in LDA are linear combinations of the original variables, where the coefficients are from the transformation matrix i.e. LDA utilizes a transformation matrix W, which can maximizes the ratio of the between-class scatter matrix SB to the within-class scatter matrix SW, to transform the original feature vectors into lower dimensional feature space by linear transformation. The linear function y= WTx maximizes the Fisher criterion J(W) 19,where xj(i) represents the jth sample of the ith of total c classes. k is the dimension of the feature space, and i is t heFigure 3 Fifth level wavelet packet decomposition of healthy EEG signal (set A).Figure 4 Fifth level wavelet packet decomposition of epileptic EEG signal (set E).mean of the ith class. Mi is the number of samples within classes i in total number of classes.where is the mean of the entire data set.As a dimensionality reduction method, LDA has also been adopted in this work.3.4 SVM classifierIn this work, SVM 20 has been employed as a learning algorithm due to its superior classification ability. permit n examples S=xi,yii=1n, yi-1,+1, where xi represent the input vectors, yi is the class label. The decision hyperplane of SVM can be delimitate as (w, b) where w is a weight vector and b a bias. The optimal hyperplane can be written as,where w0 and b0 denote the optimal values of the weight vector and bias. Then, after training, test vector is classified by decision function,To recoup the optimum values of w and b, it is required to solve the following optimisation problemsubject towhere i is the slack variable, C is the user-specified penalty parameter of the error term (C0), and the kernel function 21. A radial basis function (RBF) kernel defined as,was used, where is kernel parameter defined by the user.4. results and discussionBefore we give the experimental results and discuss our observations, we present three performance measures used to evaluate the proposed classification method. (i) Sensitivity, represented by the genuine(a) positive ratio (TPR), is defined as(ii) Specificity, represented by the true negative ratio (TNR), is given by,(iii) and average classification accuracy is defined as,(16)where FP and FN represent false positive and false negative, respectively.All the experiments in this work were undertaken over 100 segments EEG time series of 4096 samples for each class set A and set E. There were two diagnosis classes familiar person and epileptic patient. To estimate the reliability of the proposed model, we utilize ten-fold cross tr ial impression method. The data is split into ten parts such that each part contains approximately the same proportion of class samples as in the classification dataset. Nine parts (i.e. 90%) are used for training the classifier, and the remaining part (i.e. 10%) for testing. This procedure is repeated ten times using a different part for testing in each case. As illustrated in Fig.3 and 4, feature vectors were computed from coefficient of EEG signals. Taking energy as feature vector, figure 5 shows that the features of both normal and epileptic EEG signals are mixed. The proposed analysis using wavelets was carried out using MATLAB R2011b.In literature, there is no common suggestion to select a particular wavelet. Therefore, a rattling important step before classifying EEG signals is to select an appropriate wavelet for our application. Then, five wavelet functions namely Daubechies, Coiflets, Biorthogonal, Symlets and Discrete Meyer wavelets are examined and compared, in order to evaluate the performance of various types of wavelets. Figure 6 shows accuracy, sensitivity and specificity from different wavelets. We see that the best wavelet giving good redress rate is the Db2, Db4, coif3 and Bior1.1.The choice of the incur wavelet is focused on daubechies where the length of the filter is 2N, while coifflet wavelet filter is 6N and biorthogonal wavelet (2N +2). After EEG signal Db2 wavelet decomposition and dimensionality reduction, results of correct rate classification are showed in Table 2. The classification accuracy varies from the optimum value (100%) to a last value (87%). The results using standard deviation are the best results obtained and using entropy is better than using energy in EEG signals classification. In this study, experimental results show that linear discriminant analysis based on wavelet packet decomposition improves classification and the optimum SVM results are obtained by using standard deviation feature computed from wavelet pac ket coefficient and LDA reduction method. For this proposed scheme, the accuracy of the classification is 100%. This method presents a novel contribution and has not yet been presented in the literature. Figure 7 shows the average rate of classification (accuracy, sensitivity, specificity) obtained with different methods of decomposition (DWT or WPT), two reduction methods (LDA or PCA) and three characteristic features (standard deviation, energy, entropy) using the four best wavelet (Db2, Db4, coif3 and Bior1.1). We see that the combination of LDA with standard deviation have an optimum average accuracy rate of 99.90% and combination of standard deviation with PCA reaches 99.50 %. Table 3 gives a sum-up of the accuracy results obtained by other studies from the same dataset (set A and set E) using extraction of features from EEG signal and their classification.5. conclusionIn this paper, EEG signals were decomposed into time-frequency representations using discrete wavelet transfo rm, wavelet packet transform and statistical features wereFigure 5 Energy feature vector coefficient D3versus D2 (adapted from 22).Table 3 Epilepsy classification accuracies evaluation obtained in literature from the same data setsAuthorsMethod truth (%)7 SubasiDWT + Mixture of Expert94.508 Polat and GnesDWT+DFT+ Auto-regres-sive model + Decision Tree99.329 Subasi and GursoyDWT+PCA+ LDA+ICA +SVM98.75(PCA)100(LDA)99.5(ICA)12 Wang, Miao and XieWPT+ Entropy-hierarchical K-NN classification99,4414 beylBurg autoregressive + LS-SVM99.56Our methodWPT + Standard deviation+LDA + SVM100computed to represent their distribution. The most commensurate mother wavelets for feature extraction and classification were found. The pick of the suitable mother wavelet and using reduction methods lead to the improvement of performance of EEG signal classification. It has been shown by experiments that for the SVM and the combination of the standard deviation with LDA have the highest correct classificat ion rate of 100% in comparison with other techniques. The fill in expert systems for detection and classification of epileptic EEG signal is expected to grow more and more in order to swear out and strengthen the neurologist in numerous tasks, especially, to reduce the number of selection for classification performance.These promising results encourage us to continue with more insight our study and to apply it to other databases recorded with other diseases.