Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
An Edge Computing System with AMD Xilinx FPGA AI Customer Platform for Advanced Driver Assistance System
Previous Article in Journal
A Sparse Recovery Algorithm for Suppressing Multiple Linear Frequency Modulation Interference in the Synthetic Aperture Radar Image Domain
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Lower Limb Motion Recognition with Improved SVM Based on Surface Electromyography

1
College of Computer Science and Technology, Xi’an University of Science and Technology, Xi’an 710054, China
2
School of Computer Science and Engineering, Xi’an University of Technology, Xi’an 710048, China
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(10), 3097; https://doi.org/10.3390/s24103097
Submission received: 2 April 2024 / Revised: 30 April 2024 / Accepted: 10 May 2024 / Published: 13 May 2024
(This article belongs to the Section Biosensors)

Abstract

:
During robot-assisted rehabilitation, failure to recognize lower limb movement may efficiently limit the development of exoskeleton robots, especially for individuals with knee pathology. A major challenge encountered with surface electromyography (sEMG) signals generated by lower limb movements is variability between subjects, such as motion patterns and muscle structure. To this end, this paper proposes an sEMG-based lower limb motion recognition using an improved support vector machine (SVM). Firstly, non-negative matrix factorization (NMF) is leveraged to analyze muscle synergy for multi-channel sEMG signals. Secondly, the multi-nonlinear sEMG features are extracted, which reflect the complexity of muscle status change during various lower limb movements. The Fisher discriminant function method is utilized to perform feature selection and reduce feature dimension. Then, a hybrid genetic algorithm-particle swarm optimization (GA-PSO) method is leveraged to determine the best parameters for SVM. Finally, the experiments are carried out to distinguish 11 healthy and 11 knee pathological subjects by performing three different lower limb movements. Results demonstrate the effectiveness and feasibility of the proposed approach in three different lower limb movements with an average accuracy of 96.03% in healthy subjects and 93.65% in knee pathological subjects, respectively.

1. Introduction

Lower-limb exoskeleton robots have been developed to assist elderly or disabled individuals’ movements in daily activities [1,2,3] and to improve the recovery effect in pathological rehabilitation [4]. The principal to realize the effective control of robotic exoskeletons is accurately inferring the human users’ motion intentions. Among available sensing techniques, surface electromyography (sEMG) signals are preferred for controling information in rehabilitated exoskeleton robots, which mainly consider two factors: sEMG signals could not only detect human user motion intentions ahead of actual physical movements [5], and also directly reflect people’s motion states by muscle contractions. This characteristic of sEMG signal can avoid control delays form exoskeleton robotic applications.
As a bioelectrical signal, sEMG signals contain highly relevant biological information related to human motions. At present, sEMG signals have been extensively performed to recognize human motion intentions in a variety of ways. For example, motion variables (i.e., angle velocity, joint angle, etc.) are continuously estimated. Also, human gait or limb motion modes (i.e., walking, sitting, etc.) are distinguished via machine learning algorithm recognition-based approaches. In particular, many studies have been devoted to recognizing human motion intentions.
In the field of human motion intention recognition, it is crucial to extract features that conform to various motion changes or make motion changes more sensitive. Most existing works aim to directly extract features from sEMG signals, for instance, time domain, frequency domain, time–frequency domain, nonlinear domain, depth features, etc. For instance, Emilia et al. [6] extracted 15 time domain features to recognize lower limb movements, with an average recognition accuracy of over 96.7%. Root mean square (RMS), zero crossing (ZC), slope sign change (SSC), and waveform length (WL) in the time domain, and wavelet transform in the frequency domain, were extracted and fused to achieve over 95% classification accuracy in five lower limb movements [7]. For nonlinear features, Lempel Ziv complexity (LZC) and entropy features were also utilized for motion identification analysis [8,9,10]. Zhang et al. [11] extracted the time domain, frequency domain, and sample entropy (SampEn) and proposed an improved differential evolution (DE) algorithm to optimize the weight value of each feature and achieve the optimal combination of multiple features.
In addition, existing recognition methods of movement classification via machine learning algorithms (i.e., SVM, K-nearest neighbor (KNN), etc.) have also been applied. Since SVM has a superior ability to deal with uncertainties under dynamic conditions, it has been extensively implemented in limb motion classification. For example, a lower limb motion recognition approach based on ReliefF and kernel principal component analysis (KPCA) combined with SVM was proposed. The average recognition accuracy was improved by 10.86% and 2.29% compared with ReliefF-KPCA-BP and ReliefF-KPCA-PNN, respectively [12]. The frequency domain features, such as energy and variance of wavelet packet coefficients were extracted, and a particle swarm optimization–improved SVM classification model was constructed to reach 90.66% classification accuracy in six commonly used upper limb movements [13]. A back propagation (BP) neural network algorithm model based on SVM was proposed, which improved the average recognition accuracy by 9.4% compared with the SVM algorithm in lower limb motions [14]. In particular, SVM parameters have a great influence on the recognition accuracy of movements. Thus, seeking the optimal parameter values for SVM becomes a big challenge in the motion recognition field. Heuristic algorithms (i.e., PSO, whale optimization algorithm (WOA), etc.) are good candidates for optimizing and selecting the SVM model parameters. For instance, an improved WOA algorithm was proposed to reach the optimal parameters of the SVM model [15]. Liu et al. [16] extracted multi-domain features of sEMG signals, and simultaneously established an accurate SVM classification model by proposing an improved WOA. Cao et al. [17] proposed a novel adaptive mutation particle swarm optimization (AMPSO) to optimize the parameters of the SVM algorithm for recognition of sEMG-based limb motions.
Since the muscles associated with lower limb movements overlap each other, the corresponding sEMG signals are complex in nature. Thus, classifying lower limb movements is more challenging for researchers, compared to the recognition of the upper limb movements. However, the objects of most existing methods focus on healthy individuals, with unsatisfactory results for subjects having knee issues. In addition, the functionality of each muscle performing the task-specific lower limb movements (i.e., walking, standing, etc.) is completely different [18]. The knee joint has multiple degrees of freedom movements in flexion, extension, adduction, abduction, medial, and lateral, in which flexion and extension play the most important roles in human lower limb movements and are easy to injure during gait exercise [16,19].
In this paper, the muscles involved in flexion and extension of knee joints are selected to provide the object. A muscle synergy approach is adopted to select the most appropriate muscles. Moreover, nonlinear features of sEMG are believed to be effective in classifying the movements. The Fisher discriminant function method based on the Fisher score (FS) is adopted to reduce the dimension of the multi-nonlinear feature vectors, which makes it conducive for the improved SVM classifier to accuracy recognize lower limb movements. The objective of this paper is to find out the optimal parameter values of the SVM model by proposing an improved hybrid GA-PSO to distinguish various lower limb movements in individuals with and without knee pathology. Hence, an sEMG-based lower limb motion recognition using SVM with an improved hybrid GA-PSO algorithm is proposed. The main contributions are as follows.
  • Non-negative matrix factorization (NMF) method is applied to analyze muscle synergy for multi-channel sEMG signal of various lower limb movements so as to select the most appropriate muscles.
  • Taking into account the non-linearity and non-stationary of sEMG, we extract the multi-nonlinear features (e.g., approximate entropy (ApEn), SampEn, fuzzy entropy (FuzzyEn), LZC, Lyapunov, and correlation dimension (CD)). Also, the feature selection is performed with the help of the FS based on the Fisher discriminant function method, prior to feeding the dimension-reduced features to the improved SVM.
  • Since the hybrid GA-PSO algorithm has both high convergence efficiency and the capability of avoiding being trapped in a local optimal solution, this approach is leveraged to optimize the SVM to find out the best parameters (i.e., penalty factor p and kernel function parameters g). Simultaneously, a GA-PSO-SVM approach is utilized to construct a lower limb motion recognition model.
  • The proposed approach performance has been verified in the task of classifying three lower limb movements associated with knee muscles in healthy individuals (96.03%) and subjects afflicted with knee disorders (93.65%), respectively.

2. The Proposed Approach Framework

sEMG is a kind of bioelectric signal generated with muscle contraction, which drives joint movement and reflects the motion information of the limb. As the electrical signal source of muscle activity, sEMG essentially reflects the movement state of nerve, bone, and muscle systems [16]. Hence, we try to combine the sEMG signal with the motion state of the knee joint musculoskeletal system, as revealed in Figure 1a. Also, the NMF method is utilized to select optimal muscles for various lower limb movements. Specifically, there are two types of subjects with and without knee pathology performing three different lower limb movements (e.g., walking, sitting, and standing). For each subject, in Figure 1b, we label the trials of “walking” as class 0, the trials of “standing” as class 1, and the trials of “sitting” as class 2. We further extract and reduce multi-nonlinear features of sEMG signals as input to an improved GA-PSO-SVM recognition model by classifying three lower limb movements.

2.1. Selection of Muscles

Muscle synergy reflects the shared neural drives of motor units across different muscles, which has also been widely applied in limb motion recognition [20]. In this paper, vastus medialis (VM), rectus femoris (RF), biceps femoris (BF), and semitendinosus (ST) are selected as the four most relevant muscles in the lower limb motions, while the contribution of each muscle varies in various movements. Hence, muscle synergy analysis is applied to reduce the data redundancy and obtain the muscles with the greatest contribution during movements. According to muscle synergy theory, the contribution of each muscle in a movement can be obtained through a linear combination of muscle synergies and activation coefficients [16].
V N × T W N × K × H K × T [ W 1 W 2 , W K ] × [ H 1 H 2 , H K ] T Σ i = 1 K W i H i ,
where V is the given muscle activity level matrix, N is the channel number, T is the time series length, and K is the number of muscle synergies. W and H are the muscle synergy matrix and the activation coefficients matrix. In addition, W i represents the muscle synergy and H i indicates the activation coefficients of the i muscle synergy, respectively.
NMF is a decomposition technique, which can transform the sEMG signals from the muscle activity space to the synergy space. More exactly, muscle activation level matrix V R m × n is decomposed into two factors W R m × r and H R r × n . The relation is given by,
V m × n = W m × r × H r × n + E m × n ,
where m and n are the number of recorded muscles and data samples, r indicates the dimension of muscle synergies, and E is a matrix of residuals, respectively. In particular, the dimension of muscle synergies is determined based on 90% of the total accumulated data variance. The muscle synergy space Y R k × q is implemented as the input of the muscle synergy-driven musculoskeletal model, where k and q are mentioned above, respectively.

2.2. Multi-Nonlinear Feature Extraction and Selection

2.2.1. Feature Extraction

Different sEMG features can reflect various muscle statuses during movement. Moreover, as sEMG belongs to the nonlinear time series, here, six nonlinear features from sEMG, i.e., ApEn, SampEn, FuzzyEn, LZC, Lyapunov, and CD, are extracted [21]. Specifically, entropy could characterize the complexity of the signal series, and the greater the values are, the more complex the signal is. Also, LZC, Lyapunov, and CD could describe the irregularity, complexity, and dynamical changes of sEMG [10]. Six nonlinear features will be introduced in sequel.
Entropy. ApEn relies on the data length [22], and SampEn is an improvement of ApEn, independent of data length and insensitive to missing data [23]. Nevertheless, both ApEn and SampEn measure similarity using a unit step function, with a large mutation and lacking continuity of entropy. Note that FuzzyEn utilizes an exponential function to blur the similarity measure so that entropy changes continuously and smoothly with parameters [24]. In addition, the vector similarity of ApEn and SampEn is determined by the absolute value difference with the data baseline drift. FuzzyEn determines the similarity of vectors by determining the shape of the fuzzy function with an exponential function, thereby blurring the similarity measure. Since the exponential function possesses the two desired properties, continuous ensures the similarity does not change abruptly and convex ensures self-similarity is maximum, the imported exponential functions do not sacrifice precision.
For an N sample time series x ( i ) : 1 i N , a fixed value of m and τ integers and tolerance r 1 , forms vector sequences X i m , i = 1 , , N m + 1 as follows:
X i m = x ( i ) , x ( i + 1 τ ) , , x ( i + ( m 1 ) τ ) ,
where X i m represents m consecutive x values.
The distance d i j between X m ( i ) and X m ( j ) is as follows:
d i j = d [ X i m , X j m ] = max k ( 0 , m 1 ) | x ( i + k τ ) x ( j + k τ ) | .
Estimate the probability C i m ( r 1 ) as:
C i m ( r 1 ) = 1 N ( m 1 ) τ j = 1 N ( m 1 ) τ θ ( d i j r 1 )
and
ϕ m ( r 1 ) = 1 N ( m 1 ) τ i = 1 N ( m 1 ) τ ln C i m ( r 1 ) ,
where θ is the Heaviside function,
θ = 0 , d i j r 1 1 , d i j > r 1 .
Therefore, for a finite sequence of length N, both ApEn and SampEn of the signal are obtained
ApEn ( m , r 1 , N ) = Œ m ( r 1 ) Œ m + 1 ( r 1 )
and
SampEn ( m , r 1 , N ) = ln Œ m ( r 1 ) ln Œ m + 1 ( r 1 ) ,
respectively.
In addition, given n, the similarity degree D i j from X i m to X j m is calculated through a fuzzy function μ ( d i j , n , r 1 ) as:
D i j ( n , r 1 ) = μ ( d i j , n , r 1 ) = e ( d i j / r 1 ) n .
Define the function φ m as:
φ m ( n , r 1 ) = 1 N m + 1 i = 1 N m + 1 ( 1 N m j = 1 , j i N m D i j ) ,
and thus, the FuzzyEn of the signal is obtained as:
FuzzyEn ( m , n , r 1 , N ) = ln m ( n , r 1 ) ln m + 1 ( n , r 1 ) .
It is remarked that the parameter m is defined by the data itself and represents the length of the repeating modes in the sample vectors. Also, the tolerance r 1 means the constraint on the repeated modes. In general, m is set to 2, and r 1 is 0.15 * standard deviation in biological time series analysis [25].
Lempel-Ziv complexity. LZC evaluates the chaotic state (that is, complexity) and randomness of the time series signal by measuring the number of different sub-strings and their occurrence rates along a given sequence [9,26].
For a time series X = x ( 1 ) , x ( 2 ) , , x ( N ) with length N, first transform it into a binary symbolic sequence S = s ( 1 ) , s ( 2 ) , , s ( N ) by,
s ( i ) = 0 , i f x ( i ) < X ¯ 1 , o t h e r w i s e ,
where X ¯ is the mean value of the signal X ( N ) .
Initialize both S = s ( 1 ) and Q = s ( 2 ) , and set the complexity index c ( N ) = 1 . Then, define S Q by combining S with Q, and  S Q r represents the substring obtained from S Q by deleting the last letter of S Q .
Determine whether Q belongs to a subsequence of S Q r . If so, Q is no new pattern at present, the complexity remains unchanged; otherwise, Q stands for a new pattern, the complexity index increases. The former processes are represented until all characters in the sequence S are traversed to obtain the complexity index c ( N ) .
Note that c ( N ) indicates signal complexity index and is related to N. In general, to avoid the c ( N ) being affected by the time series length N, the normalized LZC complexity index is,
LZC = c ( N ) ( log ( N ) + 1 ) N ,
when N is large, LZC can be simplified as:
LZC = c ( N ) log ( N ) N .
In particular, the normalized complexity index has upper and lower limits more conducive to the extraction of nonlinear dynamic features.
Chaotic features. Motivated by our previous works [21], both CD and Lyapunov are extracted as the chaotic features, to reflect the complexity of sEMG signals.
The phase space Y is reconstructed by embedding dimension m 1 and relay time τ 1 , i.e.,
Y = x N , x N τ 1 , , x N ( m 1 + 1 ) τ 1 .
where m 1 and τ 1 are determined by the convergence result and the sampling interval, respectively.
The correlation dimension is expressed by,
C D m = lim r 0 ln C I ( r 2 ) ln r 2 ,
where C I ( r 2 ) is the association function representing the probability, in which the distance between two points is less than r 2 . Further, both C D m and C I ( r 2 ) satisfy the logarithmic linear relationship, θ is the Heaviside function,
C I ( r 2 ) = 1 N 2 j = 1 N i = 1 N θ ( r 2 | Y i Y j | ) , i j .
By the Wolf algorithm [27], the Lyapunov exponent is expressed by,
λ = 1 t M t 0 k = 1 M log 2 L ( t k ) L ( t k ) ,
where L ( t k ) is the distance between points Y ( t i ) and its nearest neighbor point, and it is the evolution of the two points with time t, M is the total number of iterations, respectively.

2.2.2. Features Selection

In the data signal sequel, each feature is denoted by a vector of length 24,
f i = [ L Z C V M , L Z C S T , L Z C B F , L Z C R F , C D V M , , C D R F , L y V M , , L y R F , S E V M , , S E R F , A E V M , , A E R F , F E V M , , F E R F ] .
The subscript of a feature vector component stands for the muscle. Hence, a matrix F R 24 × N t r a i n = [ f 1 , , f N t r a i n ] can represent the entire set of features. The Fisher discriminant function, which takes the ratio of inter-class to intra-class dispersion degree as the optimization goal, to maximize the discriminant of various samples [28].
For the training sample x ( i ) , S B and S w indicate the inter-class and intra-class spacing matrix, respectively,
S B = q = 1 N N q ( x ¯ x ¯ q ) ( x ¯ x ¯ q ) T
and
S w = q = 1 Q i = 1 Q q ( x i x ¯ q ) ( x i x ¯ q ) T ,
where Q and Q q are the number of training sample categories and belonging to class q, x ¯ and x i represent the average vector of all training samples and i-th training sample, x ¯ q indicates the average vector of the q-th training sample, respectively. Thus, the separability index F S is obtained, i.e.,  F S = tr ( S B ) tr ( S w ) , where, tr ( S B ) and tr ( S w ) are traces of the inter-class and intra-class spacing matrix, respectively. Also, the larger the index F S , the more accurate the classification would be achieved in the sample space.
According to FS, that is, F S 1 , F S 2 , , F S 6 , an optimal set of feature components is selected, which would reduce the computational overheads of subsequent recognition tasks, and hopefully maintain the accuracy of the sEMG classifier.
In short, the Fisher discriminant function maps samples from high-dimensional to low-space, such that the projected samples have large inter-class spacing and small intra-class spacing in low-dimensional space to achieve the optimal separability of samples in low-dimensional space. Thus, an FS is computed for each feature component according to Fisher discriminant function, separately. Next, the top-q ranked feature components with large scores are picked to alleviate the complexity and achieve feature dimensionality reduction.

2.3. Improved Hybrid GA-PSO Algorithm with SVM

2.3.1. Hybrid GA-PSO Algorithm

PSO, a population-based method, is desirable for regarding each individual in a population as a particle in the search space [29]. Supposing the D-dimensional location of the i-th particle at iteration time t is represented as L i t = l i 1 t , l i 2 t , , l i D t , its velocity is V i t = v i 1 t , v i 2 t , , v i D t , the optimal location found so far (i.e., the personality best position, p b e s t ) is L p i t = l p i 1 t , l p i 2 t , , l p i D t until iteration t, the optimal location found by the swarm so far (i.e., the global best position, g b e s t ) is L g i t = l g i 1 t , l g i 2 t , , l g i D t , and then, this particle is updated as follows:
v i j t + 1 = w v i j t + c 1 r 3 ( l p i j t l i j t ) + c 2 r 4 ( l g i j t l i j t )
and
l i j t + 1 = l i j t + v i j t + 1 ,
where w is an inertia weight parameter of the particle and is set as 1, c 1 and c 2 indicates the cognition and social learning factor, and  r 3 and r 4 are random numbers between [0, 1], respectively.
GA [30], an effective optimization algorithm, is desirable to solve various problems in engineering applications. Also, it simulates the process of population evolution and performs a series of genetic operations, such as selection, crossover, and mutation on the current population, to generate a new generation and gradually progress the population to a state close to the optimal solution. Therefore, in this paper, both crossover and mutation in GA are incorporated into PSO to increase the diversity of populations.
Assuming that two individuals z t i , z t j ( i j ) crossover arithmetically at time  t, the two new individuals are generated at time t + 1 , i.e.,
z t + 1 i = α z t j + ( 1 α ) z t i
and
z t + 1 j = α z t i + ( 1 α ) z t j ,
if α is constant, the crossover operation becomes uniform arithmetic crossover; otherwise, it is non-uniform arithmetic crossover.
The mutation operation has two advantages: it can give GA the ability of local random search and maintain population diversity to prevent premature convergence. For gene operations in the GA, mutation is partially incorporated into PSO to increase the population diversity. In this paper, the position l i D of the i-th particle in the D-dimensional space in the PSO is replaced by individual z t i , and the historical optimal individual z max i is leveraged to replace the individual optimal l p i j t in PSO. Similarly, the historical optimal species group z max j is leveraged to replace the global optimal l g i j t , and cumulative difference Δ z max , t i of z max i is used to replace v i j t + 1 as follows:
Δ z max , t i = Δ z max , t 1 i + ( Δ z max , t i Δ z max , t 1 i ) t .
Substituting (27) into (23) and (24), respectively, the velocity and position update of the mutation are obtained as,
Δ z max , t + 1 i = Δ z max , t i + c 1 r 3 ( z max i l i j t ) + c 2 r 4 ( z max j l i j t )
and
l i j t + 1 = l i j t + Δ z max , t + 1 i .
To summarize, the hybrid GA-PSO approach can be described in Algorithm 1.
Algorithm 1 Pseudo-code of GA-PSO.
1:
Initialize particle swarm size M, cognition and social learning factor c 1 and c 2 [ 0 , 4 ] , random values r 3 and r 4 [ 0 , 1 ] , maximum iterations T, search dimension N, particle velocity V, particle position P, convergence accuracy C.
2:
Conduct selection, crossover and mutation operations for search particle by Formulas (26)–(29).
3:
Calculate the fitness of each particle. The fitness and its position of the optimal search particle are determined by ranking the fitness.
4:
while  t T  do
5:
    for each search particle do
6:
          Update l p i j t and l g i j t
7:
          if  l p i j t p b e s t and l g i j t g b e s t  then
8:
             update the velocity and position of search particle by (22) and (23)
9:
          end if
10:
    end for
11:
    Conduct selection, crossover and mutation operations for the search particle according to Formulas (26)–(29).
12:
    Calculate the fitness of each search particle. The fitness and its location of the optimal search particle are determined by ranking the fitness.
13:
     t = t + 1
14:
end while
15:
Return the velocity and position of the optimal search particle.

2.3.2. Improved GA-PSO-SVM Algorithm

Admittedly, options abound for the sEMG classification, e.g., LDA, neural network, and SVM. In particular, SVM, is an effective recognition method in lower limb sEMG, but, whose performance would be significantly influenced by the kernel function parameter g and penalty factor p [31]. Hence, the parameters of SVM should be appropriately set to satisfy a high modeling capability under various identification situations.
The PSO algorithm, as a heuristic algorithm, is a good candidate to optimize and select the model parameters in SVM. However, the PSO is easily trapped in local optimal solutions [29]. The GA algorithm draws on the experience of natural selection and Mendelian laws of heredity to run computational processes with unique chromosome coding and decoding operations. Nevertheless, the coding and decoding process increases the calculation complexity [30]. Also, GA could evaluate multiple solutions in the search space to reduce the risk of falling into a locally optimal solution. Leveraging both GA and PSO, we establish a hybrid algorithm combining both GA and PSO to optimize the SVM model. More specifically, both high convergence efficiency and the ability to avoid falling into local optimal solutions are mainly associated with PSO and GA [32], respectively.
We aim to optimize the SVM by leveraging a hybrid GA-PSO and applying it to seek the best parameters. In particular, the radial basis function is adopted as a kernel function. Figure 2 describes the chart of the GA-PSO-SVM algorithm for lower limb movement classification, as follows: (i) The parameters p and g are initialized and search particle s i j = ( p i , g i ) is set; (ii) SVM classification error rate is defined as the fitness function so that s i j in PSO contains the model parameters to be optimized in SVM; (iii) A hybrid GA-PSO algorithm is utilized to update the individual positions iteratively, and meanwhile, the optimal model parameters ( p d , g d ) that correspond to the minimum fitness are generated during the optimization process; (iv) GA-PSO-SVM classifier model is constructed to optimize parameters and output the movement classification results.

3. Experimental Protocol and Results Discussion

3.1. Experimental Protocol

A publicly available dataset is discussed in this study, which can be found in the UCI machine learning repository [33]. This dataset was acquired from 22 male participants older than 18 years of age. Also, this dataset contains signals from eleven subjects with knee normality and abnormality, previously diagnosed by a professional. The sEMG is recorded by the acquisition equipment (MWX8, USA) with a sampling frequency of 1000 Hz, and the real-time data are transmitted through a Bluetooth adapter. Biceps femoris (BF), rectus femoris (RF), semitendinosus (ST), and vastus medialis (VM) are the four relevant muscles to the knee joint flexion and extension movement. In particular, RF and BF are utilized for the extension of the knee joint and flexion of the hip joint, respectively; ST is used for the extension and abduction of the hip joint and flexion of the knee joint; and VM is leveraged for the abduction of the hip joint [34]. Also, each subject performs three different lower limb motions (i.e., walking, standing, and sitting).

3.2. Results Analysis and Discussion

3.2.1. Signal Preprocessing

The sEMG is highly sensitive to noises and susceptible to external interference, so preprocessing is required. Since subjects with knee abnormality have slow response, there will be deviations at the beginning of each movement collection. Thus, to avoid this kind of biased data, the 200 ms of front and back segments of each motion data are discarded. In particular, the effective frequency band of the sEMG signal lies between 10 and 400 Hz, and mainly occurs between 10 and 150 Hz [35]. Hence, a fourth order band-pass Butterworth filter with a cut-off frequency of 50 Hz is utilized to effectively reduce the influence of baseline drift and artifact noises. The amplitude of the sEMG signals of four BF muscles corresponding to walking movement with healthy individuals and subjects having knee pathology before and after preprocessing are presented in Figure 3. Results show that the sEMG signal is filtered by both 10–150 Hz band-pass filter and 50 Hz notch filter, to remove high-frequency noises and other artefacts. After filtering, the baseline drift is effectively removed.

3.2.2. Selection of Muscles

As can be seen from Figure 4, the contribution level of muscle obtained by the same muscle during various movements and subjects are quite different. Thus, it is necessary to select the muscle with the highest correlation with a specific motion [16]. Nevertheless, how to determine the best muscle for healthy and pathology subjects when performing different lower limb movements is challenging. The four muscles, i.e., RF, BF, VM, and ST, are selected as previously mentioned in Section 3.1. We will derive the contribution level of the selected muscles through muscle synergy. In more detail, the weight coefficient of each muscle is calculated by the NMF method, by analyzing the muscle synergy and obtaining contribution level of all muscles. Muscle synergy of four muscles involved in the three limb movements are presented in Figure 4.
Table 1 reveals the muscle contribution proportions compared to 1 of all subjects about four muscles when performing various three lower limb movements, respectively. From Table 1, we know that the muscle contribution levels of various movements for an individual and various subjects with the same movement are different. For instance, VM and RF own the largest proportion in walking and standing movements while BF accounts for the largest in sitting, respectively. In addition, for healthy subjects, the contribution of VM in walking of Subject 1 is the highest while that of Subject 2 is the lowest. Also, for pathology subjects, the contribution of RF in standing of Subject 4 is the highest while that of Subject 6 is the lowest. This means that the proportion varies significantly between participants. Thus, the muscle selection must be made prior to motion classification. Therefore, VM, RF, and BF are selected here as the muscles for limb recognition during walking, standing, and sitting movements, respectively.

3.2.3. Feature Selection Results

Six nonlinear features (i.e., ApEn, SampEn, FuzzyEn, LZC, Lyapunov, and CD) are extracted from sEMG in two types of subjects (i.e., healthy and pathology subjects) during various lower limb movements. All feature combinations were successively input into the GA-PSO-SVM classification model to recognize lower limb movements. Simultaneously, we leveraged accuracy to evaluate the proposed approach’s performance, as follows, A c c u r a c y = T P + T N / T P + T N + F P + F N , where, T P and F P are true and false positive, T N and F N are true and false negative, respectively.
From Table 2, for healthy subjects, the recognition accuracy based on NF 1 , NF 2 , NF 4 , and NF 5 is relatively similar, reaching 91.23%, 92.01%, 92.54%, and 90.02%, respectively, while the accuracy of selection feature NF 3 can reach 97.42%. In addition, for pathology subjects, the recognition accuracy of selection feature AF 2 (95.38%) is the highest. In total, whether healthy or pathology subjects, with the increase of the dimension of multi-features combination, the recognition accuracy increases. Nevertheless, if all features are directly input into the classification model, it will not only increase the complexity and time of the training model, but also reduce the recognition accuracy of the classifier. In addition, motivated by [21], due to the similarity between the features, there is a situation in which the accuracy decreases with the increase of dimension of multi-feature combination. Hence, it is necessary to discriminate and analyze the FS value of extracted features.
It is challenging to distinguish the muscle movement status with all features. Since muscle movement is a gradual process, the change in features before and after muscle movement fatigue is insignificant. Hence, the Fisher discriminant analysis method is utilized to evaluate the score of each feature and find the optimal feature components. Figure 5 demonstrates the average FS value of six features during three lower limb movements, respectively.
From Figure 5, the FS index of each feature finds the difference between either healthy or pathology subjects. That is, according to the FS index, the optimal feature components can be obtained. For a healthy subject, the FS of each feature is ApEn, LZC, SampEn, FuzzyEn, CD, and Lyapunov, in turn. Therefore, we will increase the number of features in the feature combination in the decreasing order of FS index from large to small, that is, NF 1 = LZC , FE , NF 2 = LZC , FE , SE , NF 3 = LZC , FE , SE , AE , NF 4 = LZC , FE , SE , AE , Ly , and NF 5 = LZC , FE , SE , AE , Ly , CD . Likewise, for pathology subject, the feature combinations are expressed as AF 1 = AE , LZC , AF 2 = AE , LZC , SE , AF 3 = AE , LZC , SE , FE , AF 4 = AE , LZC , SE , FE , CD , and AF 5 = AE , LZC , SE , FE , CD , Ly , successively. In this paper, the average FS value of the six features is the basis (that is, 0.46 for healthy subject and 0.43 for pathology subject), respectively, the features with FS values higher than average are selected. Consequently, for healthy subject, the optimal feature components are NF 1 , NF 2 , and NF 3 , and AF 1 and AF 2 are the optimal feature components of pathology subjects. Thus, NF 3 and AF 2 are the optimal feature components for healthy and pathology subjects, respectively.

3.3. Experimental Comparison Analysis

3.3.1. Time-Frequency and Nonlinear Feature

To verify the performance of the extracted nonlinear features, we compare them to the time domain and frequency domain features, respectively. Also, the three time-domain features, including RMS, IEMG, and ZC, are extracted, and the frequency domain analysis indicators include MPF and MF. Similarly, these extracted features are also selected.
Figure 6 shows the classification results of four types of movements with multi-domain features (e.g., time domain, frequency domain, selected time–frequency domain, and selected nonlinear domain). In particular, the average recognition accuracy is leveraged to measure the performance of various features and is expressed by A c c u r a c y 1 + A c c u r a c y 2   + + A c c u r a c y n / n ; n is the number of features. Also, the window size is 300 ms. From Figure 6, the average recognition accuracy based on time domain features, frequency domain features, and selected time–frequency domain features is 88.53%, 73.40%, and 78.67%, respectively, while the average accuracy of the selected nonlinear features can reach 97.40%, for healthy subjects. In terms of the pathology subjects, the average recognition accuracy of extracted nonlinear features (94.10%) is higher than that of the time domain (83.36%), frequency domain (72.67%), and selected time–frequency domain (67.67%), respectively. The results show that the classification accuracy of the selected features in the time–frequency domain is the lowest, and also, the nonlinear features are also higher than that of the time and frequency domain features. The extracted nonlinear features can better reflect the natural attributes of sEMG, rather than random direct extraction of feature parameters.

3.3.2. Different Classifier Algorithms

In addition, to verify the classification performance of the proposed GA-PSO-SVM approach, we compare it with the SVM with gray wolf optimization (GWO-SVM), WOA-SVM, GA-SVM, and PSO-SVM through both the recognition accuracy and time computational. In particular, to avoid possible errors caused by the results of one experiment, each classification model is trained four times. From Table 3, the proposed GA-PSO-SVM method possesses the highest classification accuracy for three lower limb movements, as compared to other optimized SVM classification models. Average recognition accuracy based on WOA-SVM and GA-SVM is relatively similar, reaching 85.33% and 87.16%, respectively, while the accuracy of the proposed method can reach 95.76%. In particular, the average accuracy of GWO-SVM and PSO-SVM is 81.79% and 92.00%, respectively. In terms of the training time of the classification model, the averaged training time of the proposed approach is 16.63 s, which is significantly shorter than other classification models. Experiment results show that the proposed approach could not only improve the recognition accuracy, but also shorten the training time.

4. Conclusions

In this paper, a lower limb motion recognition model is constructed by combining the musculoskeletal model and the fused nonlinear chaotic features of sEMG signals. According to the skeletal and muscle motion mechanism during human movements, the musculoskeletal model of lower limb movements is built. In general, sEMG is considered a kind of nonlinear and non-stationary signal with chaotic components. The six nonlinear chaotic features are extracted, and fisher discriminant analysis is utilized for feature fusion. Compared with single features, it has a stronger characterization ability and achieves better results in training and testing models. To solve the problem that SVM is very sensitive to parameter setting, which leads to lower recognition accuracy, a recognition model based on the hybrid GA-PSO algorithm is proposed to optimize the parameters of SVM. The effectiveness of the proposed approach is validated by trials on eleven healthy subjects and eleven knee abnormal subjects, and results strongly support the superior performance of the proposed approach.
With the popularity of sEMG wearable sensing equipment, the lower limb motion recognition has attracted much attention owing to it helping improve human–machine interaction performance in exoskeleton rehabilitation. However, this paper mainly focuses on three lower limb motions. Hence, future works will include researching the practicability of the proposed approach of multi-channel sEMG with complex movements (i.e., crossing obstacles or going up stairs), to enhance the practicability of the proposed approach. Moreover, the reviewer’s valuable suggestions have motivated us to extend the proposed approach to the exoskeleton rehabilitation training model.

Author Contributions

P.T.: conceptualization, methodology, writing—original draft preparation, writing-review and editing. J.L.: conceptualization, writing—review and editing. H.W.: supervision. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Natural Science Foundation of China (No.61971347).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Acknowledgments

The authors are grateful for the anonymous reviewers who have made constructive comments.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Zhong, B.; Guo, K.; Yu, H.Y.; Zhang, M.M. Toward gait symmetry enhancement via a cable-driven exoskeleton powered by series elastic actuators. IEEE Robot. Autom. Lett. 2022, 7, 786–793. [Google Scholar] [CrossRef]
  2. Yan, Y.; Chen, Z.L.; Huang, C.; Chen, L.; Guo, Q. Human-exoskeleton coupling dynamics in the swing of lower limb. Appl. Math. Model. 2022, 4, 439–454. [Google Scholar] [CrossRef]
  3. Chen, Z.L.; Guo, Q.; Li, T.S.; Yan, Y. Output constrained control of lower limb exoskeleton based on knee motion probabilistic model with finite-time extended state observer. IEEE-Asme Trans. Mechatron. 2023, 28, 2305–2316. [Google Scholar] [CrossRef]
  4. Huang, Y.J.; Chang, C.S.; Wu, Y.C.; Han, C.C.; Cheng, Y.Y.; Chen, H.M. Development of wearable devices for collecting digital rehabilitation/fitness data from lower limbs. Sensors 2024, 24, 1935. [Google Scholar] [CrossRef]
  5. Guo, B.J.; Li, Z.Z.; Huang, M.X.; Li, X.P.; Han, J.H. Patient’s Healthy-Limb Motion Characteristic-Based Assist-As-Needed Control Strategy for Upper-Limb Rehabilitation Robots. Sensors 2024, 24, 2082. [Google Scholar] [CrossRef]
  6. Emilia, A.M.P.; María, F.T.G.; Andrés, R.A. Recognizing lower limb pathology thought an sEMG classification model. In Proceedings of the IEEE Ecuador Technical Chapters Meeting, Cuenca, Ecuador, 12–15 October 2021. [Google Scholar]
  7. Ai, Q.S.; Zhang, Y.A.; Qi, W.L.; Liu, Q.; Chen, K. Research on lower limb motion recognition based on fusion of sEMG and accelerometer signals. Symmetry 2017, 9, 147. [Google Scholar] [CrossRef]
  8. Espinosa, R.A.; Calderón, R. Choice of tau in the estimation of ApEn and SampEn entropy of EMG, ECG and EEG signals. In Proceedings of the Symposium on Image, Signal Processing and Artificial Vision, Bucaramanga, Colombia, 24–26 April 2019. [Google Scholar]
  9. Bai, Y.; Liang, Z.H.; Li, X.L. A permutation Lempel-Ziv complexity measure for EEG analysis. Biomed. Signal Process. Control 2015, 19, 102–114. [Google Scholar] [CrossRef]
  10. Guo, Y.N.; Naik, G.R.; Huang, S.H.; Abraham, A.; Nguyen, H.T. Nonlinear multiscale maximal Lyapunov exponent for accurate myoelectric signal class tion. Appl. Soft Comput. 2015, 36, 633–640. [Google Scholar] [CrossRef]
  11. Zhang, P.; Zhang, J.X.; Elsabbagh, A. Lower limb motion intention recognition based on sEMG fusion features. IEEE Sens. J. 2022, 22, 7005–7014. [Google Scholar] [CrossRef]
  12. Zhang, J.H.; Guo, J.D.; Wang, H.; Li, K.X.; Zhao, Y. Research on Lower limb Movement Pattern Recognition Method Based on ReliefF-KPCASVM. In Proceedings of the 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO), Sanya, China, 27–31 December 2021. [Google Scholar]
  13. Sui, X.W.; Wan, K.X.; Zhang, Y. Pattern recognition of sEMG based on wavelet packet transform and improved SVM. Int. J. Light Electron Opt. 2019, 176, 228–235. [Google Scholar] [CrossRef]
  14. Zeng, D.Z.; Qu, C.X.; Ma, T. Research on a gait detection system and recognition algorithm for lower limb exoskeleton robot. J. Braz. Soc. Mech. Sci. Eng. 2021, 43, 298. [Google Scholar] [CrossRef]
  15. Chaabane, S.B.; Kharbech, S.; Belazi, A. Improved Whale optimization Algorithm for SVM Model Selection: Application in Medical Diagnosis. In Proceedings of the International Conference on Software, Telecommunications and Computer Networks (SoftCOM), Split, Croatia, 17–19 September 2020. [Google Scholar]
  16. Liu, Q.; Liu, Y.; Zhang, C.S.; Ruan, Z.L.; Meng, W.; Cai, L.L.; Ai, Q.S. sEMG-based dynamic muscle fatigue classification using SVM with improved whale optimization algorithm. IEEE Internet Things J. 2021, 8, 16835–16844. [Google Scholar] [CrossRef]
  17. Cao, L.; Zhang, W.Y.; Kan, X.; Yao, W. A Novel Adaptive Mutation PSO Optimized SVM Algorithm for sEMG-Based Gesture Recognition. Sci. Program. 2021, 2021, 9988823. [Google Scholar] [CrossRef]
  18. Murley, G.S.; Menz, H.B.; Landorf, K.B.; Bird, A.R. Reliability of lower limb electromyography during overground walking: A comparison of maximal- and sub-maximal normalisation techniques. J. Biomech. 2010, 43, 749–756. [Google Scholar] [CrossRef]
  19. Gharehbaghi, S.; Jeong, H.K.; Safaei, M.; Inan, O.T. A feasibility study on tribological origins of knee acoustic emissions. IEEE Trans. Biomed. Eng. 2022, 69, 1685–1695. [Google Scholar] [CrossRef]
  20. Zhong, W.J.; Fu, X.M.; Zhang, M.M. A Muscle Synergy-Driven ANFIS Approach to Predict Continuous Knee Joint Movement. IEEE Trans. Fuzzy Syst. 2022, 30, 1553–1563. [Google Scholar] [CrossRef]
  21. Tu, P.J.; Li, J.H.; Wang, H.J.; Cao, T.; Wang, K. Non-linear chaotic features-based human activity recognition. Electronics 2021, 10, 111. [Google Scholar] [CrossRef]
  22. Pincus, S.M. Approximate entropy as a measure of system complexity. Proc. Natl. Acad. Sci. USA 1991, 88, 2297–2301. [Google Scholar] [CrossRef]
  23. Wang, S.R.; Tang, H.; Wang, B.; Mo, J. Analysis of fatigue in the biceps brachii by using rapid refined composite multiscale sample entropy. Biomed. Signal Process. Control 2021, 67. [Google Scholar] [CrossRef]
  24. Zadeh, L.A. Fuzzy sets. Inf. Control 1965, 8, 338–353. [Google Scholar] [CrossRef]
  25. Costa, M.; Goldberger, A.L.; Peng, C.K. Multiscale entropy analysis of biological signals. Phys. Rev. E 2005, 71. [Google Scholar] [CrossRef] [PubMed]
  26. Ying, X.M.; Li, Y.X.; Li, X.C.; Bin, Y. EMG signal processing and application based on empirical mode decomposition. Math. Comput. Sci. 2019, 4, 99–103. [Google Scholar]
  27. Wolf, A.; Swift, B.; Swinney, L.; Vastano, A. Determining Lyapunov exponents form a time series. Phys. D Nonlinear Phenom. 1985, 16, 285–317. [Google Scholar] [CrossRef]
  28. Moulin, C.; Largeron, C.; Ducottet, C.; Géry, M.; Barat, C. Fisher linear discriminant analysis for text-image combination in multimedia information retrieval. Pattern Recognit. 2014, 47, 260–269. [Google Scholar] [CrossRef]
  29. James, K.; Russell, E. Particle swarm optimization. In Proceedings of the IEEE International Conference on Neural Networks, Perth, WA, Australia, 27 November–1 December 1995. [Google Scholar]
  30. Shi, L.L.; Gong, J.H.; Zhai, C.J. Application of a hybrid PSO-GA optimization algorithm in determining pyrolysis kinetics of biomass. Fuel 2022, 323, 1–11. [Google Scholar] [CrossRef]
  31. Zhou, Z.Y.; Zhang, R.X.; Wang, Y.M.; Zhu, Z.F.; Zhang, J.X. Color difference classification based on optimization support vector machine of improved grey wolf algorithm. Int. J. Light Electron Opt. 2018, 170, 17–29. [Google Scholar] [CrossRef]
  32. Ghamisi, P.; Benediktsson, J.A. Feature selection based on hybridization of genetic algorithm and particle swarm optimization. IEEE Geosci. Remote Sens. Lett. 2015, 12, 309–313. [Google Scholar] [CrossRef]
  33. Sanchez, O.; Sotelo, J. EMG Dataset in Lower Limb, UCI Machine Learning Repository. 2021. Available online: http://archive.ics.uci.edu/ml/datasets/emg+dataset+in+lower+limb (accessed on 30 April 2024).
  34. Qin, P.J.; Shi, X. A novel method for lower limb joint angle estimation based on sEMG signal. IEEE Trans. Instrum. Meas. 2021, 70. [Google Scholar] [CrossRef]
  35. Tu, P.J.; Li, J.H.; Wang, H.J.; Li, Y.X.; Xiang, W. A Novel Lower-Limb Coordination Assessment Scheme Using Multi-Scale Nonlinear Coupling Characteristics with sEMG. IEEE Trans. Instrum. Meas. 2023, 72, 1–12. [Google Scholar] [CrossRef]
Figure 1. The proposed approach framework. (a) Musculoskeletal model of lower limb. (b) Lower limb movement recognition model.
Figure 1. The proposed approach framework. (a) Musculoskeletal model of lower limb. (b) Lower limb movement recognition model.
Sensors 24 03097 g001
Figure 2. Flow chart of genetic algorithm–particle swarm optimization–support vector machine (GA-PSO-SVM) algorithm for lower limb motion classification.
Figure 2. Flow chart of genetic algorithm–particle swarm optimization–support vector machine (GA-PSO-SVM) algorithm for lower limb motion classification.
Sensors 24 03097 g002
Figure 3. sEMG preprocessing from biceps femoris (BF) muscle during walking movement. (a) Raw sEMG spectrum; (b) sEMG spectrum from 10 to 150Hz; (c) spectrum removing 50 Hz frequency component.
Figure 3. sEMG preprocessing from biceps femoris (BF) muscle during walking movement. (a) Raw sEMG spectrum; (b) sEMG spectrum from 10 to 150Hz; (c) spectrum removing 50 Hz frequency component.
Sensors 24 03097 g003
Figure 4. Muscle synergy of various motions (blue and red represent healthy subjects and pathology subjects, respectively).
Figure 4. Muscle synergy of various motions (blue and red represent healthy subjects and pathology subjects, respectively).
Sensors 24 03097 g004
Figure 5. Separability values for six nonlinear features.
Figure 5. Separability values for six nonlinear features.
Sensors 24 03097 g005
Figure 6. Recognition results of healthy and pathological subjects during three lower limb movements using different features. (a) Healthy subjects. (b) Pathology subjects.
Figure 6. Recognition results of healthy and pathological subjects during three lower limb movements using different features. (a) Healthy subjects. (b) Pathology subjects.
Sensors 24 03097 g006
Table 1. Muscle contributing level about four muscles.
Table 1. Muscle contributing level about four muscles.
MotionsMusclesHealthy SubjectsPathology Subjects
Sub.1 Sub.2 Sub.3 Sub.4 Sub.5 Sub.6
WalkingRF0.25040.13680.21770.03470.12130.1124
BF0.26070.18120.23140.12830.14510.1722
VM0.90190.82010.83260.90810.87370.8102
ST0.22230.17400.14390.12090.93830.1961
StandingRF0.92250.82190.84520.93050.90510.7086
BF0.14800.15000.13940.09410.09310.1871
VM0.09390.12400.18430.17130.08750.1315
ST0.22290.15210.15680.09740.15270.1852
SittingRF0.11680.12540.23410.15310.09280.1697
BF0.84810.75260.72460.94410.91500.8875
VM0.09090.18050.18410.18950.18800.1829
ST0.18490.18600.18760.18760.19500.1826
Table 2. The recognition accuracy of feature selection (%).
Table 2. The recognition accuracy of feature selection (%).
TypesWalkingStandingSittingAverage
HS N F 1 88.9993.3891.3091.23
N F 2 94.3891.0990.5792.01
N F 3 97.0898.0597.1497.42
N F 4 91.1094.4292.0992.54
N F 5 90.7587.7991.5390.02
PS A F 1 86.5383.9984.9585.16
A F 2 95.1395.7895.2595.38
A F 3 92.4392.2090.8891.79
A F 4 90.9291.4990.0190.84
A F 5 87.9386.8087.2587.32
Table 3. Comparison of healthy and pathology subjects with different algorithms (%).
Table 3. Comparison of healthy and pathology subjects with different algorithms (%).
GWO-SVMWOA-SVMPSO-SVMGA-SVMOurs
WalkingHS88.1790.0992.3790.7397.08
PS76.7986.2688.9987.8693.10
StandingHS83.5083.7992.7582.3797.14
PS80.4984.6491.1089.7894.00
SittingHS83.3485.4694.3890.7898.05
PS78.4581.6992.4391.4395.20
Average81.7985.3392.0087.1695.76
Training time(s)17.6316.9616.851 6.7516.63
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Tu, P.; Li, J.; Wang, H. Lower Limb Motion Recognition with Improved SVM Based on Surface Electromyography. Sensors 2024, 24, 3097. https://doi.org/10.3390/s24103097

AMA Style

Tu P, Li J, Wang H. Lower Limb Motion Recognition with Improved SVM Based on Surface Electromyography. Sensors. 2024; 24(10):3097. https://doi.org/10.3390/s24103097

Chicago/Turabian Style

Tu, Pengjia, Junhuai Li, and Huaijun Wang. 2024. "Lower Limb Motion Recognition with Improved SVM Based on Surface Electromyography" Sensors 24, no. 10: 3097. https://doi.org/10.3390/s24103097

APA Style

Tu, P., Li, J., & Wang, H. (2024). Lower Limb Motion Recognition with Improved SVM Based on Surface Electromyography. Sensors, 24(10), 3097. https://doi.org/10.3390/s24103097

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop