Open AccessArticle

A Method for Measuring the Height of Hand Movements Based on a Planar Array of Electrostatic Induction Electrodes

Linyi Zhang

Xi Chen

^*,

Pengfei Li

Chuang Wang

and

Mengxuan Li

State Key Laboratory of Mechatronics Engineering and Control, Beijing Institute of Technology, Beijing 100081, China

Author to whom correspondence should be addressed.

Sensors 2020, 20(10), 2943; https://doi.org/10.3390/s20102943

Submission received: 4 April 2020 / Revised: 19 May 2020 / Accepted: 19 May 2020 / Published: 22 May 2020

(This article belongs to the Special Issue Human-Machine Interaction and Sensors)

Download

Browse Figures

Versions Notes

Abstract

This paper proposes a method based on a planar array of electrostatic induction electrodes, which uses human body electrostatics to measure the height of hand movements. The human body is electrostatically charged for a variety of reasons. In the process of a hand movement, the change of a human body’s electric field is captured through the electrostatic sensors connected to the electrode array. A measurement algorithm for the height of hand movements is used to measure the height of hand movements after the direction of it has been obtained. Compared with the tridimensional array, the planar array has the advantages of less space and easy deployment; therefore, it is more widely used. In this paper, a human hand movement sensing system based on human body electrostatics was established to perform verification experiments. The results show that this method can measure the height of hand movements with good accuracy to meet the requirements of non-contact human-computer interactions.

Keywords:

the height of hand movements; non-contact HCI; electrostatics field

1. Introduction

The progress of computer and network technology and the continuous expansion of its application fields have promoted the continuous evolution of human-computer interactions. Determining how to interact with various smart devices conveniently and effectively is one of the hot topics of research today. As a new generation of human-computer interaction, the natural user interface (NUI) [1] is gradually replacing the command-line and graphical user interfaces represented by the keyboard and the mouse [2,3].

The NUI does not require users to learn pre-designed operations but interacts with computers through voice, hand movements, facial expressions, or body gestures. Compared with voice, hand movement-based interaction has the advantage of being cross-cultural, and is not easily affected by background noise [4]; compared with facial expressions and body gestures, hand movement-based interaction is more comfortable, and users do not become fatigued after long-term use [5]. At present, hand movement-based interaction systems are generally divided into two types, namely, non-wearable device-based interaction methods and wearable device-based interaction methods [6]. Vision-based interaction [7] is a typical non-wearable device-based interaction, which can realize non-contact human-computer interactions, but its algorithm is complex and it is easily affected by ambient light, background, clothing, and so on [8]. In addition, this interaction relies on the exposed camera to obtain the user’s gesture information, which not only destroys the design sense of the devices but also causes privacy issues for the user [9]. Wearable device-based methods have high detection accuracy [10], but these methods require users to wear devices. For example, wearable electromyography (EMG)-based interaction requires electrodes to be stuck onto the forearm or wrist, which is not suitable in some scenarios [11,12]. Therefore, a new type of human-computer interaction method with good user experience and avoiding privacy problems will be of practical significance.

In recent years, due to the development of human body electrostatic detection technology [13,14], research on human-computer interactions based on human body static electricity has gradually risen [15,16] and has attracted widespread attention. The human body is electrostatically charged in certain environments and for various reasons. When the hand moves, the electrostatic charge of the hand disturbs the electric field of the space. Electrostatic induction on the electrode caused by the disturbance can be sensed by electrostatic sensors so that the parameters of a hand movement can be obtained to realize human-computer interactions. This detection method has the advantages of non-contact, good privacy, simple algorithm, and low power consumption [17]. In 2007, Professor Takiguchi of Japan proposed to use electrodes to detect electrostatic signals generated by human walking, which has the characteristics of a low false alarm rate, small dead area, and simple system design and deployment compared to other human detection technologies [18,19]. Kai Tang used a tridimensional array of electrodes to measure the direction [20] and speed of hand movements and proposed a real-time hand position sensing technology based on human body electrostatics for human-computer interactions [21]. Both of these methods need a tridimensional array of electrodes, which cannot adapt to scenarios where the placement or operating space is narrow, but the height of a hand movement is needed.

Kurita proposed a non-contact electrostatics detection method to detect human foot movements and applied it to throwing movement analysis [22,23,24]. A planar array of four detection electrodes was used to classify hand movements in eight directions of the plane [16]. In some interaction scenarios, direction information alone is not enough to support the amount of information needed for interaction.

In this paper, a method for measuring the height of hand movements based on a planar array of electrostatic induction electrodes is proposed. This method uses the measurement algorithm for the height of hand movements based on human body electrostatics to calculate the distance between the trajectory of the hand movement and the electrode array. The method can be applied to non-contact human-computer interactions. A planar array of electrostatic induction electrodes was used to obtain not only the direction but also the height of hand movements, which can meet the requirements of human-computer interactions under various space conditions.

2. Methods

The human body has a certain charge due to friction and contact with other objects [25], which is called the human body electrostatics. As the tip of the charged human body, the hand changes the distribution of the electric field in space when it moves, which leads to the flow of the induced charge on the electrode, that is, the induced current [16].

The previous method only focused on the zero-crossing point and the maximum point of the induced current signal without discussing the moment when the maximum point would appear. As a result, only the direction of the hand movement on the two-dimensional plane can be obtained. In this paper, it is proposed to calculate the occurrence time of maximum points, zero-crossing points, and the change rate’s maximum points of the induced signals on multiple electrodes transmitted to the upper computer. On the basis of judging the direction of a hand movement, the upper computer measures the height of the hand movement and then recognizes the interactive intention expressed by the hand trajectory to realize a non-contact human-computer interaction. The schematic diagram of the interaction is shown in Figure 1.

When the hand moves linearly in different directions in front of the array, the time when the zero-crossing points of the induced current are generated on the electrodes at different positions is different. By processing the signals on each electrode, the hand movement in eight directions can be classified, which is presented in Reference [16]. The following sections will introduce, in detail, the measurement algorithm for the height of hand movements based on human body electrostatics.

2.1. Regularity of the Occurrence of the Maximum Value of the Induced Current, the Zero-Crossing of the Induced Current, and the Maximum Value of the Change Rate of the Induced Current

When the hand moves linearly near the spherical electrode, an induced current is generated on it. Suppose that the hand charge quantity is Q, the distance between the trajectory of the hand movement and electrode is z₀, and the velocity of the hand is v for a very short time when the hand moves near the electrode.

The left-hand coordinate system is established with the ball center as the origin. For the convenience of calculation, let the trajectory of the hand movement be in the XOZ plane and parallel to the x-axis, as shown in Figure 2. Take the time when the hand is on the z-axis as time zero, and the angle between the x-axis and the line passing through the hand and the origin is α.

The induced current signal of the spherical electrode can be expressed as:

i = \frac{Q R_{0}}{r^{2}} \frac{d r}{d t} = Q R_{0} \cdot \frac{v^{2} t}{{[{(v t)}^{2} + z_{0}^{2}]}^{\frac{3}{2}}}

(1)

where R₀ is the radius of the spherical electrode, and r is the distance from the trajectory of the hand to the center of the spherical electrode.

In addition, the α can be calculated as:

\cos α = \sqrt{\frac{v^{2} t^{2}}{[z_{0}^{2} + {(- v t)}^{2}]}} .

(2)

Take in the parameters (set v = 2 m/s, z₀ = 0.3 m, Q = −10⁻⁹ C, R₀ = 0.004 m) to simulate the current i, and the current waveform is shown in Figure 3.

The waveform of the induced current i in the figure has two extreme points and one zero-crossing point. In order to calculate the position relationship between the hand and the electrode when the extreme points occur, differentiate the induced current i to t to obtain the change rate of the induced current as follows:

i' = Q R_{0} \cdot \frac{v^{2}}{{[{(v t)}^{2} + z_{0}^{2}]}^{\frac{3}{2}}} - Q R_{0} \cdot \frac{3 v^{4} t^{2}}{{[{(v t)}^{2} + z_{0}^{2}]}^{\frac{5}{2}}} .

(3)

The simulated waveform of the change rate of the induced current

i^{'}

is shown in Figure 4.

When the maximum value of the induced current i occurs, the change rate of the induced current is equal to zero, that is:

i' = Q R_{0} \cdot \frac{v^{2}}{{[{(v t)}^{2} + z_{0}^{2}]}^{\frac{3}{2}}} - Q R_{0} \cdot \frac{3 v^{4} t^{2}}{{[{(v t)}^{2} + z_{0}^{2}]}^{\frac{5}{2}}} = 0 .

(4)

So that:

\cos α = \sqrt{\frac{v^{2} t^{2}}{[z_{0}^{2} + {(v t)}^{2}]}} = \frac{\sqrt{3}}{3} .

(5)

That is, when α = 54.7°, the maximum value of the induced current i appears. The waveform of the change rate of the induced current has three extreme points. Similarly, let the second derivative of the induced current i to t be equal to zero.

i^{″} = Q R_{0} \cdot \frac{- 9 v^{4} t}{{[z_{0}^{2} + {(- v t)}^{2}]}^{\frac{5}{2}}} + Q R_{0} \cdot \frac{15 v^{6} t^{3}}{{[z_{0}^{2} + {(- v t)}^{2}]}^{\frac{7}{2}}} = 0 .

(6)

So that:

\cos α = \sqrt{\frac{v^{2} t^{2}}{[z_{0}^{2} + {(- v t)}^{2}]}} = \sqrt{\frac{3}{5}} or t = 0 .

(7)

When

\cos α = \sqrt{\frac{3}{5}}

, that is, α = 39.2°, the first maximum value of the change rate of the induced current

i^{'}

appears. When

t = 0

, the hand is directly above the electrode, α₃ = 90°, the minimum value of the change rate of the induced current

i^{'}

appears, and the zero-crossing of the induced current i appears.

In summary, when α = 39.2°, the first maximum value of the change rate of the induced current

i^{'}

appears; when α = 54.7°, the maximum value of the induced current i appears; and when α = 90°, the zero-crossing of the induced current i appears. For the convenience of the introduction later, let α₁= 39.2°, α₂ = 54.7°, and α₃ = 90°.

2.2. Algorithm for Measuring the Distance between the Trajectory of a Hand Movement and the Straight Line of Two Electrodes

Assume that the trajectory of a hand movement is parallel to the straight line of two electrodes; the distance between them can be calculated based on the values mentioned above. Take the midpoint of the connection of electrodes P₁ and P₂ as the origin, and the line of two electrodes is the x-axis. Set the trajectory of the hand movement in the XOZ plane and establish the coordinate system as shown in Figure 5. Set the electrode spacing as L.

According to the order of the maximum values of the induced current, the maximum values of the change rate of the induced current, and the zero-crossings of the induced current on the two electrodes, we can classify the range of the hand trajectory in the upper half of the XOZ plane, as shown in Figure 6.

In Figure 6, P₁ and P₂ are spherical electrodes placed on the x-axis. Make lines l₁₁ and l₂₁ have an angle of α₁= 39.2° with the x-axis through P₁ and P₂. When the hand moves along the x-axis, the trajectory of the hand intersects with l₁₁ and l₂₁ successively, while the maximum values of the change rate of the induced current on P₁ and P₂ occur successively. Let their occurrence time be T₁₁ and T₂₁. Make lines l₁₂ and l₂₂ have an angle of α₂ = 54.7° with the x-axis through P₁ and P₂. When the hand moves along the x-axis, the trajectory of the hand intersects with l₁₂ and l₂₂ successively, while the maximum values of the induced current on P₁ and P₂ occur successively. Let their occurrence time be T₁₂ and T₂₂. Make lines l₁₃ and l₂₃ have an angle of α₃ = 90° with the x-axis through P₁ and P₂. When the hand moves along the x-axis, the trajectory of the hand intersects with l₁₃ and l₂₃ successively, while the zero-crossings of the induced current on P₁ and P₂ occur successively. Let their occurrence time be T₁₃ and T₂₃. F₁, F₂, and F₃ are the intersections of l₁₃ and l₂₁, l₁₃ and l₂₂, and l₁₂ and l₂₁, respectively. l₁, l₂, and l₃ are straight lines passing through F₁, F₂, and F₃ and parallel to the x-axis. Their distances from the x-axis are D₁, D₂, and D₃, respectively.

In the right-angled triangle F₁P₁P₂ ∠ F₁P₂P₁ = α₁, P₂P₁ = L, so:

\frac{D_{1}}{\tan α_{1}} = L .

(8)

In the right-angled triangle F₂P₁P₂, ∠ F₂P₂P₁ =

α_{2}

, P₂P₁ = L, so:

\frac{D_{2}}{\tan α_{2}} = L .

(9)

In the triangle F₃P₁P₂, make the line segment F₃G perpendicular to the x-axis, ∠F₃P₂P₁ = α₁, ∠F₃P₂P₁ = α₂, P₂P₁ = L, so:

\frac{D_{3}}{\tan α_{1}} - \frac{D_{3}}{\tan α_{2}} = L .

(10)

It can be calculated that:

{\begin{cases} D_{1} = \frac{\sqrt{6}}{3} L \\ D_{2} = \sqrt{2} L \\ D_{3} = (\frac{\sqrt{6} + \sqrt{2})}{2} L \end{cases} .

(11)

l₁, l₂, and l₃ divide the upper part of the x-axis into four areas of different heights. For convenience, they are named “Area 1”, “Area 2”, “Area 3”, and “Area 4”.

When the trajectory of a hand movement is located in different areas above the electrode, the occurrence time of the maximum values of the induced current, the zero-crossings of the induced current, and the maximum values of the change rate of the induced current on the two electrodes are different. Take the trajectory of the hand movement in Areas 3 and 2 as examples. When the hand moves along the x-axis, the trajectory intersects with l₁₁, l₁₂, l₂₁, l₂₂, l₁₃, and l₂₃ successively if it is in Area 3; in this case, T₁₁ < T₁₂ < T₂₁ < T₂₂ < T₁₃ < T₂₃. When the hand moves along the x-axis, the trajectory intersects with l₁₁, l₁₂, l₂₁, l₁₃, l_22, and l₂₃ successively if it is in Area 2. The difference is, in this case, T₁₁ < T₁₂ < T₂₁ < T₁₃ < T₂₂ < T₂₃. By sorting the six moments, the position of the trajectory of a hand movement parallel to the x-axis is divided into four areas. Based on this, the distance d between the trajectory of the hand movement and the x-axis can be calculated by the following method.

Suppose that the hand moves along the x-axis; no matter which area the trajectory is located in, it passes through l₁₃ first, and then l₂₃, after the time difference Δt₀. In the very short time that the hand passes the electrode, the hand movement speed v can be regarded as a fixed value:

v = \frac{L}{Δ t_{0}} .

(12)

Taking the height D₂ as a reference, let the time difference between the hands passing l₁₃ and l₂₂ be Δt₂ (when d < D₂, Δt₂ is positive; when d = D₂, Δt₂ is zero; when d > D₂, Δt₂ is negative), then d can be calculated as:

d = D_{2} - \sqrt{2} v Δ t_{2} .

(13)

Substituting Equation (12) into Equation (13):

d = D_{2} - \sqrt{2} L \frac{Δ t_{2}}{Δ t_{0}} .

(14)

The distance d between the trajectory of a hand movement and the x-axis can be calculated through Equation (14). In practical applications, in order to accurately calculate d, first determine the area in which the hand is located, and calculate d with one or more of D₁, D₂, and D₃ as a reference.

If taking the height D₁ as a reference, let the time difference between the hands passing l₁₃ and l₂₁ be Δt₁ (when d < D₁, Δt₁ is positive; when d = D₁, Δt₁ is zero; when d > D₁, Δt₁ is negative), then d can be calculated as:

d = D_{1} - \frac{\sqrt{6}}{3} v Δ t_{1} = D_{1} - \frac{\sqrt{6}}{3} L \frac{Δ t_{1}}{Δ t_{0}} .

(15)

If taking the height D₃ as a reference, let the time difference between the hands passing l₁₂ and l₂₁ be Δt₃ (when d < D₃, Δt₁ is positive; when d = D₃, Δt₃ is zero; when d > D₃, Δt₃ is negative), then d can be calculated as:

d = D_{3} - \frac{\sqrt{6} + \sqrt{2}}{2} v Δ t_{3} = D_{3} - \frac{\sqrt{6} + \sqrt{2}}{2} L \frac{Δ t_{3}}{Δ t_{0}} .

(16)

In the actual application scenario, we can first determine the area where the hand is, then select the appropriate formula to calculate the value of d. If it is determined that the trajectory of the hand movement is in Area 1, calculate d by Equation (14); if it is determined that the trajectory of the hand movement is in Area 2, calculate d by Equations (14) and (15), respectively, and take their average value as the final result; if it is determined that the trajectory of the hand movement is in Area 3, calculate d by Equations (15) and (16), respectively, and take their average value as the final result; if it is determined that the trajectory of the hand movement is in Area 4, calculate d by Equation (16).

2.3. Measurement Algorithm for the Height of Hand Movements Based on Human Body Electrostatics

The height of a hand movement can be calculated by making up a planar array of multiple electrodes, that is, the vertical distance between the trajectory of the hand movement and the planar array of electrodes. Using an array of four spherical electrodes, the coordinate system as shown in Figure 7 is established by taking the midpoint of the square with four electrodes as the vertex as the origin. The electrodes P₁, P₂, P₃, and P₄ are all in the XOY plane, and the distance of each electrode from the x and y axes is l. The height of the hand movement is the distance h between the trajectory of the hand movement and the XOY plane.

For convenience, the eight directions on the plane are numbered in the order as shown in Figure 7. In most cases, the distance d measured by two electrodes is not equal to the height of the hand movement h. Take direction ① as an example. AB is the trajectory of the hand movement parallel to the x-axis, and AD is perpendicular to point D on P₁P₃. The length of segment AD is the height of the hand movement h. The distance measured by electrodes P₁ and P₂ between the trajectory and the straight line P₁P₂ is d₁ and the distance measured by electrodes P₃ and P₄ between the trajectory and the straight line P₃P₄ is d₂.

In the triangle AP₁P₃, the lengths of the three sides are d₁, d₂, and 2l, respectively. According to Heron’s formula, the area of the triangle AP₁P₃ is:

S = \sqrt{p (p - d_{1}) (p - d_{2}) (p - 2 l)}

(17)

where p is the half perimeter of the triangle AP₁P₃, that is, p = (d₁ + d₂ + 2l)/2.

The value of the height of the hand movement can be calculated by:

h = \frac{2 S}{2 l} = \frac{\sqrt{2 d_{1}^{2} + 2 d_{2}^{2} - {(\frac{d_{1}^{2} - d_{2}^{2}}{2 l})}^{2} - 4 l^{2}}}{2} .

(18)

When the direction of hand movement is ②, ④, ⑥, or ⑧, there is only one set of electrodes in these directions, so there will be an error between the electrode measurement result d and the actual height h. This can be improved by adding electrodes, such as electrodes P₅ and P₆ shown in Figure 8, which are located on the x-axis, and P₄P₆ = P₃P₅ = P₂P₆ = P₁P₅ =

\sqrt{2} l

For example, when it is determined that the direction of the hand movement is direction ②, calculate the distance d₁ from the hand trajectory to line P₂P₃ through Equation (14) by using the signals on electrodes P₂ and P₃. The distance between electrodes P₂ and P₃ is

L = 2 \sqrt{2} l

. Then, calculate the distance d₂ from the hand trajectory to line P₄P₆ through Equation (15) by using the signals on electrodes P₄ and P₆. The distance between electrodes P₄ and P₆ is

L = \sqrt{2} l

, and the height of the hand movement h is:

h = \frac{\sqrt{2 d_{1}^{2} + 2 d_{2}^{2} - {(\frac{d_{1}^{2} - d_{2}^{2}}{\sqrt{2} l})}^{2} - 2 l^{2}}}{2} .

(19)

The flowchart for obtaining the height of the hand movement is shown in Figure 9.

First, determine the direction of the hand movement and select the corresponding electrode. Then, by analyzing the order of the maximum values of the induced current, the maximum values of the change rate of the induced current, and the zero-crossings of the induced current on the two electrodes, we can know which area the hand is located in order to calculate d₁ and d₂.

2.4. Simulation Noise Test

To verify the practicability of the algorithm, white noise was applied to the induced current signals generated on the electrodes by hand movements of different heights. The simulated waveform of the induced current on the electrodes after adding noise is shown in Figure 10. In the figure, the current signals are normalized to −1~1.

The noise-added signals were used to calculate the height of the hand 100 times under different SNR (SIGNAL-NOISE RATIO) conditions. The absolute values of the mean errors and the maximum errors obtained are shown in Table 1.

It can be seen from the table that a low SNR affects the accuracy of the algorithm. With the SNR increased, the mean errors and the maximum errors are decreased. When the SNR is greater than 15 dB and the range is 50~350 mm, the maximum absolute error of the height measurement is 11.70 mm and the maximum relative error is 5.85%.

2.5. Design and Experiment

In order to verify the algorithm proposed in this paper, we designed a human hand movement sensing system based on human body electrostatics, including a planar array of four spherical electrodes, electrostatic sensors, and an upper computer. Electrostatic sensors can convert the induced current into voltage signal output, which is convenient for subsequent signal transmission and processing. The response time of the electrostatic sensors is 1~2 milliseconds. The signal collected by the electrostatic sensors is transmitted to the upper computer through a wireless transmission device. The upper computer determines the information of the hand movement through the induced current signals and reflects it on the screen. At the same time, Leap Motion is used as the standard sensing system to verify the accuracy of the human hand movement sensing system, as shown in Figure 11. In practical application scenarios such as vehicle interactions, we think 50–350 mm is the proper operating range. If the hand is too close to the array, it may touch the electrodes. If the distance is too far, it can be considered that the hand exceeds the operation area and we can ignore it as interference.

In the experiment, the tester raised a hand and moved to 1 m in front of the electrode array. The sensing system calculates the height of a hand movement through the electrostatic signals obtained by the electrostatic sensors. Leap Motion and the electrode array are placed in the same plane so that they can simultaneously detect the height of the hand movement, as shown in the left section of Figure 12.

3. Results

When the height of a hand movement is 97.41 mm given by Leap Motion, the output signals of the sensors are shown in Figure 13a. The values of filtered signals are normalized to −1~1, as shown in Figure 13b. And the measurement result of the system is 100.65 mm.

The upper computer calculated the height of the hand movement based on the received signals and compared it with the output values of Leap Motion. A total of 80 groups of data were collected at different heights, and the comparison results are shown in Figure 14.

Figure 15 shows the errors of the results of the human hand movement sensing system. The maximum error is 6.58 mm and the mean error is 3.03 mm.

4. Discussion

4.1. Operation Error

This paper proposes a method for measuring the height of hand movements based on a planar array of electrostatic induction electrodes. However, in actual human-computer interactions, it is impossible to ensure that the hand movement trajectory is completely parallel to the line of electrodes. Therefore, the measurement height inevitably has errors. The following will take direction ① as an example to analyze the errors. Assume that there is a deviation of ξ between the direction of the hand movement and direction ①, as shown in Figure 16. AB is the trajectory of the hand along direction ①, and A’B’ is the trajectory of the hand with deviation angle ξ; DN and D’N are the projections of AD and A’B’ on plane XOY; AD and AD’ are perpendicular to plane XOY, respectively; and d is the distance from AB to line P₁P₂. The side length of the square P₁P₂P₃P₄ is 2l. Set the length of P₃D as m and the length of AD as h.

When the hand moves along A’B’, the result solved by Equation (14) is:

\begin{array}{l} d + Δ d & = D_{2} - \sqrt{2} L \frac{Δ t_{2}}{Δ t_{0}} \\ = 2 \sqrt{2} l - 2 \sqrt{2} l \frac{(2 l \cos ξ - \sqrt{{(l \tan ξ + m)}^{2} \cos^{2} ξ + h^{2}} / \tan α_{2}) / v}{2 l \cos ξ / v} . \\ = 2 \sqrt{2} l - \frac{2 \sqrt{2} l \cos ξ - \sqrt{{(l \tan ξ + m)}^{2} \cos^{2} ξ + h^{2}}}{\cos ξ} \end{array}

(20)

When the hand moves along direction ①, the distance d is:

d = \sqrt{m^{2} + h^{2}} .

(21)

Then the absolute error Δd and the relative error δ of the measurement are, respectively:

{\begin{cases} Δ d = d + Δ d - d \\ δ = \frac{Δ d}{d} \end{cases} .

(22)

The measurement range of the system is 50~350 mm, l = 40 mm, and

m \in [0, 2 l]

. If the deviation angle ξ is less than 10°, then:

{\begin{cases} δ_{\max} = 8.11 % \\ Δ d_{\max} = 6.88 mm \end{cases} .

(23)

The maximum value of δ is obtained when h = 50 mm and m = 40 mm, and the maximum value of Δd is obtained when h = 350 mm and m = 80 mm.

In conclusion, when the angle deviation between the trajectory of the hand movement and the line of electrodes is within 10°, the measurement error can be ignored relative to the measuring range. The angle ξ can be calculated by the electrode array [26]. If the angle is larger than 10°, we can define it as a new gesture or think it is a wrong one and ignore it according to the situation.

4.2. Application Example

In order to verify the usability of the method proposed in this paper, we wrote a program of a human-computer interface on the PC and obtained gesture information through the electrode array to control it. The area above the electrode array was divided into system operation area and application operation area. The system operation area was the area within 15 cm above the electrode array, and the gestures in this area were operations for controlling the system regardless of the current application, such as mute and standby. The application operation area was the area 15–30 cm above the electrode array, and gestures in this area were operations for controlling the current application or desktop. If the measured height of hand movement was more than 30 cm, it was considered as interference caused by distant charge movement (such as the hand movement of a person far away). The defined gestures are shown in Figure 17.

(1) In the system operation area, wave the hand to the right, and the system will initiate mute; wave the hand to the left, and the system will restore the original volume; wave the hand down, and the system will initiate standby; wave the hand up, and the system will be back to a normal state.

(2) In the application operation area, we can use gestures to operate the current application or desktop. Taking the desktop as an example, waving the hand in four directions moves the cursor to select different applications. Then we can enter the selected application with a gesture like tapping the screen.

This example only involves the movement of the hand in four directions, so only four electrodes are used. In the system operation area, when waving the hand to the right and down, the interface reactions are shown in Figure 18.

In the application operation area, when waving the hand in four directions, the interface reactions are shown in Figure 19.

If the measured height of the hand movement was more than 30 cm, the interface reaction is shown in Figure 20.

In addition, we have found a way to measure the angle between the hand trajectory and the array when they are not parallel. And the gestures of the hand moving clockwise and counterclockwise can also be recognized. We will combine them with the method proposed in this article to enrich the gestures for human-computer interaction in our future research.

5. Conclusions

In order to obtain the height of hand movements based on a planar array of electrodes, a method for measuring the height of hand movements based on a planar array of electrostatic induction electrodes was proposed in this paper, and a human hand movement sensing system was established to verify it. The information of the induced current on the induced electrode as obtained by the electrostatic sensor, and was then converted into a voltage signal. The upper computer received signals from different electrodes to determine the direction and calculate the height of the hand movement. Finally, the results measured by the human hand movement sensing system were compared with those of Leap Motion set at the same time. It can be seen from the results that the system can measure the height of the hand movement with a maximum error of 6.58 mm. The system verifies that the algorithm can measure the height of the hand movement, and the measurement errors caused by the movement direction of the hand not being parallel to the line of electrodes were discussed.

The method proposed in this paper can be applied to human-computer interaction systems. After classifying the hand movement in eight directions of the plane, it can obtain the height of hand movements. This method has the characteristics of a simple algorithm, non-contact, and low power consumption. Compared with the methods proposed by Kai Tang, only a planar array of electrodes is needed, which greatly saves space and has a wider range of use. Compared with the vision-based system, this method does not need to place the sensors on the external surface of the equipment, so as to ensure the integrity of the external surface of the equipment and avoid the privacy problems caused by the camera and compared with wearable equipment, it is more convenient and comfortable to use.

We can use this method on an intelligent vehicle system to control some applications through gesture recognition. In this application scenario, vision-based interaction has complex algorithms and large power consumption, which will burden the vehicle’s power supply. In addition, the camera is easily affected by light and background, and it may cause privacy issues. The tridimensional array cannot be set up in the narrow environment of the vehicle. The method we propose can measure the height of hand movements using a planar array. Therefore, gestures of different heights can represent different operations. In addition, gestures outside the operating range can be ignored by the system as interference signals from the back row. Therefore, this method has a good application prospect.

Author Contributions

Conceptualization, L.Z.; Data curation, L.Z.; Formal analysis, L.Z., X.C., C.W. and M.L.; Funding acquisition, X.C. and P.L.; Investigation, L.Z.; Methodology, L.Z. and C.W.; Project administration, X.C. and P.L.; Resources, X.C., P.L. and M.L.; Software, L.Z.; Supervision, X.C. and P.L.; Validation, L.Z.; Visualization, L.Z.; Writing—original draft, L.Z.; Writing—review & editing, L.Z., X.C., C.W. and M.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China grant numbers #U1630130 and #51777010.

Conflicts of Interest

The authors declare no conflict of interest.

References

Jennifer, P.; Yvonne, R.; Helen, S. Interaction Design: Beyond Human-Computer Interaction, 4th ed.; John Wiley & Sons Inc.: Hoboken, NJ, USA, 2015; pp. 219–221. [Google Scholar]
Liu, W. Natural user interface- next mainstream product user interface. In Proceedings of the 2010 IEEE 11th International Conference on Computer-Aided Industrial Design & Conceptual Design 1, Yiwu, China, 17–19 November 2010. [Google Scholar]
Fernandez, R.A.S.; Sanchez-Lopez, J.L.; Sampedro, C. Natural user interfaces for human-drone multi-modal interaction. In Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, VA, USA, 20–24 June 2016; pp. 2372–9198. [Google Scholar]
Günter, E.; Holzner, C.; Guger, C. A Hybrid Brain-Computer Interface for Smart Home Control. In Human-Computer Interaction. In Proceedings of the Interaction Techniques and Environments-14th International Conference, HCI International 2011, Orlando, FL, USA, 9–14 July 2011. Part II. [Google Scholar]
Moeslund, T.B.; Granum, E. A Survey of Computer Vision-Based Human Motion Capture. Comput. Vis. Image Underst. 2001, 81, 231–268. [Google Scholar] [CrossRef]
Nishiyama, M.; Watanabe, K. Wearable Sensing Glove with Embedded Hetero-Core Fiber-Optic Nerves for Unconstrained Hand Motion Capture. IEEE Trans. Instrum. Meas. 2009, 58, 3995–4000. [Google Scholar] [CrossRef]
Cheng, J.; Xie, C.; Bian, W.; Tao, D. Feature fusion for 3D hand gesture recognition by learning a shared hidden space. Pattern Recognit. Lett. 2012, 33, 476–484. [Google Scholar] [CrossRef]
Ji, X.; Wang, C.; Ju, Z. A New Framework of Human Interaction Recognition Based on Multiple Stage Probability Fusion. Appl. Sci. 2017, 7, 567. [Google Scholar] [CrossRef] [Green Version]
Ádám, E.; Thomas, W.; Bernhard, R. Privacy protection vs. utility in visual data-An objective evaluation framework. Multimed. Tools Appl. 2018, 77, 2285–2312. [Google Scholar]
Liu, J.; Pan, Z.; Li, X. An accelerometer-based gesture recognition algorithm and its application for 3D interaction. Comput. Sci. Inf. Syst. 2010, 7, 177–188. [Google Scholar] [CrossRef]
Kevin, R.W.; Mindy, H.C.; Kevin, H.K. Gesture based control and EMG decomposition. IEEE Trans. Ind. Appl. 2006, 36, 503–514. [Google Scholar]
Panagiotis, K.A.; Kostas, J.K. EMG-based control of a robot arm using low-dimensional embeddings. IEEE Trans. 2010, 26, 393–398. [Google Scholar]
Harland, C.J.; Clark, T.D.; Prance, R.J. Electric Potential Probes-New Directions in the Remote Sensing of the Human Body. Meas. Sci. Technol. 2002, 13, 163–169. [Google Scholar] [CrossRef]
Beardsmore-Rust, S.T.; Prance, R.J.; Aydin, A.; Prance, H.; Harl, C.J.; Stiffell, P.B. Signal specific electric potential sensors for operation in noisy environments. J. Phys. Conf. Ser. 2009, 178, 12011. [Google Scholar] [CrossRef]
Han, Q.; Chen, X.; Tang, K.; Li, P. A non-contact human-computer interaction application design based on electrostatic current of human body. Int. J. Comput. Appl. Technol. 2016, 53, 23–31. [Google Scholar] [CrossRef]
Kurita, K. A novel non-contact hand motion classification technique for application to human machine interfaces. In Proceedings of the SICE Annual Conference 2011, Tokyo, Japan, 13–18 September 2011. [Google Scholar]
Von, W.J.; Florian, K.; Biying, F. An experimental overview on electric field sensing. J. Ambient Intell. Humaniz. Comput. 2019, 10, 813–824. [Google Scholar]
Takiguchi, K.; Wada, T.; Toyama, S. Human Body Detection that Uses Electric Field by Walking. Adv. Mech. Des. Syst. Manuf. 2007, 1, 294–305. [Google Scholar] [CrossRef] [Green Version]
Takiguchi, K.; Wada, T.; Toyama, S. Rhythm Pattern of Sole through Electrification of the Human Body WhenWalking. J. Adv. Mech. Des. Syst. Manuf. 2008, 2, 429–440. [Google Scholar] [CrossRef] [Green Version]
Tang, K.; Chen, X.; Zheng, W.; Han, Q.; Li, P. A Non-contact Technique Using Electrostatics to SenseThree-dimensional Hand Movement for Human Computer Interaction. J. Electrost. 2015, 77, 101–109. [Google Scholar] [CrossRef]
Tang, K.; Li, P.; Wang, C.; Wang, Y.; Chen, X. Real-time hand position sensing technology based on human body electrostatics. Sensors 2018, 18, 1677. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Kurita, K. Novel Non-contact and Non-attached Technique for Detecting Sports Motion. Measurement 2011, 44, 1361–1366. [Google Scholar] [CrossRef]
Kurita, K.; Nishikubo, K. Development of a Human Motion Measurement System for Application to the Human Machine Interface. In Proceedings of the ICCAS-SICE International Joint Conference, Fukuka, Japan, 18–21 August 2009; IEEE Publisher: Piscataway, NJ, USA, 2009. [Google Scholar]
Kurita, K. New Estimation Method for the Electric Potential of the Human Body under Perfect Non-contact Conditions. IEEJ T. Electr. Electr. 2009, 4, 309–311. [Google Scholar] [CrossRef]
Jean, C. Electrostatics: Principles, Problems and Applications; Adam Higher: Bristol, UK, 1987; pp. 16–17. [Google Scholar]
Chen, X.; Han, H. Research on Human-Computer Interaction Technology Based on Electrical Detection Technology. TechConnect Briefs 2016, 3, 144–147. [Google Scholar]

Figure 1. Schematic diagram of the interaction.

Figure 2. Schematic diagram of a hand movement in a straight line near the spherical electrode.

Figure 3. Waveform of the induced current.

Figure 4. Waveform of the change rate of the induced current.

Figure 5. Schematic diagram of a hand movement parallel to the straight line of two electrodes.

Figure 6. Schematic diagram of the area division above the electrodes.

Figure 7. Schematic diagram of the height of a hand movement.

Figure 8. Schematic diagram of the electrode array improvement.

Figure 9. Flow chart for the hand height measurement.

Figure 10. Simulation waveform of the induced current after adding noise.

Figure 11. Schematic diagram of the verification system.

Figure 12. Experimental scene and electrode array.

Figure 13. (a) Sensor output signals. (b) Filtered and normalized signals.

Figure 14. Comparison chart of the measurement results between the human hand movement sensing system and Leap Motion.

Figure 15. Statistical chart of the measurement errors of the human hand movement sensing system.

Figure 16. Schematic diagram of the height measurement error caused by the trajectory of a hand movement not completely parallel to the line of electrodes.

Figure 17. Schematic diagram of defined gestures.

Figure 18. The interface reactions when the hand in the system operation area. (a) Waving the hand to the right; (b) waving the hand down.

Figure 19. The interface reactions when waving the hand in four directions in the application operation area.

Figure 20. The interface reaction when the hand trajectory is out of operation area.

Table 1. Absolute values of the mean errors and the maximum errors under different SNR conditions.

SNR	10 dB		15 dB		20 dB
Absolute Values of Errors/mm	Mean Error	Max Error	Mean Error	Max Error	Mean Error	Max Error
Absolute Values of Errors/mm	13.32	28.71	5.04	11.70	1.09	5.76

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).

Share and Cite

MDPI and ACS Style

Zhang, L.; Chen, X.; Li, P.; Wang, C.; Li, M. A Method for Measuring the Height of Hand Movements Based on a Planar Array of Electrostatic Induction Electrodes. Sensors 2020, 20, 2943. https://doi.org/10.3390/s20102943

AMA Style

Zhang L, Chen X, Li P, Wang C, Li M. A Method for Measuring the Height of Hand Movements Based on a Planar Array of Electrostatic Induction Electrodes. Sensors. 2020; 20(10):2943. https://doi.org/10.3390/s20102943

Chicago/Turabian Style

Zhang, Linyi, Xi Chen, Pengfei Li, Chuang Wang, and Mengxuan Li. 2020. "A Method for Measuring the Height of Hand Movements Based on a Planar Array of Electrostatic Induction Electrodes" Sensors 20, no. 10: 2943. https://doi.org/10.3390/s20102943

APA Style

Zhang, L., Chen, X., Li, P., Wang, C., & Li, M. (2020). A Method for Measuring the Height of Hand Movements Based on a Planar Array of Electrostatic Induction Electrodes. Sensors, 20(10), 2943. https://doi.org/10.3390/s20102943

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Menu