Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
A Cost Function for the Uncertainty of Matching Point Distribution on Image Registration
Previous Article in Journal
Leveraging Road Characteristics and Contributor Behaviour for Assessing Road Type Quality in OSM
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research on HAR-Based Floor Positioning

1
National Administration of Surveying, Mapping and Geo-Information (NASG) Key Laboratory of Land Environment and Disaster Monitoring, China University of Mining and Technology, Xuzhou 221116, China
2
School of Environment Science and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, China
3
College of Surveying and Geo-Informatics, Shandong Jianzhu University, Jinan 250101, China
*
Author to whom correspondence should be addressed.
ISPRS Int. J. Geo-Inf. 2021, 10(7), 437; https://doi.org/10.3390/ijgi10070437
Submission received: 23 May 2021 / Revised: 23 June 2021 / Accepted: 24 June 2021 / Published: 25 June 2021

Abstract

:
Floor positioning is an important aspect of indoor positioning technology, which is closely related to location-based services (LBSs). Currently, floor positioning technologies are mainly based on radio signals and barometric pressure. The former are impacted by the multipath effect, rely on infrastructure support, and are limited by different spatial structures. For the latter, the air pressure changes with the temperature and humidity, the deployment cost of the reference station is high, and different terminal models need to be calibrated in advance. In view of these issues, here, we propose a novel floor positioning method based on human activity recognition (HAR), using smartphone built-in sensor data to classify pedestrian activities. We obtain the degree of the floor change according to the activity category of every step and determine whether the pedestrian completes floor switching through condition and threshold analysis. Then, we combine the previous floor or the high-precision initial floor with the floor change degree to calculate the pedestrians’ real-time floor position. A multi-floor office building was chosen as the experimental site and verified through the process of alternating multiple types of activities. The results show that the pedestrian floor position change recognition and location accuracy of this method were as high as 100%, and that this method has good robustness and high universality. It is more stable than methods based on wireless signals. Compared with one existing HAR-based method and air pressure, the method in this paper allows pedestrians to undertake long-term static or round-trip activities during the process of going up and down the stairs. In addition, the proposed method has good fault tolerance for the misjudgment of pedestrian actions.

1. Introduction

Indoor positioning technology is one of the core technologies of artificial intelligence (AI) in the future [1]. It has been widely used in multiple industry sectors and markets [2], including shopping centers, hospitals, nursing homes, airports, railway stations, warehouses, parking lots, and prisons/detention centers. Today, high-rise and multi-storey buildings are widely distributed. In multi-storey indoor environments, users need floor information in the vertical dimension, alongside positions on a 2D plane. With the wide application of indoor location services, the demand for floor positioning information is increasing [3], especially in emergency rescue situations [4]. In a multi-floor indoor environment, an indoor positioning system (IPS) is sensitive to floor location [5], and floor recognition functions make indoor positioning systems more effective. In some cases, it is not easy to obtain the floor location information, such as in complex multi-floor environments, for people with limited vision [6], or in conditions with weak indoor light or fire smoke. Highly similar multi-storey parking lots have caused trouble for people trying to find their cars. The correct floor plan map in an indoor positioning system depends on the right floor positioning, and accurate floor judgment can effectively reduce the search time in the fingerprint-based method matching stage, while improving the positioning accuracy and reducing the computational overhead [7]. In the Indoor Positioning and Indoor Navigation (IPIN) competition, the competition area is usually a multi-floor building. In 2018, at the Microsoft indoor localization competition hosted by the international conference on Information Processing in Sensor Networks (IPSN), a 3D Track was used [8]. Therefore, during the competition, the participants need to first solve the problem of floor positioning. In general, floor positioning plays an important role in the field of indoor positioning.
The common floor positioning technologies mainly include radio-based floor identification technologies [9,10,11,12,13,14,15,16,17,18,19], floor determination methods based on barometric pressure [6,20,21,22,23,24], and floor positioning methods based on inertial sensors [25,26,27,28,29,30]. They can be used alone, or in combination [31,32,33,34,35], to perform floor positioning. However, the first two methods have some limitations. The radio-based method is dependent upon widespread wireless signal infrastructure support [36]. The effective positioning depends on a stable wireless network structure [37]. Most floor recognition algorithms are based on the difference or sudden change in wireless signals between different floors [10,38]. This type of method has high precision and good universality, but also some limitations. For the wireless signal method, the floor positioning accuracy is affected by the access point (AP) deployment conditions; multipath effects are likely to cause large fluctuations in the wireless signal strength (received signal strength indicator (RSSI)) [2,39,40,41], leading to a large error in indoor positioning [1], and floor positioning also suffers from this issue. Differences in the internal spatial structures of multiple floors will also affect the accuracy of floor positioning.
Methods based on barometric pressure also have some shortcomings. For these methods, although the floor recognition accuracy is high, the universality is inadequate. Air pressure is easily affected by environmental changes, such as the indoor temperature and humidity [15,30,42]. When pedestrians stay in a certain position for a long time, changes in the corresponding air pressure will cause errors in recognition of the floor [42]. Further, different barometer terminals need to be calibrated in advance [43,44]. Methods based on a reference base station require additional deployment and data communication, and some smartphones lack barometers [45]. The above shortcomings have affected the popularization of this method [21]. In addition, it can be difficult to obtain high-accuracy flooring information due to a high similarity in radio signals and the small barometric pressure difference between adjacent floors in a multi-storey environment with staggered floor structures, a low story height, stairwells [46], or atrium structures [17,18].
Existing HAR methods based on acceleration sensors can adapt to multi-floor structures and perform well under certain test conditions, but they need to be improved in terms of fault tolerance and action switching. There remain omissions in the stand still state or going back and forth when humans going up and down the stairs. The Ftrack method proposed by Ye [25] uses an acceleration sensor to calculate the time spent taking the elevator, or the number of steps taken when climbing stairs between any two floors, through information exchange when users meet and from the users’ trajectories. The feature data of the current floor are deduced and stored in a database. In the positioning stage, the floor positioning can be realized according to the time taken or the number of steps. In this method, the traversal of all floors and landmarks is needed in advance to obtain complete reference values, and to realize the omnibearing floor positioning. This method cannot reflect the process of going up and down stairs, and does not consider pedestrian round trips and stays. In the literature [27], smartphone pedometers and building shape models have been used to fix the specific position of a user through a particle filter. The symmetry of stairs has been used to solve the positioning of multiple floors. This method needs to be improved in terms of its real-time performance, however, because conclusions can only be drawn after a certain period of time or motion state. They will become invalid when users stay still for a while when going up/down stairs, or engage in back-and-forth walking, and the choice of shoe installation is not conducive to popularization of the applications. In other literature [29], it has been pointed out that some smartphones do not contain barometers, so the height of multi-storey buildings cannot be obtained from their data. Therefore, a pedestrian activity classification algorithm has been proposed to detect the activities of going up and down stairs, and in this way, the building height can be obtained. Then, the HAR results combined with WLAN positioning can be used to realize floor positioning through Kalman filtering. This method does not consider the static states during back-and-forth movement, and static states when going up and down stairs, and it requires the all-the-way tracking of WLAN.
In [30], the floor was determined by combining the barometric pressure with motion sensors. Equipment worn around the waist was used for stair climbing activity detection, landing detection, and counting. Then, the height variation was obtained by measuring barometric pressure. The Bayesian network model was used for floor positioning. However, this method is limited by the variability of barometric pressure when pedestrians are stationary or moving back and forth in a stairwell, and it cannot reflect the transition process of users going up and down.
Fetzer et al. [47] used threshold-based activity recognition based on barometer and accelerometer readings to realize floor change detection, which is simple and easy to implement. However, the floor change detection process is mainly based on the air pressure method, which affects its universality. The floor positioning system proposed by Ye et al. uses acceleration data to detect the time of entering and exiting the elevator, and recognizes and updates the floor through Wi-Fi signals. This method is mainly based on wireless signals, and is not necessarily suitable for multi-floor environments without elevators [36].
Inertial sensors in smartphones are not easily affected by multi-floor indoor structures, temperature, humidity, or wind speed. This type of method does not require calibration in advance, and has high relative accuracy, robustness, and universality. Thus, methods based on acceleration sensors can be used to identify the floor, making up for the shortcomings of radio-based methods and barometric-pressure-based methods, and can achieve high precision, stability, and universal floor positioning effects.
Based on the above discussion, we propose a method that involves using pedestrian activity status to determine floor changes and then achieve floor positioning information. The method allows pedestrians to stay static or engage in a round trip when going up and down stairs. The classification algorithm is used for activity classification (AC). On the basis of AC, the change in elevation of each stair in a multi-storey building can be obtained. The pedestrian vertical position and flooring information can also be obtained by synchronously detecting changes in the pedestrian’s floor location.
The paper is organized as follows. Section 2 introduces the method to achieve HAR, based on smartphone sensor data. Section 3 presents the algorithm used to detect the floor change. Section 4 demonstrates the algorithm accuracy and floor positioning results through experiments by a process of alternating multiple types of activities. In Section 5, the conclusions are given.

2. Human Activity Recognition

Generally, when pedestrians are walking (WA), upstairs (US), or downstairs (DS) in a multi-floor indoor environment, the three-axis accelerometer data in smartphones held by them show a certain periodicity. In this study, the vector sum of three-axis accelerometer data (TAAD) was taken as the total acceleration data (TAD), and the filtered TAD were divided periodically, which is similar to the step frequency detection used in pedestrian dead reckoning (PDR) [48]. In the classification algorithm, the feature vector of each step accounting period was extracted as training samples during the training stage. The classification model was trained and refined by the classification algorithms through machine learning. During the classification stage, the feature vector extracted in pedestrian movement was input into the classification model, giving us the activity categories [49,50,51]. We determined the positions of pedestrians in the elevation dimension to calculate their floor location. Therefore, this study mainly developed high-precision AC for the following actions: WA, US, and DS.
Although the existing HAR classification algorithms are very mature and have achieved good performance [29,50,51,52,53], the selection of features still plays a significant role in classification accuracy. Pedestrians may engage in walking, going up/down stairs, and taking the elevator, although most of the time they stay still (ST). The classification algorithm is unable to correctly determine other pedestrian activities with small probabilities. In order to address this problem, the overall features of the TAD of common activities were extracted, and the threshold values were divided. In this way, pedestrian activities with small probabilities could be masked. Such activities belonged, overall, to the state of walking because they usually occurred on the ground. Figure 1 shows the specific HAR classification algorithm flow.

2.1. Filtering

During the movement of pedestrians, TAAD (the three-axis data are respectively represented by ax, ay, and az.) were output at the frequency of 50 Hz, and TAD was a_all, as expressed by Equation (1). In order to effectively remove the “noise” data, the mean filtering algorithm was selected. After filtering, TAAD and a_all were set as ax′, ay′, az′, and a_all′, respectively. Taking a_all′ as an example, the mean filtering process is shown in Equation (2).
a _ a l l i = a x i 2 + a y i 2 + a z i 2
a _ a l l = ( a _ a l l i 8 + + a _ a l l i ) / 9 , i f i 9 a _ a l l = ( a _ a l l 1 + + a _ a l l i ) / i , i f i < 9

2.2. Step Frequency Detection

The periodic law of a_all′ was used for step detection, and the peak point of each period could be determined according to the fluctuation characteristics of a_all′. The peak point was taken as the demarcation point of adjacent periods. Each period was recorded as one step, and the index corresponding to the peak was set as step_index. Considering that there were no obvious periodic features of a_all′ during the activities of going up/down elevators or keeping still, the mean value of the frequency avg_af of the other movement states was taken as a one-period frequency. That is, if the fluctuation range of a_all′ was within a small range and there was no peak within the sampling frequency of 50/avg_af after the previous peak, a period could be recorded. The overall peak value determination logic was summarized as follows: the filtered acceleration value effectively removes the false peak. If a sample value is greater than the three sample values before and after it, and, at the same time, is greater than a set minimum peak threshold (according to statistics, the threshold is set to 10.1 here), the sample is judged to be a peak. At this time, a cycle is recorded. The logic example of the overall step determination (Algorithm 1) is as follows.
Algorithm 1: Step Determination Algorithm
Input: filtered acceleration set A, average steps set avg_af in one second
Output: step_index
Ijgi 10 00437 i001

2.3. Threshold Filtering

The peaks of a_all′ corresponding to pedestrian activities (WA, US/DS, taking the elevator, and ST) had different numerical ranges, so this was used as the filtering basis before HAR classification. In the actual multi-storey building, pedestrian activities mainly included WA, US, DS, elevator up (LU), elevator down (LD), and ST. Other activities with small probabilities, such as running, jumping, and shaking, were included in the state of walking in this study.
The acceleration due to gravity was set as g at the testing site. The analysis of a_all′ of the motion states (the data related to different activity states are shown in Figure 2) indicated that the fluctuation of a_all′ was at the minimum and had no periodicity when pedestrians were in the states of standing still and taking the elevator, with the value sitting around g (roughly fluctuating ±0.5). At the same time, when the elevator went up and down, a_all′ indicated accelerating, uniform, and decelerating motions. The average acceleration of each step was avg_a_all′, the second maximum value was max_a_all′, and the second minimum value was min_a_all′. Under such a background, if avg_a_all′ and min_a_all′ were larger than g within two consecutive steps, the elevator had an upward acceleration or a downward deceleration. If they were less than g, the elevator movement was the opposite. The ranges of the peak and valley values of a_all′ were relatively close in the states of walking and going up and down stairs, with the maximum value interval of (10.5, 16) and a minimum value interval of (5, 9), as shown in Figure 2. If both the maximum and minimum values of a_all′ were outside of the aforementioned ranges, the motion state belonged to other activities, and was marked as new_a_all in the HAR classification. The classification of a_all′ is expressed as follows.
a _ a l l = l i f t i n g _ d a t a ,   if   a _ a l l ( step_index ( i 1 ) : step_index ( i ) ) g ± 0.5 o t h e r _ d a t a ,   if   max ( a _ a l l ( step_index ( i 1 ) : step_index ( i ) ) ) 10.5 , 16 min ( a _ a l l ( step_index ( i 1 ) : step_index ( i ) ) ) 5 , 9 n e w _ a _ a l l ,   o t h e r
It can be seen from Figure 2 that the a_all′ data in the latter three states (ST, LU, and LD) have obvious characteristics, and threshold conditions can be selected to differentiate them from one another. High-precision classification can be completed even without the use of classification algorithms, and thus computing resources can be saved.

2.4. Selection and Extraction of Eigenvalues

The complex calculation of frequency domain features is not conducive to real-time classification on smartphones [54]. According to the related literature [51,52,53,55,56], from periodic curve characteristics of new_a_all of three kinds of motion (WA, US, and DS) and filtered barometric pressure data, a total of 91 eigenvalues were taken (see Table 1). Of these, 88 features were from TAAD, and the others were barometric pressure data. If there was no barometric pressure sensor in the smartphones, features of TAAD could be selected for AC. Suppose the selected features are Fi, where i = 1,2,3,…,91. Assume that the air pressure data feature is called Air.

2.5. Classification Algorithms

During the algorithm selection process, two types of software, Matlab and Waikato Environment for Knowledge Analysis (WEKA) [29], were respectively used to carry out approximately 1500 classification experiments, as shown in Figure 3. The above classification trainings are carried out using multiple algorithms and multiple combinations of feature vector. We selected more than ten machine learning classification algorithms (see Figure 3), including decision tree (C4.5), logistic model tree (LMT), random forests, Bayes, support vector machine (SVM), etc. Considering that some smartphones do not contain a barometer, the first 88 feature values were selected for classification. In the figure, the columns represent different classification algorithms, and the rows in red area represent the different combinations of selected features. The red gradient is used to indicate the difference in classification accuracy. Darker color means higher classification accuracy. The data in the figure show that when the same classification algorithm is used, the average difference in the classification accuracy due to selecting different feature sub-vectors is about 43%; when the same features is used, the average difference in the classification accuracy of different classification algorithms is about 13%. The eigenvalues corresponding to the classification results in the white dashed box in the figure were classified by unfiltered eigenvalues, and the accuracy was low, failing to reach 50%. It can be seen that the features have a greater impact on the classification accuracy, and adding the feature value of the filtered data can effectively remove the noise and improve the classification accuracy. The last three rows of data respectively show the average, maximum, and minimum classification accuracy of each algorithm. After comparing the classification accuracy of different classification algorithms, it was found that the algorithm with the highest classification accuracy was SVM, so the SVM algorithm was selected for real-time activity classification in the floor positioning phase.

3. Detection Scheme for Floor Changes

After obtaining the pre-acquired high-accuracy initial floor position, the floor positioning could be implemented recursively through the floor change detection scheme proposed in this study. The method of floor change detection is summarized as follows. Firstly, different AC results for each step of the pedestrians were processed differently. Then, based on the pre-stored floor stair library (see Table 2), each step’s status data could be calculated and saved. Floor change determination was also conducted (see Figure 3). Finally, the current floor position could be obtained based on the previous floor position or the high-accuracy initial floor recursion.
The detection process included online and offline stages. In the offline stage, the parameters of the target indoor multi-storey structure were investigated, including the number of stairs on each floor, the number of floor platforms, positions of the platforms, and the height of the floor. These data were saved and sample data are given in Reference Floor (RF) table, see Table 2.
If there were elevators in the multi-storey space, it was necessary to record the elevator up-and-down time in advance, and we stored them in the ETRF table. The ETRF mainly recorded the relationship between elevator running height and time, as shown in Table 3 and Figure 4. The data were obtained through various real operations. Equation (4) expresses the relationship between running time and running height. The fitting function’s R2 was 0.9964. In the real-time determination stage, the discrepancy in elevation was obtained according to the elevator running time, and then, the new floor position could be calculated according to the previous floor position and the floor height in the Table RF.
H e i g h t = 1.0405 * T i m e 3.2995
In the online phase, a temporary table Temp (as shown in Table 4) was established to store data relating to different motion states of pedestrians during human movement. Time in the table was used to record the time, the up_down_rate recorded the degree level of the floor transition to another, and up_steps, down_steps, stay_steps, and walk_steps, respectively, recorded the steps of US, DS, ST, and WA in the process of the floor change. This table was mainly used to record the movement status series of pedestrians and provide data support for pedestrian floor change plans.
Figure 5 shows the flow for detecting the floor change, the ‘St’ in the figure represents each calculation step. It shows that the high-accuracy initial floor could be obtained by Step 1 or using an external input, and the position was input into Step 5. Step 2 classified the TAAD of each step by HAR to obtain the AC of the pedestrians. In Step 3.1 to Step 3.4, increment and decrement operators were used on different fields in the temp table, according to various ACs. In Step 4, the change of floor was updated according to the motion states and up_down_rate. Finally, the current floor position was calculated by Step 5. In this way, floor positions over a long period of time could be realized through cyclic calculation.
(1)
Step 1: Determination of the initial floor position. The proper radio-based floor positioning methods [9,15,16,57] or external input can be used to obtain the position of the initial floor. The real-time update of the position by inputting the initial absolute floor position into Step 5.
(2)
Step 2: Algorithm for HAR. The specific flow has been given in Section 2. AC results can be obtained by inputting TAAD. The activity categories were taken as activation signals of Step 3.1–Step 3.4, that is, Step 3.1 is executed if pedestrians go upstairs. Step 3.2 is executed if pedestrians go down stairs. Step 3.3 is executed if pedestrians walk. Step 3.4 is executed if pedestrians keep still, or take the elevator.
(3)
Step 3.1: Dealing with upstairs steps. Firstly, it is necessary to judge whether the user was at the highest floor. If so, Step 3.3 is executed. If not, step_num of the current floor is obtained from the Table RF, and the f_rate = 1/step_num is calculated. The time in the Temp table is then updated. Other field values are processed as follows. The original up_down_rate +f_rate and up_steps +1 are carried out. If up_steps ≤ 3, the value of down_steps, stay_steps, and walk_steps remain unchanged. If up_steps > 3, their values return to zero.
(4)
Step 3.2: Dealing with downstairs steps. Firstly, it is necessary to judge whether the user is on the lowest floor. If so, Step 3.3 is executed with the motion state of walking. If not, Step_num of the current floor is obtained from Table RF, and the f_rate = 1/Step_num is calculated. The time in the temp table is then updated. Other field values are processed as follows. The original up_down_rate-f_rate and down_steps+1 is conducted. If down_steps ≤ 3, the values of up_steps, stay_steps, and walk_steps remain unchanged. If down_steps > 3, their values return zero.
(5)
Step 3.3: Dealing with walking steps. There are two situations. If the up_down_rate in the temp table is close to the step change rate near the platform (i.e., PF_rate in Table RF), pedestrians are going up/down the stairs. Meanwhile, if the value of walk_steps is in a reasonable range of the PF_steps in Table RF, walk_steps + 1 is implemented. If not, the motion type depends on the larger value of down_steps and up_steps, which then corresponds to Steps 3.1 and 3.2. During horizontal walking, the time in the temp table is updated, and walk_steps +1 is conducted. If walk_steps > 3 and up_steps+down_steps > 3, Step 4 is then executed.
(6)
Step 3.4: Dealing with keeping still. There are two cases. Firstly, when pedestrians keep still in the process of going up/down the stairs or in the process of moving in the plane, the time and stay_steps tend to increase in the Temp table. Secondly, there are certain feature of a_all′ in the process of taking the elevator up and down, showing the process of firstly accelerating upwards (or downwards) for about 2 seconds, then returning to a relatively still state for some seconds, and then decelerating upwards (or downwards) for about 2 seconds. The starting and ending time of the whole acceleration–motionless–deceleration process is recorded and set as the start_end_time. By comparing the start_end_time with the S_E_time in the table ETRF, the height difference of the elevator, called Δ h ascending or descending, can be obtained. The floor position is updated by inputting Δ h into Step 5. If Δ h > 0, pedestrians are taking the elevator up; otherwise, pedestrians were taking the elevator down. At the same time, values of up_steps, down_steps, and walk_steps are set as zero in the table Temp.
(7)
Step 4: Judging the floor change. This is used to calculate the general position of pedestrians in the vertical direction during the process of going up and down stairs. If the up_down_rate in the temp table is 0.5 while the pedestrian is going up stairs, F4 (as an example) is given by Step 5, indicating that the pedestrian is in the middle of the stairs between F4 and F5, which can be shown on the map. If the value of the up_down_rate is close to 0, it is set to 0, indicating that the pedestrian is on the same floor. If it is close to ±1, it showed that the pedestrian only goes up (close to 1) or down (close to −1) the stairs. At this point, Step 5 is executed. At the same time, the values of up_steps, stay_steps, and down_steps are set to zero. If none of the above is true, the pedestrian is still going up/down stairs, and there was no need to conduct any calculation.
(8)
Step 5: Floor location update. This is used to record the current floor. The value obtained by Step 1 is recorded as the current floor. The F_last of the currents floor can be calculated by inputting Δ h into Step 3.4. On this basis, the h_sum of the adjacent ±f floors is obtained, according to the table RF. If h_sum is closest to Δ h , the result is F _ l a s t = F _ l a s t + f , where positive and negative values of f are the same as Δ h . The input value of Step 4 can be 1 or –1. If it is 1, the floor position is increased by 1. Otherwise, it is reduced by 1. At the same time, the up_down_rate in the temp table is reset to 0 to facilitate the seamless operation of all steps.
To sum up, all steps are used to calculate the floor position according to the logic relationship presented in Figure 5. After each cycle of human activity, the steps calculate, process, increase, or decrease the degree value, determine the threshold value, and analyze and determine the floor position. Through cooperation among the steps, the real-time floor position can be obtained.

4. Experiment Introduction and Result Analysis

4.1. Introduction to the Experimental Environment

The experiment was carried out in a five-story office building in China University of Mining and Technology. The experimental site covered an area of about 3800 m2, and the main corridor of each floor was about 210 m long. There were one elevator and four sets of stairs for the experimental floors, including the five-story office areas and one underground garage. The floor height of the garage and the first floor was 5 m, and that of the other floors was 4 m. Figure 6 shows the experimental environment.

4.2. Characteristics of a_all’ with the Elevator in Operation

The acceleration sensor data were used to reflect the operation of the elevator. The fluctuation range of a_all′ during elevator operation was much smaller than that for pedestrians walking or going up and down stairs. In the upward process of the elevator, a_all′ firstly accelerated upward, then moved at a uniform speed for several seconds and decelerated to a stop. The change law of a_all′ was opposite to this in the downward process. a_all′ occurred several seconds of uniform state between the intermediate moment of acceleration and deceleration. The starting and ending time of the elevator was related to Δ h [25]. On this basis, the number of floors of the change of pedestrians could be inferred during the operation of the elevator. Figure 7 shows the variation characteristics of a_all′ during the operation of the elevator. The green broken line is the filtered acceleration a_all′ (left ordinate), the orange curve is the corresponding floor position (right ordinate), and the abscissa represents the data sampling frequency. In order to highlight the change in a_all′ (shown by different dotted lines), the a_all′ data for the waiting time beyond the upward and downward movement of the elevator were deleted.
In the process of taking an elevator, pedestrians often stop halfway (for other people to get on or off the elevator) and then continue to move to the target floor. Therefore, the floor change could be processed with several stages of upward movement and downward movement of the elevator. Each process will generate a Δ h . Δ h can be converted to the number of the relative floor change. Finally, the values can be superimposed. If a pedestrian takes the elevator from F1 to F5, and others get out of the elevator on F3, the determination of the floor change can be processed in two stages.

4.3. Classification Algorithms and Feature Vector Selection

The SVM algorithm is a classic machine learning classification algorithm. It can solve problems such as nonlinearity and local minima, and it performs well in text, face, image, and speech recognition. Since the data characteristics corresponding to the three motions of ST, LU, and LD are obvious and easy to distinguish, even without using machine learning classification algorithms, high-precision classification can be achieved. The three kinds of activities of WA, US, and DS have a high degree of similarity, and it is difficult to distinguish them in a simple way. Therefore, we focused on classification testing for these three types of activities. In the classification test process, eight testers with heights between 1.58 and 1.89 m were asked to carry out WA, US, and DS movements. A total of more than 70,000 accelerometer data points were collected via smartphones, corresponding to a total step frequency of about 3000 steps. The 10-fold cross-validation method was used to evaluate the accuracy. Considering versatility, 88 features that did not include air pressure data were selected for classification. The average activity classification accuracy of the eight testers was 96.8%. The heights of different testers and the corresponding classification accuracy are shown in Figure 8. It can be seen from the figure that the feature vector selected in this study has a good classification performance, high classification accuracy, and good data support for the subsequent floor change check algorithm.

4.4. Fault Tolerance Analysis of Continuous Misjudgement and Floor Change Detection

In the floor change detection scheme, a threshold was set to assist the floor change detection. If walk_steps in the temp table exceeded 3, and up_steps+down_steps exceeded 3, the pedestrian was judged to move from one floor to another, and Step 5 in Figure 5 was activated. The three-step threshold was mainly determined based on the training results for the number of consecutive misjudged steps of HAR. During the pedestrian’s movement, the more consecutive misjudged steps there were (especially for the activities of going up and down stairs), the more unfavorable the conditions for the detection of the floor change. Through the analysis of the results in Figure 8, the number of incorrect steps misclassified by multiple people was 90 steps in total. We found that the continuous value of the number of misjudged steps was mostly 1, a small number of misjudged steps were 2, and the maximum was 3 steps. The specific distribution is shown in Table 5. It can be seen that this statistical result supports the implementation of the floor change detection scheme in this article.

4.5. Comparison of Floor Positioning Effects Based on Wi-Fi Signals and HAR

To determine the floor, Wi-Fi signals were collected at a frequency of 1 Hz and TAAD were collected at a frequency of 50 Hz by walking along the corridor on F3 (in the experimental environment of Figure 6). Both types of data are collected by hand-held smartphones during pedestrian’s walking. Figure 9 shows the floor positioning results from the two methods. The method based on Wi-Fi signals was introduced in [9]. In Figure 9a, the overall floor positioning accuracy of the Wi-Fi signals was quite ideal during pedestrian walking, and the accuracy was about 92%. However, the floor was misjudged continuously (in the red dashed box) in some areas due to the relatively high signal similarity between adjacent floors. This was because the method based on Wi-Fi signals is easily affected by the indoor environment, architectural pattern, AP layout, etc., which may lead to incorrect results. In Figure 9b, the pedestrian was walking in the corridor of F3, taking a total of 180 steps. At this point, the characteristics of pedestrian walking could not easily be changed, so the activity classification and floor result were not affected by the indoor environment. Even if there was occasional misjudgment of the activity state, the result of the floor was the same as the reference floor F3 by the algorithm in Chapter 3. In short, if the pedestrian keeps walking on a plane, the algorithm in this paper keeps the pedestrian’s floor position unchanged.

4.6. Comparison of Floor Estimation Results

A pedestrian may be in a static state when going up and down stairs, such as when thinking, smoking, engaging in voice communication, taking video calls, etc. Therefore, it is necessary to consider the impact of the static state on floor determination. In general, when the temperature and humidity change rapidly, the barometric-pressure-based and non-base-station floor estimation method will most likely fail. In this study, multiple activities were involved in the experiments related to going up and down stairs, and there were about 15 min of the ST state during this period. The effects of two non-base-station barometric-pressure-based methods and one HAR-based floor positioning method were compared with the proposed method. The BPFI method in the literature [58] was used as the non-base-station barometric-pressure-method, and the relationship between barometric pressure and height difference was also used for floor positioning. Another HAR-based method, was discussed in literature [30]. The corresponding results are shown in Figure 10. Figure 10a shows the barometric pressure values during the test, and Figure 10b shows the human activities. The black area represents the 15 min of static state on the platform from F3 to F2. Figure 10c shows the actual floor, and the results of the three floor positioning methods. It can be seen from Figure 10c that our HAR-based method was not affected by the ST state of the pedestrians, and compared with other methods, the floor positioning accuracy was the highest.

4.7. Analysis of Floor Positioning Results under Multiple Activities

Similar to most indoor positioning systems, accuracy is one of the classical measurements of a floor positioning technology [59]. Through a series of activities, we calculated the floor position by the proposed method, and compared it with the real floor position. Figure 11 shows the specific floor positions obtained by the HAR classification algorithm, where the x-axis represents steps of pedestrian movement, the lower scale of y-axis represents the number of floors, and the top row represents the different AC at each moment. The occasional dots of different colors in the middle represent the misjudgment of HAR. The blue line below represents the intermediate results, and the red represents the actual floor position. According to the action type data, the elevation position (the blue poly-line area) can be derived. It can be seen that, even if there were misjudged states of pedestrian movements, the results could be corrected in time, and the overall floor change determination accuracy was high. In addition, it can be inferred that as long as the classification algorithm maintains an accuracy of more than 92% and more than four steps of misjudgment do not occur, the floor determination accuracy would always remain at 100%. If no more than two steps of misjudgment occur every 10 steps (i.e., the accuracy of HAR is higher than 80%), the floor determination accuracy remains unchanged.

5. Conclusions and Prospects

There are some problems with floor positioning in the following situations. Radio signals can be affected by multi-storey and complex indoor environments. Barometric changes are limited by temperature and humidity. The floor recognition rate is low in staggered floor and atrium spaces. In addition, some smartphones do not have barometric sensors. In order to solve these problems, a HAR-based method was proposed in this study to obtain real-time floor positions. The SVM algorithm was used for activity classification, and 91 eigenvalues were selected for classification. The recognition accuracy of WA, US, and DS was as high as 99.3%. The average activity recognition accuracy of multiple people could still be maintained at 96.8%, even in smartphones without barometers. Thus, high-accuracy floor change recognition could be guaranteed.
Threshold analysis was used to filter the static states of pedestrians, and then detect the state of taking the elevator up and down. The running time of the elevator was recorded and used to judge the floor change. Then, the results of the floor change and the HAR were utilized to detect the real-time floor change by a series of aforementioned detailed steps. The floor positioning was also realized. Finally, the floor positions of pedestrians’ movements in a multi-storey building were evaluated and compared with the actual floor positions. The test results indicate that our method could achieve high-accuracy floor change and real-time floor positioning. It also had a sound fault tolerance rate in the case of the continuous misjudgment of a three-step motion state. Moreover, it was not sensitive to the complex multi-storey environment and had high universality. It was able to detect floor changes during elevator operation, even without barometers, but also allowed for pedestrian round-trips and static behavior.
The scheme for detecting the HAR-based floor change was described in this paper on the basis of ensuring HAR accuracy, and the number of consecutive misjudged steps. In the case of different phone modes, such as trouser pocket modes, and waist or ankle positions, the HAR accuracy could be ensured by extracting the same and even higher accuracy classification models through further sample training. If there appeared more than four misjudged consecutive steps, the accuracy of the classification model could be improved by increasing the training sample size, optimizing feature vector. If the accuracy still cannot be improved, we can adjust relevant thresholds to increase the fault tolerance rate of our method. In short, higher HAR accuracy can ensure the high-precision floor positioning of the HAR-based method described in this article.

Author Contributions

Conceptualization, Hongxia Qi, Yunjia Wang and Jingxue Bi; Data curation, Hongxia Qi and Shenglei Xu; Investigation, Hongxia Qi and Hongji Cao; Methodology, Hongxia Qi, Hongji Cao and Jingxue Bi; Resources, Hongxia Qi; Software, Shenglei Xu; Supervision, Yunjia Wang; Vali-dation, Hongxia Qi and Shenglei Xu; Writing—original draft, Hongxia Qi; Writing—review and editing, Hongxia Qi, Yunjia Wang, Jingxue Bi and Hongji Cao. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China, grant number 2016YFB0502102. This research was also funded by the National Natural Science Foundation of China (No.42001397) and the Introduction & Training Program of Young Creative Talents of Shandong Province (0031802).

Data Availability Statement

Restrictions apply to the availability of these data. Data are classified and are not able to be published publicly.

Acknowledgments

We would like to acknowledge the National Key Research and Development Program of China, the National Natural Science Foundation of China, and the Introduction & Training Program of Young Creative Talents of Shandong Province for financial support. We would also like to thank the editor and anonymous reviewers for their critical comments and constructive suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chen, R.Z.; Chen, L. Indoor Positioning with Smartphones: The State-of-the-art and the Challenges. Acta Geod. Cartogr. Sin. 2017, 46, 1316–1326. [Google Scholar]
  2. Furfari, F.; Crivello, A.; Barsocchi, P.; Palumbo, F.; Potorti, F. What is next for Indoor Localisation? Taxonomy, protocols, and patterns for advanced Location Based Services. In Proceedings of the 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Pisa, Italy, 30 September–3 October 2019; pp. 1–8. [Google Scholar]
  3. Li, B.H.; Harvey, B.; Gallagher, T. Using barometers to determine the height for indoor positioning. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation 2013, Montbeliard, France, 28–31 October 2013; pp. 1–7. [Google Scholar]
  4. Gu, F.Q.; Blankenbach, J.; Khoshelham, K.; Grottke, J.; Valaee, S. ZeeFi: Zero-Effort Floor Identification with Deep Learning for Indoor. In Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM), Waikoloa, HI, USA, 9–13 December 2019; IEEE: Waikoloa, HI, USA, 2019; pp. 1–6. [Google Scholar]
  5. Wang, H.; Lenz, H.; Szabo, A.; Hanebeck, U.D.; Bamberger, J. Fusion of Barometric Sensors, WLAN Signals and Building Information for 3-D Indoor/Campus Localization. In Proceedings of the International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2006), Heidelberg, Germany, 3–6 September 2006; pp. 426–432. [Google Scholar]
  6. Bai, Y.C.; Jia, W.Y.; Zhang, H.; Mao, Z.H.; Sun, M.G. Helping the blind to find the floor of destination in multistory buildings using a barometer. In Proceedings of the 35th Annual International Conference of the IEEE EMBS, Osaka, Japan, 3–7 July 2013; pp. 4738–4741. [Google Scholar]
  7. Li, H.T.; Qi, S. Indoor Map Information Based WiFi Positioning Technology for Multi-Floor Buildings. J. Univ. Electron. Sci. Technol. China 2017, 46, 32–37. [Google Scholar]
  8. Potortì, F.; Park, S.; Crivello, A.; Palumbo, F.; Girolami, M.; Barsocchi, P.; Lee, S.; Torres-Sospedra, J.; Ruiz, A.R.J.; Perez-Navarro, A.; et al. The IPIN 2019 Indoor Localisation Competition—Description and Results. IEEE Access 2020, 8, 206674–206718. [Google Scholar] [CrossRef]
  9. Qi, H.X.; Wang, Y.J.; Bi, J.X.; Cao, H.J.; Si, M.H. Fast floor identification method based on confidence interval of Wi-Fi signals. Acta Geod. Geophys. 2019, 54, 425–443. [Google Scholar] [CrossRef]
  10. Deng, Z.L.; Wang, W.J.; Xu, L.M. A K-Means Based Method to Identify Floor in WLAN Indoor Positioning System. Software 2012, 33, 114–117. [Google Scholar]
  11. Alsehly, F.; Sevak, Z.; Arslan, T. Indoor positioning with floor determination in multi story buildings. In Proceedings of the Indoor Positioning and Indoor Navigation (IPIN), Guimarães, Portugal, 21–23 September 2011. [Google Scholar]
  12. Maneerat, K.; Prommak, C.; Kaemarungsi, K. Floor estimation algorithm for wireless indoor multi-story positioning systems. In Proceedings of the 2014 11th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), Nakhon Ratchasima, Thailand, 14–17 May 2014. [Google Scholar]
  13. Bhargava, P.; Krishnamoorthy, S.; Nakshathri, A.K.; Mah, M.; Agrawala, A. Locus: An Indoor Localization, Tracking and Navigation System for Multi-story Buildings Using Heuristics Derived from Wi-Fi Signal Strength. In Proceedings of the International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services, Tokyo, Japan, 2–4 December 2013; Springer: Berlin/Heidelberg, Germany, 2013; Volume 120, pp. 212–223. [Google Scholar]
  14. Maneerat, K.; Prommak, C. An Enhanced Floor Estimation Algorithm for Indoor Wireless Localization Systems Using Confidence Interval Approach. In Proceedings of the International Conference on Telecommunications and Network Engineering, Zurich, Switzerland, 30–31 July 2014; Volume 8, pp. 1182–1186. [Google Scholar]
  15. Zhang, S.; Guo, J.M.; Wang, W.; Hu, J.Y. Floor Recognition Based on SVM for WiFi Indoor Positioning. In China Satellite Navigation Conference (CSNC) 2018 Proceedings; Lecture Notes in Electrical Engineering; Springer: Singapore, 2018; Volume 499, pp. 725–735. [Google Scholar]
  16. Alireza, R.; Mikko, V.; Elena, S.L. Robust Statistical Approaches for RSS-Based Floor Detection in Indoor Localization. Sensors 2016, 16, 793. [Google Scholar]
  17. Han, L.T.; Jiang, L.; Kong, Q.L.; Wang, J.; Zhang, A.G.; Song, S.M. Indoor Localization within Multi-Story Buildings Using MAC and RSSI Fingerprint Vectors. Sensors 2019, 19, 2433. [Google Scholar] [CrossRef] [Green Version]
  18. Elbakly, R.; Aly, H.; Youssef, M. TrueStory: Accurate and Robust RF-Based Floor Estimation for Challenging Indoor Environments. IEEE Sens. J. 2018, 18, 10115–10124. [Google Scholar] [CrossRef]
  19. Zheng, Z.W.; Chen, Y.Y.; Chen, S.N.; Sun, L.; Chen, D. BigLoc: A Two-Stage Positioning Method for Large Indoor Space. Int. J. Distrib. Sens. Netw. 2016, 2016, 1289013. [Google Scholar] [CrossRef] [Green Version]
  20. Xia, H.; Wang, X.G.; Qiao, Y.Y.; Jian, J.; Chang, Y.F. Using Multiple Barometers to Detect the Floor Location of Smart Phones with Built-in Barometric Sensors for Indoor Positioning. Sensors 2015, 15, 7857–7877. [Google Scholar] [CrossRef]
  21. Ebner, F.; Fetzer, T.; Deinzer, F.; Köping, L.; Grzegorzek, M. Multi sensor 3D indoor localization. In Proceedings of the 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Banff, AB, Canada, 13–16 October 2015. [Google Scholar]
  22. Jaworski, W.; Wilk, P.; Zborowski, P.; Chmielowiec, W.; Lee, A.Y.G. Real-time 3D indoor localization. In Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan, 18–21 September 2017. [Google Scholar]
  23. Ye, H.B.; Gu, T.; Tao, X.P.; Lu, J. Scalable floor localization using barometer on smartphone. Wirel. Commun. Mob. Comput. 2016, 16, 2557–2571. [Google Scholar] [CrossRef] [Green Version]
  24. Kim, S.; Kim, J.; Han, D. Floor Detection Using a Barometer Sensor in a Smartphone. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan, 18–21 September 2017. [Google Scholar]
  25. Ye, H.B.; Gu, T.; Zhu, X.R.; Xu, J.W.; Tao, X.P.; Lu, J.; Jin, N. FTrack: Infrastructure-free floor localization via mobile phone sensing. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications, Lugano, Switzerland, 19–23 March 2012. [Google Scholar]
  26. Varshavsky, A.; LaMarca, A.; Hightower, J.; de Lara, E. The skyloc floor localization system. In Proceedings of the Fifth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom’07), White Plains, NY, USA, 19–23 March 2007. [Google Scholar]
  27. Woodman, O.; Harle, R. Pedestrian localisation for indoor environments. In Proceedings of the 10th International Conference on Ubiquitous Computing, Seoul, Korea, 21–24 September 2008; pp. 114–123. [Google Scholar]
  28. Ai, H.J.; Li, T.Z.; Wang, Y.F. Method to Identify Floor in WiFi Fingerprinting Location System. J. WUT Inf. Manag. Eng. 2015, 37, 269–273. [Google Scholar]
  29. Moder, T.; Hafner, P.; Wisiol, K.; Wieser, M. 3D indoor positioning with pedestrian dead reckoning and activity recognition based on Bayes filtering. In Proceedings of the 5th International Conference on Indoor Positioning and Indoor Navigation (IPIN), Busan, South Korea, 27–30 October 2014. [Google Scholar]
  30. Xu, Z.Y.; Wei, J.M.; Zhu, J.X.; Yang, W.J. A robust floor localization method using inertial and barometer measurements. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan, 18–21 September 2017. [Google Scholar]
  31. Gupta, P.; Bharadwaj, S.; Ramakrishnan, S.; Balakrishnan, J. Robust floor determination for indoor positioning. In Proceedings of the 2014 Twentieth National Conference on Communications (NCC), Kanpur, India, 28 February–2 March 2014. [Google Scholar]
  32. Gansemer, S.; Großmann, U.; Hakobyan, S. RSSI-based Euclidean Distance algorithm for indoor positioning adapted for the use in dynamically changing WLAN environments and multi-level buildings. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation (IPIN), Zurich, Switzerland, 15–17 September 2010. [Google Scholar]
  33. Ye, H.B.; Li, X.S.; Sheng, L.; Dong, K. CBSC: A crowdsensing system for automatic calibrating of barometers. J. Comput. Sci. Tech. 2019, 34, 1007–1019. [Google Scholar] [CrossRef]
  34. Haque, F.; Dehghanian, V.; Fapojuwo, A.O.; Nielsen, J. A Sensor Fusion-Based Framework for Floor Localization. Sens. J. IEEE 2019, 19, 623–631. [Google Scholar] [CrossRef]
  35. Elbakly, R.; Elhamshary, M.; Youssef, M. HyRise: A Robust and Ubiquitous Multi-Sensor Fusion-based Floor Localization System. ACM Interact. Mob. Wearable Ubiquitous Technol. 2018, 2, 1–23. [Google Scholar] [CrossRef]
  36. Ye, H.B.; Gu, T.; Tao, X.P.; Lu, J. F-Loc: Floor localization via crowdsourcing. In Proceedings of the 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS), Hsinchu, Taiwan, 16–19 December 2014. [Google Scholar]
  37. Yan, S.; Luo, H.Y.; Zhao, F.; Shao, W.H.; Li, Z.H.; Crivello, A. Wi-Fi RTT based indoor positioning with dynamic weighted multidimensional scaling. In Proceedings of the 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Pisa, Italy, 30 September–3 October 2019. [Google Scholar]
  38. Rajagopal, N.; Lazik, P.; Pereira, N.; Chayapathy, S.; Sinopoli, B.; Rowe, A. Enhancing indoor smartphone location acquisition using floor plans. In Proceedings of the 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), Porto, Portugal, 11–13 April 2018; pp. 278–289. [Google Scholar]
  39. Schröder, Y.; Heidorn, D.; Wolf, L. Investigation of Multipath Effects on Phase-based Ranging. In Proceedings of the 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Pisa, Italy, 30 September–3 October 2019; pp. 1–8. [Google Scholar]
  40. Shen, X.; Xu, K.; Sun, X.Q.; Wu, J.; Lin, J.T. Optimized indoor wireless propagation model in wifi-rof network architecture for rss-based localization in the internet of things. In Proceedings of the 2011 International Topical Meeting on Microwave Photonics jointly held with the 2011 Asia-Pacific Microwave Photonics Conference, Singapore, 18–21 October 2011. [Google Scholar]
  41. Liang, Y. Statistical Modeling and Applications on Wireless Signal Propagation in WLAN Indoor Location Systems. Master’s Thesis, Harbin Institute of Technology, Harbin, China, June 2009. [Google Scholar]
  42. Sadeghi, J.; Mahmood, S. A 3D Ubiquitous Multi-Platform Localization and Tracking System for Smartphones. Ph.D. Thesis, University of Toronto, Toronto, ON, Canada, November 2017. [Google Scholar]
  43. Chen, Y.S. The Mixed Floor Localization System Based on Barometer and WiFi. Master’s Thesis, Hangzhou Dianzi University, Hangzhou, China, March 2016. [Google Scholar]
  44. Muralidharan, K.; Khan, A.J.; Misra, A.; Balan, R.K.; Agarwal, S. Barometric phone sensors—More hype than hope! In Proceedings of the 15th Workshop on Mobile Computing Systems and Applications, Santa Barbara, CA, USA, 26–27 February 2014. [Google Scholar]
  45. Yu, M.; Xue, F.; Ruan, C.; Guo, H. Floor positioning method indoors with smartphone’s barometer. Geospat. Inf. Sci. 2019, 22, 138–148. [Google Scholar] [CrossRef]
  46. Alshami, I.H.; Ahmad, N.A.; Sahibuddin, S.; Firdaus, F. Adaptive Indoor Positioning Model Based on WLAN-Fingerprinting for Dynamic and Multi-Floor Environments. Sensors 2017, 17, 1789. [Google Scholar] [CrossRef]
  47. Fetzer, T.; Ebner, F.; Bullmann, M.; Deinzer, F.; Grzegorzek, M. Smartphone-Based Indoor Localization within a 13th Century Historic Building. Sensors 2018, 18, 4095. [Google Scholar] [CrossRef] [Green Version]
  48. Jimenez, A.R.; Seco, F.; Prieto, C.; Guevara, J. A comparison of Pedestrian Dead-Reckoning algorithms using a low-cost MEMS IMU. In Proceedings of the IEEE International Symposium on Intelligent Signal Processing, Budapest, Hungary, 26–28 August 2009. [Google Scholar]
  49. Shoaib, M.; Bosch, S.; Incel, O.D.; Scholten, H.; Havinga, P.J.M. A Survey of Online Activity Recognition Using Mobile Phones. Sensors 2015, 15, 2059–2085. [Google Scholar] [CrossRef]
  50. Wang, J.D.; Chen, Y.Q.; Hao, S.J.; Peng, X.H.; Hu, L.S. Deep Learning for Sensor-based Activity Recognition: A Survey. Pattern Recognit. Lett. 2019, 119, 3–11. [Google Scholar] [CrossRef] [Green Version]
  51. Lara, O.D.; Labrador, M.A. A Survey on Human Activity Recognition using Wearable Sensors. IEEE Commun. Surv. Tutor. 2013, 15, 1192–1209. [Google Scholar] [CrossRef]
  52. Liu, B.; Liu, H.J.; Jin, X.T.; Guo, D.F. Human activity recognition based on sensors of smart phone. Comput. Eng. Appl. 2016, 52, 188–193. [Google Scholar]
  53. Sun, Z.H. Research on Mobile Phone and Wearable Devices Based Human Activity Recognition Technologies. Ph.D. Thesis, University of Science and Technology of China, Hefei, China, May 2016. [Google Scholar]
  54. Liu, Y.; Jiang, H.Y.; Wang, S.L.; Wang, Y.B.; Chen, Y.P. Real-time human activity pattern recognition based on time domain features of acceleration. J. Shanghai Jiao Tong Univ. 2015, 49, 169–172. [Google Scholar]
  55. Li, D.; Chen, Y.Y.; Yao, Z.M.; Yang, H.L. Recognition system of human daily physical activity based on a 3D acceleration sensor. Instrum. Technol. 2013, 9, 1–5. [Google Scholar]
  56. Wang, S.C.; Liu, Y.; Hao, W.F.; Liu, K.H.; Lu, W.P. Walking pattern recognition based on inertial sensing. J. Electron. Meas. Instrum. 2014, 28, 630–636. [Google Scholar]
  57. Sun, L.; Zheng, Z.W.; He, T.; Li, F. Multifloor Wi-Fi Localization System with Floor Identification. Int. J. Distrib. Sens. Netw. 2015, 2015, 1–8. [Google Scholar] [CrossRef]
  58. Zhao, F.; Luo, H.Y.; Zhao, X.Q.; Pang, Z.B.; Park, H. HYFI: Hybrid Floor Identification Based on Wireless Fingerprinting and Barometric Pressure. IEEE Trans. Ind. Inform. 2017, 13, 330–341. [Google Scholar] [CrossRef] [Green Version]
  59. Barsocchi, P.; Chessa, S.; Furfari, F.; Francesco Potortı, F. Evaluating AAL solutions through competitive benchmarking: The localization competition. IEEE Pervasive Comput. Mag. 2013, 12, 72–79. [Google Scholar] [CrossRef]
Figure 1. The HAR classification algorithm flow.
Figure 1. The HAR classification algorithm flow.
Ijgi 10 00437 g001
Figure 2. The a_all′ data for different pedestrian activities.
Figure 2. The a_all′ data for different pedestrian activities.
Ijgi 10 00437 g002
Figure 3. Classification test of different classification algorithms and features.
Figure 3. Classification test of different classification algorithms and features.
Ijgi 10 00437 g003
Figure 4. The relationship between elevator running time (s) and height (m).
Figure 4. The relationship between elevator running time (s) and height (m).
Ijgi 10 00437 g004
Figure 5. Flow chart for detecting the floor change.
Figure 5. Flow chart for detecting the floor change.
Ijgi 10 00437 g005
Figure 6. Multi-floor experimental environment.
Figure 6. Multi-floor experimental environment.
Ijgi 10 00437 g006
Figure 7. Variation characteristics of a_all′ during the upward and downward movement of the elevator.
Figure 7. Variation characteristics of a_all′ during the upward and downward movement of the elevator.
Ijgi 10 00437 g007
Figure 8. Activity classification of eight testers.
Figure 8. Activity classification of eight testers.
Ijgi 10 00437 g008
Figure 9. Floor positioning effects of the method based on Wi-Fi signals and HAR-based floor positioning. (a) The overall floor positioning accuracy of the Wi-Fi signals was quite ideal during pedestrian walking, and the accuracy was about 92%; (b) The pedestrian was walking in the corridor of F3, taking a total of 180 steps.
Figure 9. Floor positioning effects of the method based on Wi-Fi signals and HAR-based floor positioning. (a) The overall floor positioning accuracy of the Wi-Fi signals was quite ideal during pedestrian walking, and the accuracy was about 92%; (b) The pedestrian was walking in the corridor of F3, taking a total of 180 steps.
Ijgi 10 00437 g009
Figure 10. Comparison between the proposed method and other methods based on barometric pressure and HAR. (a) Barometric pressure values during the test; (b) Human activities; (c) Actual floor.
Figure 10. Comparison between the proposed method and other methods based on barometric pressure and HAR. (a) Barometric pressure values during the test; (b) Human activities; (c) Actual floor.
Ijgi 10 00437 g010
Figure 11. HAR-aided floor change test.
Figure 11. HAR-aided floor change test.
Ijgi 10 00437 g011
Table 1. Distribution of 91 features.
Table 1. Distribution of 91 features.
IDFeaturesaxayazax′ay′az′a_allAir
1Mean F1F2F3F84
2mean(az)-mean(ay)/mean(ay)-mean(ax)F4
3Standard DeviationF5F6F7F8F9F10F83
4Max F11F85
5Min F12F86
6Max-Min F13F87
7Slope between Max and Min F14, F17F17F88
8Slope between Max and Min in a step F15
9Whether the positions of Max and Min are equalF16F19F16, F19
10Percentage of waveform integral F18
11Number of peaks F20F21
12Number of ascending intervals F22F28F34
13Number of descent intervals F23F29F35
14Average increase in each interval F24F30F36
15Average drop in each interval F25F31F37
16Maximum increase in each interval F26F32F38
17Maximum drop in each interval F27F33F39
18Median F40F41F42F73
19Correlation coefficient F43, F44F45, F44F43, F45
201 quantile F46F47F48F74
213rd quantile F49F50F51F75
22Quartile deviation F52F53F54F76
23Coefficient of variation F55F56F57F77
24Skewness coefficient F58F59F60F78
25Kurtosis coefficient F61F62F63F79
26Median absolute deviation F64F65F66F80
27Reconcile mean F67F68F69F81
28Sum of first derivative F70F71F72F82
29One step air pressure difference F89
30Two step air pressure difference F90
31Three step air pressure difference F91
Table 2. Sample data in RF of the floor stair library.
Table 2. Sample data in RF of the floor stair library.
F_idstep_numPF_numPF_rateif_ELPF_stepsfloor_h
B13420.2,0.6Y4,55
F13410.5Y45
F22810.5Y44
F32810.5Y44
F42810.5Y44
F500-----4
Table 3. ETRF table of elevator running data.
Table 3. ETRF table of elevator running data.
IdHeight(m)Time(s)
147
258
3811
41315.7
51720
62224
Table 4. Temp table of pedestrian activity states.
Table 4. Temp table of pedestrian activity states.
Timeup_down_rateup_stepsdown_stepsstay_stepswalk_steps
14:00:011/341000
14:00:012/342000
……
14:00:0917/3417002
……
14:00:1934/3434000
Table 5. Distribution of pedestrian misclassification steps and continuous misjudgment statistics.
Table 5. Distribution of pedestrian misclassification steps and continuous misjudgment statistics.
Number of Consecutive Error Steps
1234sum
Times47145066
Steps472815090
Percentage52%31%17%0100%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Qi, H.; Wang, Y.; Bi, J.; Cao, H.; Xu, S. Research on HAR-Based Floor Positioning. ISPRS Int. J. Geo-Inf. 2021, 10, 437. https://doi.org/10.3390/ijgi10070437

AMA Style

Qi H, Wang Y, Bi J, Cao H, Xu S. Research on HAR-Based Floor Positioning. ISPRS International Journal of Geo-Information. 2021; 10(7):437. https://doi.org/10.3390/ijgi10070437

Chicago/Turabian Style

Qi, Hongxia, Yunjia Wang, Jingxue Bi, Hongji Cao, and Shenglei Xu. 2021. "Research on HAR-Based Floor Positioning" ISPRS International Journal of Geo-Information 10, no. 7: 437. https://doi.org/10.3390/ijgi10070437

APA Style

Qi, H., Wang, Y., Bi, J., Cao, H., & Xu, S. (2021). Research on HAR-Based Floor Positioning. ISPRS International Journal of Geo-Information, 10(7), 437. https://doi.org/10.3390/ijgi10070437

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop