Cited By
View all- Ahanger TAlqahtani AAlharbi MAlgashami A(2022)Cognitive decision-making in smart police industryThe Journal of Supercomputing10.1007/s11227-022-04392-978:10(12834-12860)Online publication date: 1-Jul-2022
HCAR: : Human continuous activity recognition using latent structure features
Authors: 
Kun Zhao, Xiaoxian Yang, Wei Xi, Zhiping Jiang, Xiaohong Wang, Zhi Wang, Xinyuan Ji, Zhao Yang, Jizhong ZhaoAuthors Info & Claims
Abstract
With the rapid development of the Internet of Things and the improvement of computing power, edge‐computing becomes an emergency computing paradigm that communicates between the terminal and cloud. One of the most representative works of edge‐computing is to achieve human‐activity recognition at the edge side, as it has lower latency and it could reduce transmission costs, compared with processing at the cloud side. However, existing approaches have many drawbacks: (1) they can merely recognize separated actions as it is incompetence for continuous activity recognition; and (2) they are not robust to action transformation and environmental noise due to the value‐feature‐based matching strategy. In this paper, we propose HCAR, a structure‐feature–based human continuous activity recognition system, which is insensitive to action transformation and environmental noise. Firstly, we leverage word2vec to embed the CSI sequences to CSI value space. Secondly, we select representative features from the embedded vectors and use HMM‐LDA to cluster them into different action categories. Lastly, for each new coming sequence, we calculate the Hellinger distance and bi‐modality coefficient to different categories and then identify the corresponding action(s). We implement HCAR by Intel 5300 NIC to evaluate the activity recognition precision in different cases. The experiments show that HCAR can recognize actions corresponding to the unsegmented CSI sequence with high accuracy, ie, >90%.
Graphical Abstract
Leveraging Latent Dirichlet Allocation, HCAR can recognize continuous ativities without segmentation.
References
[1]
Chen Z, Zhang L, Cao Z, Guo J. Distilling the knowledge from handcrafted features for human activity recognition. IEEE Trans Ind Inf. 2018;14(10)4334‐4342.
[2]
Gao H, Huang W, Yang X. Applying probabilistic model checking to path planning in an intelligent transportation system using mobility trajectories and their statistical data. Intell Autom Soft Comput(Autosoft). 2019;25(3)547‐559.
[3]
Gao H, Huang W, Duan Y, Yang X, Zou Q. Research on cost‐driven services composition in an uncertain environment. J Int Technol(JIT). 2019;20(3)755‐769.
[4]
ur Rehman MH, Sun C, Wah TY, Iqbal A, Jayaraman PP. Opportunistic computation offloading in mobile edge cloud computing environments. Paper presented at: 2016 17th IEEE International Conference on Mobile Data Management (MDM); 2016; Porto, Portugal.
[5]
Samarah S, Zamil MGA, Rawashdeh M, Hossain MS, Muhammad G, Alamri A. Transferring activity recognition models in fog computing architecture. J Parallel Distrib Comput. 2018;122:122‐130.
[6]
Uddin MZ. A wearable sensor‐based activity prediction system to facilitate edge computing in smart healthcare system. J Parallel Distrib Comput. 2019;123:46‐53.
[7]
Presti LL, La Cascia M. 3D skeleton‐based human action classification: a survey. Pattern Recognition. 2016;53:130‐147.
[8]
Ye M, Wang X, Yang R, Ren L, Pollefeys M. Accurate 3D pose estimation from a single depth image. Paper presented at: 2011 International Conference on Computer Vision; 2011; Barcelona, Spain.
[9]
Sun M, Kohli P, Shotton J. Conditional regression forests for human pose estimation. Paper presented at: 2012 IEEE Conference on Computer Vision and Pattern Recognition; 2012; Providence, RI.
[10]
Yang L, Chen Y, Li X‐Y, Xiao C, Li M, Liu Y. Tagoram: real‐time tracking of mobile RFID tags to high precision using COTS devices. In: Proceedings of the 20th Annual International Conference on Mobile Computing and Networking; 2014; Maui, HI.
[11]
Ding H, Qian C, Han J, et al. Device‐free detection of approach and departure behaviors using backscatter communication. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing; 2016; Heidelberg, Germany.
[12]
Wang Y, Liu J, Chen Y, Gruteser M, Yang J, Liu H. E‐eyes: device‐free location‐oriented activity identification using fine‐grained WiFi signatures. In: Proceedings of the 20th Annual International Conference on Mobile Computing and Networking; 2014; Maui, HI.
[13]
Okeyo G, Chen L, Wang H, Sterritt R. Dynamic sensor data segmentation for real‐time knowledge‐driven activity recognition. Pervasive Mob Comput. 2014;10:155‐172.
[14]
Reddy S, Mun M, Burke J, Estrin D, Hansen M, Srivastava M. Using mobile phones to determine transportation modes. ACM Trans Sens Netw (TOSN). 2010;6(2).
[15]
Pu Q, Gupta S, Gollakota S, Patel S. Gesture Recognition Using Wireless Signals. ACM MobiCom. 2013;18(4):27‐38.
[16]
Liu W, Luo X, Liu Y, Liu J, Liu M, Shi YQ. Localization algorithm of indoor Wi‐Fi access points based on signal strength relative relationship and region division. Comput Mater Continua. 2018;55(1):71‐93.
[17]
Tse D, Viswanath P. Fundamentals of Wireless Communication. New York, NY: Cambridge University Press; 2005.
[18]
Blei DM, Lafferty JD. Topic models. In: Text Mining: Classification, Clustering, and Applications. Boca Raton, FL: Chapman and Hall/CRC; 2009.
[19]
Liu M, Liu H, Chen C. Enhanced skeleton visualization for view invariant human action recognition. Pattern Recognition. 2017;68:346‐362.
[20]
Wang P, Li W, Li C, Hou Y. Action recognition based on joint trajectory maps with convolutional neural networks. Knowl‐Based Syst. 2018;158:43‐53.
[21]
Feichtenhofer C, Pinz A, Wildes R. Spatiotemporal residual networks for video action recognition. Paper presented at: Advances in Neural Information Processing Systems 29 (NIPS 2016); 2016; Barcelona, Spain.
[22]
Du Y, Wang W, Wang L. Hierarchical recurrent neural network for skeleton based action recognition. Paper presented at: IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2015; Boston, MA.
[23]
Liu J, Shahroudy A, Xu D, Kot AC, Wang G. Skeleton‐based action recognition using spatio‐temporal LSTM network with trust gates. IEEE Trans Pattern Anal Mach Intell. 2018;40(12):3007‐3021.
[24]
Zhao Y, Patwari N, Phillips JM, Venkatasubramanian S. Radio tomographic imaging and tracking of stationary and moving people via kernel distance. Paper presented at: 2013 ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN); 2013; Philadelphia, PA.
[25]
Zhao Y, Patwari N. Noise reduction for variance‐based device‐free localization and tracking. Paper presented at: 2011 8th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks; 2011; Salt Lake City, UT.
[26]
Wilson J, Patwari N. Radio tomographic imaging with wireless networks. IEEE Trans Mob Comput. 2010;9(5):621‐632.
[27]
Sigg S, Blanke U, Troster G. The telepathic phone: frictionless activity recognition from WiFi‐RSSI. Paper presented at: 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom); 2014; Budapest, Hungary.
[28]
Sigg S, Shi S, Büsching F, Ji Y, Wolf L. Leveraging RF‐channel fluctuation for activity recognition. In: Proceedings of International Conference on Advances in Mobile Computing & Multimedia; 2013; Vienna, Austria.
[29]
Wang G, Zou Y, Zhou Z, Wu K, Ni LM. We can hear you with Wi‐Fi! In: Proceedings of the 20th Annual International Conference on Mobile Computing and Networking; 2014; Maui, HI.
[30]
Xi W, Zhao J, Li X‐Y, et al. Electronic frog eye: counting crowd using WiFi. Paper presented at: IEEE INFOCOM 2014 ‐ IEEE Conference on Computer Communications; 2014; Toronto, ON.
[31]
Xi W, Huang D, Zhao K, et al. Device‐free human activity recognition using CSI. In: Proceedings of the 1st Workshop on Context Sensing and Activity Recognition; 2015; Seoul, South Korea.
[32]
Wu D, Wang Z. Applying online feature selection for fall detection. Paper presented at: 2016 IEEE International Conference on Imaging Systems and Techniques (IST); 2016; Chania, Greece.
[33]
Halperin D, Hu W, Sheth A, Wetherall D. Predictable 802.11 packet delivery from wireless channel measurements. ACM SIGCOMM Comput Commun Rev. 2011;41(4):159‐170.
[34]
Church KW. Word2Vec. Nat Lang Eng. 2017;23(1):155‐162.
[35]
Radim R. Gensim topic modeling for humans. https://radimrehurek.com/gensim/. Accessed April 4, 2019.
[36]
Evangelopoulos NE. Latent semantic analysis. Ann Rev Inf Sci Technol. 2013;4(6):683‐692.
[37]
Peng H, Long F, Ding C. Feature selection based on mutual information: criteria of max‐dependency, max‐relevance, and min‐redundancy. IEEE Trans Pattern Anal Mach Intell. 2005;8:1226‐1238.
[38]
Griffiths TL, Steyvers M, Blei DM, Tenenbaum JB. Integrating topics and syntax. In: Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press; 2005:537‐544.
[39]
Knapp TR. Bimodality revisited. J Modern Appl Stat Methods. 2007;6(1).
[40]
Taylor GW, Hinton GE, Roweis ST. Modeling human motion using binary latent variables. In: Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press; 2007:1345‐1352.
[41]
Shen S, Wang H, Roy Choudhury R. I am a smartwatch and I can track my user's arm. In: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services; 2016; Singapore.
[42]
Lee J, Shin SY. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques; 1999; Los Angeles, CA.
[43]
Gill J. Bayesian Methods: A Social and Behavioral Sciences Approach. Boca Raton, FL: Chapman and Hall/CRC; 2014.
[44]
Hazimeh H, Zhai C. Axiomatic analysis of smoothing methods in language models for pseudo‐relevance feedback. In: Proceedings of the 2015 International Conference on the Theory of Information Retrieval; 2015; Northampton, MA.
[45]
Tang J, Meng Z, Nguyen XL, Mel Q, Zhang M. Understanding the limiting factors of topic modeling via posterior contraction analysis. Paper presented at: 31st International Conference on Machine Learning (ICML 2014); 2014; Beijing, China.
Index Terms
- HCAR: Human continuous activity recognition using latent structure features
Index terms have been assigned to the content through auto-classification.
Recommendations
Recognizing action units for facial expression analysis
Multimodal interface for human-machine communicationMost automatic expression analysis systems attempt to recognize a small set of prototypic expressions, such as happiness, anger, surprise, and fear. Such prototypic expressions, however, occur rather infrequently. Human emotions and intentions are more ...
Collaborative expression representation using peak expression and intra class variation face images for practical subject-independent emotion recognition in videos
This paper proposes a facial expression recognition (FER) method in videos. The proposed method automatically selects the peak expression face from a video sequence using closeness of the face to the neutral expression. The severely non-frontal faces ...
Recognizing Action Units for Facial Expression Analysis
Most automatic expression analysis systems attempt to recognize a small set of prototypic expressions, such as happiness, anger, surprise, and fear. Such prototypic expressions, however, occur rather infrequently. Human emotions and intentions are more ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© 2019 John Wiley & Sons, Ltd.
Publisher
John Wiley & Sons, Inc.
United States
Publication History
Published: 13 June 2021
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 23 Sep 2024
Other Metrics
Citations
Cited By
View all- Ahanger TAlqahtani AAlharbi MAlgashami A(2022)Cognitive decision-making in smart police industryThe Journal of Supercomputing10.1007/s11227-022-04392-978:10(12834-12860)Online publication date: 1-Jul-2022
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in