Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3266157.3266219acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiwoarConference Proceedingsconference-collections
research-article

Combining off-the-shelf Image Classifiers with Transfer Learning for Activity Recognition

Published: 20 September 2018 Publication History

Abstract

Human Activity Recognition (HAR) plays an important role in many real world applications. Currently, various techniques have been proposed for sensor-based "HAR" in daily health monitoring, rehabilitative training and disease prevention. However, non-visual sensors in general and wearable sensors in specific have several limitations: acceptability and willingness to use wearable sensors; battery life; ease of use; size and effectiveness of the sensors. Therefore, adopting vision-based human activity recognition approach is more viable option since its diversity would enable the application to be deployed in wide range of domains. The most popular technique of vision based activity recognition, Deep Learning, however, requires huge domain-specific datasets for training which, is time consuming and expensive. To address this problem this paper proposes a Transfer Learning technique by adopting vision-based approach to "HAR" by using already trained Deep Learning models. A new stochastic model is developed by borrowing the concept of "Dirichlet Alloaction" from Latent Dirichlet Allocation (LDA) for an inference of the posterior distribution of the variables relating the deep learning classifiers predicted labels with the corresponding activities. Results show that an average accuracy of 95.43% is achieved during training the model as compared to 74.88 and 61.4% of Decision Tree and SVM respectively.

References

[1]
D Abowd, Anind K Dey, Robert Orr, and Jason Brotherton. 1998. Context-awareness in wearable and ubiquitous computing. Virtual Reality 3, 3 (1998), 200--211.
[2]
David M Blei, Alp Kucukelbir, and Jon D McAuliffe. 2017. Variational inference: A review for statisticians. J. Amer. Statist. Assoc. 112, 518 (2017), 859--877.
[3]
Geoffrey E Hinton, Simon Osindero, and Yee-Whye Teh. 2006. A fast learning algorithm for deep belief nets. Neural computation 18, 7 (2006), 1527--1554.
[4]
Geoffrey E Hinton and Ruslan R Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. science 313, 5786 (2006), 504--507.
[5]
Jui-Ting Huang, Jinyu Li, Dong Yu, Li Deng, and Yifan Gong. 2013. Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 7304--7308.
[6]
Earnest Paul Ijjina and C Krishna Mohan. 2015. Human action recognition based on motion capture information using fuzzy convolution neural networks. In Advances in Pattern Recognition (ICAPR), 2015 Eighth International Conference on. IEEE, 1--6.
[7]
Alexey Grigorevich Ivakhnenko. 1971. Polynomial theory of complex systems. IEEE transactions on Systems, Man, and Cybernetics 4 (1971), 364--378.
[8]
Oscar D Lara and Miguel A Labrador. 2013. A survey on human activity recognition using wearable sensors. IEEE Communications Surveys and Tutorials 15, 3 (2013), 1192--1209.
[9]
Fabian Nater, Tatiana Tommasi, Helmut Grabner, Luc Van Gool, and Barbara Caputo. 2011. Transferring activities: Updating human behavior analysis. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on. IEEE, 1737--1744.
[10]
Hossein Rahmani and Ajmal Mian. 2016. 3d action recognition from novel viewpoints. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1506--1515.
[11]
Tim Salimans, Diederik Kingma, and Max Welling. 2015. Markov chain monte carlo and variational inference: Bridging the gap. In International Conference on Machine Learning. 1218--1226.
[12]
Allah Bux Sargano, Plamen Angelov, and Zulfiqar Habib. 2017. A comprehensive review on handcrafted and learning-based action representation approaches for human activity recognition. Applied Sciences 7, 1 (2017), 110.
[13]
Lin Sun, Kui Jia, Tsung-Han Chan, Yuqiang Fang, Gang Wang, and Shuicheng Yan. 2014. DL-SFA: deeply-learned slow feature analysis for action recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2625--2632.
[14]
Chen Wu, Amir Hossein Khalili, and Hamid Aghajan. 2010. Multiview activity recognition in smart homes with spatiotemporal features. In Proceedings of the Fourth ACM/IEEE International Conference on Distributed Smart Cameras. ACM, 142--149.
[15]
Kristina Yordanova, Frank Krüger, and Thomas Kirste. 2018. Providing Semantic Annotation for the CMU Grand Challenge Dataset. In Workshops Proceedings of the IEEE International Conference on Pervasive Computing and Communications. Athens, Greece.
[16]
Kristina Yordanova, Frank Krüger, and Thomas Kirste. 2018. Semantic Annotation for the CMU-MMAC Dataset. University Library, University of Rostock. http://purl.uni-rostock.de/rosdok/id00000163.
[17]
Dong Yu and Li Deng. 2011. Deep learning and its applications to signal and information processing {exploratory dsp}. IEEE Signal Processing Magazine 28, 1 (2011), 145--154.
[18]
Sheng Yu, Yun Cheng, Songzhi Su, Guorong Cai, and Shaozi Li. 2017. Stratified pooling based deep convolutional neural networks for human action recognition. Multimedia Tools and Applications 76, 11 (2017), 13367--13382.
[19]
Ozgur Yurur, Chi Liu, and Wilfrido Moreno. 2014. A survey of context-aware middleware designs for human activity recognition. IEEE Communications Magazine 52, 6 (2014), 24--31.

Cited By

View all
  • (2024)De-anonymizing VR Avatars using Non-VR Motion Side-channelsProceedings of the 17th ACM Conference on Security and Privacy in Wireless and Mobile Networks10.1145/3643833.3656135(54-65)Online publication date: 27-May-2024
  • (2019)Fusing Object Information and Inertial Data for Activity RecognitionSensors10.3390/s1919411919:19(4119)Online publication date: 23-Sep-2019

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
iWOAR '18: Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction
September 2018
148 pages
ISBN:9781450364874
DOI:10.1145/3266157
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

  • Fraunhofer IGD: Fraunhofer Institute for Computer Graphics Research IGD
  • Rostock: University of Rostock

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Convolutional Neural Networks (CNNs)
  2. Dirichlet Distribution
  3. Human Activity Recognition (HAR)
  4. Latent Dirichlet Allocation (LDA)
  5. Probabilistic Graphical Models (PGM)
  6. Transfer Learning
  7. Variational Inference

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

iWOAR '18

Acceptance Rates

iWOAR '18 Paper Acceptance Rate 15 of 28 submissions, 54%;
Overall Acceptance Rate 46 of 73 submissions, 63%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 24 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)De-anonymizing VR Avatars using Non-VR Motion Side-channelsProceedings of the 17th ACM Conference on Security and Privacy in Wireless and Mobile Networks10.1145/3643833.3656135(54-65)Online publication date: 27-May-2024
  • (2019)Fusing Object Information and Inertial Data for Activity RecognitionSensors10.3390/s1919411919:19(4119)Online publication date: 23-Sep-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media