Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Independent shape component-based human activity recognition via Hidden Markov Model

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

In proactive computing, human activity recognition from image sequences is an active research area. In this paper, a novel human activity recognition method is proposed, which utilizes Independent Component Analysis (ICA) for activity shape information extraction from image sequences and Hidden Markov Model (HMM) for recognition. Various human activities are represented by shape feature vectors from the sequence of activity shape images via ICA. Based on these features, each HMM is trained and activity recognition is achieved by the trained HMMs of different activities. Our recognition performance has been compared to the conventional method where Principal Component Analysis (PCA) is typically used to derive activity shape features. Our results show that superior recognition is achieved with the proposed method especially for activities (e.g., skipping) that cannot be easily recognized by the conventional method. Furthermore, by employing Linear Discriminant Analysis (LDA) on IC features, the recognition results further improved significantly in the recognition performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Niu F, Abdel-Mottaleb M (2004) View-invariant human activity recognition based on shape and motion features. In: Proceedings of the IEEE sixth international symposium on multimedia software engineering, pp 546–556

  2. Niu F, Abdel-Mottaleb M (2005) HMM-based segmentation and recognition of human activities from video sequences. In: Proceedings of IEEE international conference on multimedia & expo, pp 804–807

  3. Robertson N, Reid I (2006) A general method for human activity recognition in video. Comput Vis Image Underst 104(2):232–248

    Article  Google Scholar 

  4. Gavrila D (1999) The visual analysis of human movement: a survey. Comput Vis Image Underst 73:82–98

    Article  MATH  Google Scholar 

  5. Yamato J, Ohya J, Ishii K (1992) Recognizing human action in time-sequential images using hidden Markov model. In: Proceedings of IEEE international conference on computer vision and pattern recognition, pp 379–385

  6. Cohen I, Lim H (2003) Inference of human postures by classification of 3D human body shape. In: IEEE international workshop on analysis and modeling of faces and gestures, pp 74–81

  7. Carlsson S, Sullivan J (2002) Action recognition by shape matching to key frames. In: IEEE computer society workshop on models versus exemplars in computer vision, pp 263–270

  8. Nakata T (2006) Recognizing human activities in video by multi-resolutional optical flow. In: Proceedings of international conference on intelligent robots and systems, pp 1793–1798

  9. Sun X, Chen C, Manjunath BS (2002) Probabilistic motion parameter models for human activity recognition. In: Proceedings of 16th international conference on pattern recognition, pp 443–450

  10. Masound O, Papanikolopoulos N (2003) Recognizing human activities. In: IEEE conference on advanced video and signal based surveillance, Miami, Florida, pp 157–162

  11. Ben-Arie ZW, Pandit P, Rajaram S (2002) Human activity recognition using multidimensional indexing. IEEE Trans Pattern Anal Mach Intell 24(8):1091–1104

    Article  Google Scholar 

  12. Belongie S, Malik J (2000) Matching with shape contexts. In: IEEE workshop on content-based access of image and video libraries

  13. Bookstein FL (1978) The measurement of biological shape and shape change. Lecture notes in biomathematics

  14. Bremermann HJ (1971) Cybernetic functionals and fuzzy sets. In: IEEE systems, man and cybernetics group annual symposium, pp 248–254

  15. Carlsson S (1999) Order structure, correspondence and shape based categories. Shape contour and grouping in computer vision. LNCS, vol 1681. Springer, Berlin, pp 58–71

  16. Sclaroff S (1996) Deformable prototypes for encoding shape categories in image databases. Pattern Recogn 30(4):627–640

    Article  Google Scholar 

  17. Pujol JV, Lumbreras F, Villanueva JJ, (2001) Topological principal component analysis for face encoding and recognition. Pattern Recogn Lett 22:769–776

    Article  MATH  Google Scholar 

  18. Kim HC, Kim D, Bang SY (2002) Face recognition using the mixture-of-eigenfaces method. Pattern Recogn Lett 23:1549–1558

    Article  MATH  Google Scholar 

  19. Gottumukkal R, Asari VK (2004) An improved face recognition technique based on modular PCA approach. Pattern Recogn Lett 24:429–436

    Article  Google Scholar 

  20. Bartlett MS, Lades HM, Sejnowski TJ (1998) Independent component representations recognition. In: SPIE symposium on electronic imaging: science and technology, human vision and electronic imaging III, San Jose, CA

  21. Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13:1450–1464

    Article  Google Scholar 

  22. Liu C, Wechsler H (1999) Comparative assessment of independent component analysis (ICA) for face recognition. In: International conference on audio and video based biometric person authentication, Washington, DC

  23. Kwon W, Lee TW (2004) Phoneme recognition using ICA-based feature extraction and transformation. Signal Process 84(6):1005–1019

    Article  MATH  MathSciNet  Google Scholar 

  24. Lee SI, Batzoglou S (2003) Application of independent component analysis to microarrays. Genome Biol 4(11):R76.1–21

    Article  Google Scholar 

  25. Makeig S, Bell AJ, Jung TP, Sejnowski TJ (1996) Independent component analysis of electroencephalographic data. Adv Neural Inf Process Syst 8:145–151

    Google Scholar 

  26. Jung T, Makeig S, Westerfield M, Townsend J, Courchesne E, Sejnowski TJ (2001) Analysis and visualization of single-trial event-related potentials. Hum Brain Mapp 14:166–185

    Article  Google Scholar 

  27. Elgammal DH, Davis L (2000) Non-parametric model for background subtraction. In: 6th European conference on computer vision, Dublin, Ireland

  28. Cardoso J-F (1997) Infomax and maximum likelihood for source separation. IEEE Lett Signal Process 4:112–114

    Article  Google Scholar 

  29. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  30. Kwak K-C, Pedrycz W (2007) Face recognition using an enhanced independent component analysis approach. IEEE Trans Neural Netw 18(2):530–541

    Article  Google Scholar 

  31. Kanungu T, Mount DM, Netanyahu N, Piatko C, Silverman R, Wu AY (2000) The analysis of a simple k-means clustering algorithm. In: Proceedings of 16th ACM symposium on computational geometry, pp 101–109

  32. Linde Y, Buzo A, Gray R (1980) An algorithm for vector quantizer design. IEEE Trans Commun 28(1):84–94

    Article  Google Scholar 

  33. Baum E, Petrie T, Soules G, Weiss N (1970) A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann Math Stat 41:164–171

    Article  MATH  MathSciNet  Google Scholar 

  34. Baum E, Eagon J (1967) An inequality with applications to statistical estimation for probabilistic functions of Markov processes and to a model for ecology. Am Math Soc Bull 73:360–363

    Article  MATH  MathSciNet  Google Scholar 

  35. Lawrence R, Rabiner A (1989) Tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286

    Article  Google Scholar 

  36. Bregler C, König Y (1994) Eigenlips for robust speech recognition. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing, Adelaide, Australia, pp 669–672

  37. Hu J, Brown MK, Turin W (1996) HMM based on-line handwriting recognition. IEEE Trans Pattern Anal Mach Intell 18(10):1039–1045

    Article  Google Scholar 

  38. Eickeler S, Kosmala A, Rigoll G (1998) Hidden Markov model based online gesture recognition. In: Proceedings of international conference on pattern recognition (ICPR), pp 1755–1757

  39. Iwai Y, Hata T, Yachida M (1997) Gesture recognition based on subspace method and hidden Markov model. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, pp 960–966

  40. Gorelick L, Blank M, Shechtman E, Irani M, Basri R (2007) Actions as space-time shapes. IEEE Trans Patt Anal Mach Intell 29(12):2247–2253

    Article  Google Scholar 

  41. Schuldt C, Laptev I, Caputo B (2004) Recognizing human actions: a local SVM approach. In: Proceedings of the 17th international conference on pattern recognition (ICPR’04), pp 32–36

Download references

Author information

Authors and Affiliations

  1. Department of Biomedical Engineering, Kyung Hee University, Seocheon-dong, Giheung-gu, Yongin-si, Gyeonggi-do, 446-701, Republic of Korea

    M. Zia Uddin, J. J. Lee & T.-S. Kim

Authors
  1. M. Zia Uddin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. J. Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. T.-S. Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to T.-S. Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zia Uddin, M., Lee, J.J. & Kim, TS. Independent shape component-based human activity recognition via Hidden Markov Model. Appl Intell 33, 193–206 (2010). https://doi.org/10.1007/s10489-008-0159-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-008-0159-2

Keywords

Search

Navigation