poster

An adaptive sensor fusion based objects tracking and human action recognition for interactive virtual environments

Authors:

Hyun S. YangAuthors Info & Claims

VRCAI '09: Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry

Pages 357 - 362

https://doi.org/10.1145/1670252.1670332

Published: 14 December 2009 Publication History

Get Access

Abstract

As augmented reality is advanced, more smart and sophisticated virtual environments are required. The purpose of the present work is to enable person in an interactive virtual environment to simultaneously and conveniently interact with virtual agents. In this paper, we propose a realtime system that track people in virtual environment robustly and recognize their action view-invariantly based on adaptive sensor fusion approach between laser scanner and video camera. To track the objects precisely, we match objects of video camera to the datum of laser scanner adaptively. Then we recognize human action view-invariantly based on a motion history image and a moving trajectory of objects. To evaluate the performance of the proposed system, we employed it augmented reality application where users can interact with a virtual pet, named cho-rong-i. The results confirm that reliable tracking is archived and persons' actions can be recognized for interactive virtual environment.

References

[1]

Aggarwal, J. K. and Cai, Q. 1999, Human Motion Analysis: A Review, Computer Vision and Image Understanding: CVIU, vol. 73, no. 3, pp. 428--440.

Digital Library

Google Scholar

[2]

Bobick, A. and Davis, J. 2001, The recognition of human movement using temporal templates, IEEE Trans. Patt. Analy. And Mach. Intell., 23(3):257--267.

Digital Library

Google Scholar

[3]

Choi, J., Cho, Y., Cho, K., Bae, S. and Yang, H. 2006, A view-based Multiple Objects Tracking and human Action Recognition for Interactive virtual Environments, The International Jornal of Virtual Reality, 5(3):1--6.

Google Scholar

[4]

Henry, T., Janapriya, E. and Silva, L. 2003, An Automatic System for Multiple Human Tracking&Actions Recognition in Office Environment, IEEE Int. Conf. Acoustics, Speech, Signal Processing.

Google Scholar

[5]

Jacques Jr, J., Jung, C. and Musse, S. 2006, A Background Subtraction Model Adapted to Illumination Changes, IEEE International Conference on Image Processing.

Google Scholar

[6]

Krumm, J., Harris, S., Meyers, B., Brumitt, B., Hale, M. and Shafer, S. 2000, Multi-Camera Multi-Person Tracking for EasyLiving, IEEE Workshop on Visual Surveillance, (July).

Digital Library

Google Scholar

[7]

Park, J., Tabb, A. and Kak, A. C. 2006, Hierarchical Data Structure for Real-Time Background Subtraction, IEEE International Conference on Image Processing.

Google Scholar

[8]

Ryan, P. 2005, Count the steps to motivate walking, Functional u, vol. 3, No. 3, pp 12--16.

Google Scholar

[9]

Wren, C., Azarbayejani, A., Darell, T. and Pentland, A. 1997. Pfinder: Real-time tracking of the human body, IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 780--785.

Digital Library

Google Scholar

Cited By

View all

Ozturk OMatsunami TSuzuki YYamasaki TAizawa K(2018)Real-time tracking of humans and visualization of their future footsteps in public indoor environmentsMultimedia Tools and Applications10.1007/s11042-010-0691-z59:1(65-88)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0691-z
Nam YRho SPark J(2018)Intelligent video surveillance systemMultimedia Tools and Applications10.1007/s11042-010-0677-x57:2(315-334)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0677-x

Index Terms

An adaptive sensor fusion based objects tracking and human action recognition for interactive virtual environments
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking
      2. Computer vision tasks
        Scene understanding
        Vision for robotics
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

A lightweight and efficient system for tracking handheld objects in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

While the content of virtual reality (VR) has grown explosively in recent years, the advance of designing user-friendly control interfaces in VR still remains a slow pace. The most commonly used device, such as gamepad or controller, has fixed shape and ...
Robust object tracking via multi-cue fusion

A long-term object tracking method based on calibrated binocular cameras by fusing information of the two channels and binocular geometry constraints is proposed.The stereo filter which is built based on the epipolar geometry of the binocular cameras is ...
An adaptive particle filter tracking method based on homography and common FOV
RACS '12: Proceedings of the 2012 ACM Research in Applied Computation Symposium

In object tracking, methods based on a particle filter are widely used, but the technique alone often fails in various situations. Sometimes multi-camera systems using homography are tried to solve problems like occlusion. We propose an adaptive ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

VRCAI '09: Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry

December 2009

374 pages

ISBN:9781605589121

DOI:10.1145/1670252

Editor:
Stephen N. Spencer
University of Washington
,
General Chairs:
Masayuki Nakajima
Tokyo Institute of Technology, Japan
,
Enhua Wu
University of Macau & Academia Sinica, China
,
Program Chairs:
Kazunori Miyata
JAIST, Japan
,
Daniel Thalmann
Ecole Polytechnique Federale de Lausanne, Switzerland
,
Zhiyong Huang
Institute for Infocomm Research, Singapore

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

Ministry of Land, Infrastructure and Transport

Conference

VRCAI '09

Sponsor:

SIGGRAPH

VRCAI '09: Virtual Reality Continuum and its Applications in Industry

December 14 - 15, 2009

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
260
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ozturk OMatsunami TSuzuki YYamasaki TAizawa K(2018)Real-time tracking of humans and visualization of their future footsteps in public indoor environmentsMultimedia Tools and Applications10.1007/s11042-010-0691-z59:1(65-88)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0691-z
Nam YRho SPark J(2018)Intelligent video surveillance systemMultimedia Tools and Applications10.1007/s11042-010-0677-x57:2(315-334)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0677-x

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A lightweight and efficient system for tracking handheld objects in virtual reality

Robust object tracking via multi-cue fusion

An adaptive particle filter tracking method based on homography and common FOV