research-article

Human shape reconstruction via graph cuts for voxel-based markerless motion capture in intelligent environment

Authors:

Masamichi Shimosaka,

Kazuhiko Murasaki,

Taketoshi Mori,

Tomomasa SatoAuthors Info & Claims

IUCS '09: Proceedings of the 3rd International Universal Communication Symposium

Pages 230 - 236

https://doi.org/10.1145/1667780.1667828

Published: 03 December 2009 Publication History

Abstract

In this paper, we propose a robust and real-time 3D human shape reconstruction method in daily life spaces to make practical voxel-based motion capture systems. Our algorithm extracts human silhouette and reconstructs human shape via volume intersection from multi view point images. The method presented in this paper is based on energy minimization via graph cuts, and its main features are: 1) to reduce the background subtraction errors caused by background clutter, 2) to have robustness for influences of shadows, 3) to segment the foreground region even if moving objects other than human. The precise human shape reconstructed by the method improves the accuracy of human pose estimation. Especially, 3) leads to enhance the range of application of the voxel-based human pose estimation. We demonstrate the effectiveness of our approach in terms of both quantitative and qualitative performance where strong shadows appear and moving objects are present in intelligent environment.

References

[1]

A. Balan, L. Sigal, M. Black, J. Davis, and H. Haussecker, "Detailed human shape and pose from images," in Proc. of CVPR 2007, pp. 1--8.

[2]

P. Felzenszwalb and D. Huttenlocher, "Efficient matching of pictorial structures," in Proc. of CVPR 2000, vol. 2, pp. 66--73.

[3]

A. Agarwal and B. Triggs, "3D human pose from silhouettes by relevance vector regression," in Proc. of CVPR 2004, vol. 2, pp. 882--888.

Digital Library

[4]

G. Shakhnarovich, T. Darrell, and P. Indyk, Nearest-Neighbor Methods in Learning and Vision: Theory and Practice. The MIT Press, 2006.

Digital Library

[5]

Y. Sagawa, M. Shimosaka, T. Mori, and T. Sato, "Fast online human pose estimation via 3D voxel data," in Proc. of IROS 2007, pp. 1034--1040.

[6]

M. Shimosaka, Y. Sagawa, T. Mori, and T. Sato, "3D voxel based online human pose estimation via robust and efficient hashing," in Proc. of ICRA 2009, pp. 3577--3582.

Digital Library

[7]

Y. Furukawa and J. Ponce, "Accurate, dense, and robust multi-view stereopsis," in Proc. of CVPR 2007, pp. 1--8.

[8]

A. Laurentini, "How far 3D shapes can be understood from 2D silhouettes," IEEE Trans, on PAMI, vol. 17, no. 2, pp. 188--195, 1995.

Digital Library

[9]

Y. Boykov and M. Jolly, "Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images," in Proc. of ICCV 2001, pp. 105--112.

[10]

N. Otsu, "A threshold selection method from gray-level histograms," IEEE Trans, on SMC, vol. 9, no. 1, pp. 62--66, 1979.

[11]

S. Friedman N, Russel, "Image segmentation in video sequences: a probabilistic approach," in Proc. of UAI 1997, pp. 175--181.

Digital Library

[12]

A. Elgammal, R. Duraiswami, D. Harwood, L. Davis, R. Duraiswami, and D. Harwood, "Background and foreground modeling using nonparametric kernel density estimation for visual surveillance," in Proc. of IEEE 2002, pp. 1151--1163.

[13]

Y. Boykov and V. Kolmogorov, "An experimental comparison of Min-Cut/Max-Flow algorithms for energy minimization in vision," IEEE Trans. on PAMI, vol. 26, no. 9, pp. 1124--1137, 2004.

Digital Library

[14]

J. Sun, W. Zhang, X. Tang, and H. Shum, "Background cut," in Proc. of ECCV 2006, vol. 3952, pp. 628--641.

Digital Library

[15]

D. Damen and D. Hogg, "Detecting carried objects in short video sequences," in Proc. of ECCV 2008, vol. 3, pp. 154--167.

Digital Library

[16]

T. Horprasert, D. Harwood, and L. Davis, "A statistical approach for real-time robust background subtraction and shadow detection," in Proc. of ICCV'99 FRAME-RATE Workshop, pp. 1--19.

[17]

H. Lombaert, Y. Sun, L. Grady, and C. Xu, "A multilevel banded graph cuts method for fast image segmentation," in Proc. of ICCV 2005, pp. 259--265.

Digital Library

[18]

G. Chung and T. Kanade, "A real time system for robust 3D voxel reconstruction of human motions," in Proc. of CVPR 2000, vol. 2, pp. 714--720.

Cited By

Odashima SMori TSimosaka MNoguchi HSato T(2011)Event Understanding of Human-Object Interaction: Object Movement Detection via Stable ChangesIntelligent Video Event Analysis and Understanding10.1007/978-3-642-17554-1_9(195-210)Online publication date: 2011
https://doi.org/10.1007/978-3-642-17554-1_9
Odashima SSato TMori T(2010)Household object management via integration of object movement detection from multiple cameras2010 IEEE/RSJ International Conference on Intelligent Robots and Systems10.1109/IROS.2010.5651511(3187-3194)Online publication date: Oct-2010
https://doi.org/10.1109/IROS.2010.5651511

Index Terms

Human shape reconstruction via graph cuts for voxel-based markerless motion capture in intelligent environment
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Automatic reconstruction of 3D human motion pose from uncalibrated monocular video sequences based on markerless human motion tracking

We present a method to reconstruct human motion pose from uncalibrated monocular video sequences based on the morphing appearance model matching. The human pose estimation is made by integrated human joint tracking with pose reconstruction in depth-...
Towards markerless motion capture: model estimation, initialization and tracking
Markerless human body motion capture using Markov random field and dynamic graph cuts

Current vision-based human body motion capture methods always use passive markers that are attached to key locations on the human body. However, such systems may confront subjects with cumbersome markers, making it difficult to convert the marker data ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IUCS '09: Proceedings of the 3rd International Universal Communication Symposium

December 2009

404 pages

ISBN:9781605586410

DOI:10.1145/1667780

General Chair:
Kazumasa Enami
National Institute of Information and Communications Technology (NICT), Japan

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

NICT: National Institute of Information and Communications Technology

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

IUCS '09

Sponsor:

NICT

IUCS '09: 3rd International Universal Communication Symposium

December 3 - 4, 2009

Tokyo, Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
154
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Odashima SMori TSimosaka MNoguchi HSato T(2011)Event Understanding of Human-Object Interaction: Object Movement Detection via Stable ChangesIntelligent Video Event Analysis and Understanding10.1007/978-3-642-17554-1_9(195-210)Online publication date: 2011
https://doi.org/10.1007/978-3-642-17554-1_9
Odashima SSato TMori T(2010)Household object management via integration of object movement detection from multiple cameras2010 IEEE/RSJ International Conference on Intelligent Robots and Systems10.1109/IROS.2010.5651511(3187-3194)Online publication date: Oct-2010
https://doi.org/10.1109/IROS.2010.5651511

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten