article

3D Reconstruction of Periodic Motion from a Single View

Authors:

Nikolaos PapanikolopoulosAuthors Info & Claims

International Journal of Computer Vision, Volume 90, Issue 1

Pages 28 - 44

https://doi.org/10.1007/s11263-010-0334-x

Published: 01 October 2010 Publication History

Abstract

Periodicity has been recognized as an important cue for tasks like activity recognition and gait analysis. However, most existing techniques analyze periodic motions only in image coordinates, making them very dependent on the viewing angle. In this paper we show that it is possible to reconstruct a periodic trajectory in 3D given only its appearance in image coordinates from a single camera view. We draw a strong analogy between this problem and that of reconstructing an object from multiple views, which allows us to rely on well-known theoretical results from the multi-view geometry domain and obtain significant guarantees regarding the solvability of the estimation problem. We present two different formulations of the problem, along with techniques for performing the reconstruction in both cases, and an algorithm for estimating the period of motion from its image-coordinate trajectory. Experimental results demonstrate the feasibility of the proposed techniques.

References

[1]

Allmen, M., & Dyer, C. R. (1990). Cyclic motion detection using spatiotemporal surfaces and curves. In Proc. int. conf. pattern recognition (Vol. 1, pp. 365-370).

[2]

Belongie, S., & Wills, J. (2004). Structure from periodic motion. In Proc. int. workshop on spatial coherence for visual motion analysis (pp. 16-24). May 2004.

Digital Library

[3]

Boyd, S. P., & Vandenberghe, L. (2004). Convex optimization. Cambridge: Cambridge University Press.

[4]

Briassouli, A., & Ahuja, N. (2007). Extraction and analysis of multiple periodic motions in video sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(7), 1244-1261.

Digital Library

[5]

Cohen, C. J., Conway, L., & Koditschek, D. (1996). Dynamical system representation, generation, and recognition of basic oscillatory motion gestures. In Proc. int. conf. automatic face and gesture recognition (pp. 60-65).

[6]

Cutler, R., & Davis, L. S. (2000). Robust real-time periodic motion detection, analysis, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 781-796.

Digital Library

[7]

Davis, J., Bobick, A., & Richards, W. (2000). Categorical representation and recognition of oscillatory motion patterns. In Proc. IEEE conf. computer vision and pattern recognition (Vol. 1, pp. 628-635).

[8]

Donoho, D.L. (2006). Compressed sensing. IEEE Transactions on Information Theory, 52, 1289-1306.

Digital Library

[9]

Eggert, D.W., Lorusso, A., & Fisher, R. B. (1997). Estimating 3-d rigid body transformations: A comparison of four major algorithms. Machine Vision and Applications, 9, 272-290.

Digital Library

[10]

Elgammal, A., & Lee, C.-S. (2004). Inferring 3D body pose from silhouettes using activity manifold learning. In Proc. IEEE conf. computer vision and pattern recognition (Vol. 2, pp. 681-688).

[11]

Fossati, A., Arnaud, E., Horaud, R., & Fua, P. (2008). Tracking articulated bodies using generalized expectation maximization. In Proc. CVPR workshop on non-rigid shape analysis and deformable image alignment.

[12]

Fujiyoshi, H., Lipton, A. J., & Kanade, T. (2004). Real-time human motion analysis by image skeletonization. IEICE Transactions on Information and Systems, E87-D(1), 113-120.

[13]

Hartley, R., & Zisserman, A. (2003). Multiple view geometry in computer vision (2nd ed.). Cambridge: Cambridge University Press.

[14]

Hurley, N., & Rickard, S. (2008). Comparing measures of sparsity. In Proc. IEEE workshop on machine learning for signal processing (pp. 55-60).

[15]

Little, J., & Boyd, J. (1995). Describing motion for recognition. In Proc. int. symposium on computer vision (pp. 235-240).

[16]

Liu, F., & Picard, R. W. (1998). Finding periodicity in space and time. In Proc. IEEE conf. computer vision and pattern recognition.

[17]

Nocedal, J., & Wright, S. J. (1999). Numerical optimization. Berlin: Springer.

[18]

Ormoneit, D., Black, M. J., Hastie, T., & Kjellstrom, H. (2005). Representing cyclic human motion using functional analysis. Image and Vision Computing, 23, 1264-1276.

Digital Library

[19]

Orriols, X., & Binefa, X. (2003). Classifying periodic motions in video sequences. In Proc. IEEE int. conf. image processing (Vol. 1). September 2003.

[20]

Polana, R., & Nelson, R. (1997). Detection and recognition of periodic, nonrigid motion. International Journal of Computer Vision, 23(3), 261-282.

Digital Library

[21]

Ramanan, D., Forsyth, D. A., & Zisserman, A. (2007). Tracking people by learning their appearance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29, 65-81.

Digital Library

[22]

Ribnick, E., & Papanikolopoulos, N. (2008). Estimating 3D trajectories of periodic motions from stationary monocular views. In Proc. European conf. computer vision.

[23]

Ribnick, E., & Papanikolopoulos, N. (2009). View-invariant analysis of periodic motion. In Proc. IEEE/RSJ int. conf. intelligent robots and systems.

[24]

Ribnick, E., Atev, S., & Papanikolopoulos, N. (2009). Estimating 3D positions and velocities of projectiles from monocular views. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 938-944.

Digital Library

[25]

Schaible, S., & Shi, J. (2003). Fractional programming: the sum-of-ratios case. Optimization Methods and Software, 18, 219-229.

[26]

Schonemann, P. (1966). A generalized solution of the orthogonal Procrustes problem. Psychometrika, 31, 1-10.

[27]

Seitz, S. M., & Dyer, C. R. (1997). View-invariant analysis of cyclic motion. International Journal of Computer Vision, 25, 1-23.

Digital Library

[28]

Sigal, L., & Black, M. J. (2006). Measure locally, reason globally: Occlusion-sensitive articulated pose estimation. In Proc. IEEE conf. computer vision and pattern recognition.

[29]

Tsai, P.-S., Shah, M., Keiter, K., & Kasparis, T. (1994). Cyclic motion detection for motion based recognition. Pattern Recognition, 27(12), 1591-1603.

[30]

Zhang, Z., & Troje, N. F. (2007). 3D periodic human motion reconstruction from 2D motion sequences. Neural Computation, 19, 1400-1421.

Digital Library

Cited By

Zeng WWang C(2016)View-invariant gait recognition via deterministic learningNeurocomputing10.1016/j.neucom.2015.10.065175:PA(324-335)Online publication date: 29-Jan-2016
https://dl.acm.org/doi/10.1016/j.neucom.2015.10.065
Chen HMa SSun BShen Y(2012)Projection ray intersecting location-based multicolour pseudo-random coded projected active vision methodInternational Journal of Computer Applications in Technology10.1504/IJCAT.2012.04583743:1(21-28)Online publication date: 1-Mar-2012
https://dl.acm.org/doi/10.1504/IJCAT.2012.045837

3D Reconstruction of Periodic Motion from a Single View
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Animation
2. Networks
  1. Network protocols

Recommendations

Periodic Motion Detection on Patient with Motion Disorders
CBMS '08: Proceedings of the 2008 21st IEEE International Symposium on Computer-Based Medical Systems

The proposed method serves for detecting and analysing translating and non-translating periodic motion with small oscillation from video data. Periodic motion in a video sequence is detected using principles of motion accumulation. Non-translating ...
3D motion reconstruction for real-world camera motion
CVPR '11: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition

This paper addresses the problem of 3D motion reconstruction from a series of 2D projections under low reconstructibility. Reconstructibility defines the accuracy of a 3D reconstruction from 2D projections given a particular trajectory basis, 3D point ...
NormalGAN: Learning Detailed 3D Human from a Single RGB-D Image
Computer Vision – ECCV 2020
Abstract
We propose NormalGAN, a fast adversarial learning-based method to reconstruct the complete and detailed 3D human from a single RGB-D image. Given a single front-view RGB-D image, NormalGAN performs two steps: front-view RGB-D rectification and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image International Journal of Computer Vision

International Journal of Computer Vision Volume 90, Issue 1

October 2010

129 pages

ISSN:0920-5691

Issue’s Table of Contents

Copyright © Copyright © 2010 Springer Science+Business Media, LLC.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 October 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zeng WWang C(2016)View-invariant gait recognition via deterministic learningNeurocomputing10.1016/j.neucom.2015.10.065175:PA(324-335)Online publication date: 29-Jan-2016
https://dl.acm.org/doi/10.1016/j.neucom.2015.10.065
Chen HMa SSun BShen Y(2012)Projection ray intersecting location-based multicolour pseudo-random coded projected active vision methodInternational Journal of Computer Applications in Technology10.1504/IJCAT.2012.04583743:1(21-28)Online publication date: 1-Mar-2012
https://dl.acm.org/doi/10.1504/IJCAT.2012.045837

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents