research-article

Fisheye camera modeling for human segmentation refinement in indoor videos

Authors:

K. K. Delibasis,

V. P. Plagianakos,

I. MaglogiannisAuthors Info & Claims

PETRA '13: Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments

Article No.: 37, Pages 1 - 8

https://doi.org/10.1145/2504335.2504375

Published: 29 May 2013 Publication History

Abstract

In this paper, we concentrate on refining the results of segmenting human presence from indoors videos acquired by a fisheye camera, using a 3D mathematical model of the camera. The model has been calibrated according to the specific indoor environment that is being monitored. Human segmentation is implemented using a standard established technique. The fisheye camera used for video acquisition is modeled using a spherical element, while the parameters of the camera model are determined only once, using the correspondence of a number of user-defined landmarks, both in real world coordinates and on the acquired video frame. Subsequently, each pixel of the video frame is inversely mapped to the direction of view in the real world and the relevant data are stored in look-up tables for very fast utilization in real-time video processing. The proposed fisheye camera model enables the inference of possible real world positions of a segmented cluster of pixels in the video frame. In this work, we utilize the constructed camera model to achieve a simple geometric reasoning that corrects gaps and mistakes of the human figure segmentation. Initial results are also presented for a small number of video sequences, which prove the efficiency of the proposed method.

References

[1]

J. Willems, G. Debard, B. Bonroy, B. Vanrumste and T. Goedemé 2009, How to detect human fall in video? An overview, In Proceedings of the positioning and contex-awareness international conference (Antwerp, Belgium, 28 May, 2009), POCA '09.

[2]

Cucchiara, R., Grana, C., Piccardi, M., and Prati A. 2003. Detecting moving objects, ghosts, and shadows in video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 10, (2003), 1337--1442.

Digital Library

[3]

McFarlane N. and Schofield C. 1995, Segmentation and tracking of piglets in images, Mach. Vision Appl. 8, 3, (May. 1995), 187--193.

[4]

Wren C., Azarhayejani A., Darrell T., and Pentland, A. P. 1997. Pfinder: real-time tracking of the human body, IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 7, (October. 1997), 780--785.

Digital Library

[5]

Stauffer C. and Grimson W. 1999, Adaptive background mixture models for real-time tracking, In Proceedings of the conference on computer vision and pattern recognition (Ft. Collins, USA, June 23--25, 1999), CVPR '99. IEEE Computer Society, New York, NY, pp. 246--252.

[6]

Cheng F. C., Huang S. C. and Ruan S. J. 2011, Implementation of Illumination-Sensitive Background Modeling Approach for Accurate Moving Object Detection, IEEE Trans. on Boardcasting, vol. 57, no. 4, pp.794--801, 2011.

[7]

Christodoulidis A., Delibasis K. K., Maglogiannis I. 2012, Near real-time human silhouette and movement detection in indoor environments using fixed cameras, in the 5th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Heraklion, Crete, Greece, 2012.

Digital Library

[8]

Kemmotsu K., Tomonaka T., Shiotani S., Koketsu Y., and Iehara M. 2006, Recognizing human behaviors with vision sensors in a Network Robot System, in Proceedings of IEEE Int. Conf. on Robotics and Automation, pp. 1274--1279, 2006.

[9]

Zhou Z., Chen X., Chung Y., He Z., Han T. X. and Keller J. M. 2008, Activity Analysis, Summarization and Visualization for Indoor Human Activity Monitoring, IEEE Trans. on Circuit and systems for Video Technology, Vol. 18, No. II, pp. 1489--1498, 2008.

Digital Library

[10]

Li H. and Hartley R., Plane-Based Calibration and Auto-calibration of a Fish-Eye Camera, in P. J. Narayanan et al. (Eds.): ACCV 2006, LNCS 3851, pp. 21--30, 2006, c Springer-Verlag Berlin Heidelberg 2006.

Digital Library

[11]

Basu A., Licardie S., Modeling fish-eye lenses, Proceedings of the 1993 IEEWSJ International Conference on Intelligent Robots and Systems, Yokohama, Japan July 2630, 1993.

[12]

Shah S. and Aggarwal J. 1996, Intrinsic parameter calibration procedure for a high distortion fish-eye lens camera with distortion model and accuracy estimation, Pattern Recognition, 29(11), 1775--1788, 1996.

[13]

Wei J., Li C. F., Hu S. M., Martin R. R., and Tai C. L. 2012, Fisheye Video Correction, IEEE T on Visualization and Computer Graphics,

Digital Library

[14]

N. Max 1983, Computer Graphics Distortion for IMAX and OMNIMAX Projection, Proc Nicograph, 83, Dec 1983 pp 137.

[15]

Greene N. 1986, Environment Mapping and Other Applications of World Projections, IEEE Computer Graphics and Applications, November 1986, vol. 6(11), pp 21.

Digital Library

[16]

http://paulbourke.net/dome/fisheye/

[17]

B. Micusik and T. Pajdla, "Structure from Motion with Wide Circular Field of View Cameras", IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI 28(7), 2006, pp. 1--15.

Digital Library

[18]

J. Canny, "A Computational Approach To Edge Detection", IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8(6), 1986, pp. 679--698.

Digital Library

Cited By

Khan MMittal MGoyal LRoy S(2021)A deep survey on supervised learning based human detection and activity classification methodsMultimedia Tools and Applications10.1007/s11042-021-10811-5Online publication date: 27-May-2021
https://doi.org/10.1007/s11042-021-10811-5
Styliadis CKonstantinidis EBillis ABamidis PMakedon FClements MPelachaud CKalogeraki VMaglogiannis I(2014)Employing affection in elderly healthcare serious games interventionsProceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/2674396.2674456(1-4)Online publication date: 27-May-2014
https://dl.acm.org/doi/10.1145/2674396.2674456
Maglogiannis IMakedon FClements MPelachaud CKalogeraki VMaglogiannis I(2014)Human centered computing for the development of assistive environmentsProceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/2674396.2674453(1-7)Online publication date: 27-May-2014
https://dl.acm.org/doi/10.1145/2674396.2674453
Show More Cited By

Index Terms

Fisheye camera modeling for human segmentation refinement in indoor videos
1. Applied computing
  1. Life and medical sciences
    1. Health care information systems

Recommendations

Cata-Fisheye Camera for Panoramic Imaging
WACV '08: Proceedings of the 2008 IEEE Workshop on Applications of Computer Vision

We present a novel panoramic imaging system which uses a curved mirror as a simple optical attachment to a fish-eye lens. When compared to existing panoramic cameras, our "cata-fisheye" camera has a simple, compact and inexpensive design, and yet yields ...
Direct visual odometry for a fisheye-stereo camera
2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
We present a direct visual odometry algorithm for a fisheye-stereo camera. Our algorithm performs simultaneous camera motion estimation and semi-dense reconstruction. The pipeline consists of two threads: a tracking thread and a mapping thread. In the ...
Dual-fisheye omnidirectional stereo
2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
We propose a novel omnidirectional stereo camera setup that is formed by two ultra-wide field-of-view (FOV) fisheye cameras. The proposed configuration is formed by two 245-degree FOV fisheye cameras, facing opposite directions, that are rigidly mounted ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '13: Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments

May 2013

413 pages

ISBN:9781450319737

DOI:10.1145/2504335

Conference Chair:
Fillia Makedon
University of Texas at Arlington
,
Program Chairs:
Margrit Betke
Boston University
,
Magy Self El-Nasr
Northeastern University
,
Ilias Maglogiannis
University of Central Greece, Greece

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

NSF: National Science Foundation
FORTH: Foundation for Research and Technology - Hellas
HERACLEIA: HERACLEIA Human-Centered Computing Laboratory at UTA
U of Tex at Arlington: U of Tex at Arlington
TEI: Technological Educational Institution of Athens
UCG: University of Central Greece
NCRS: Demokritos National Center for Scientific Research
Fulbrigh, Greece: Fulbright Foundation, Greece
Ionian: Ionian University, GREECE

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 May 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Social Fund
Greek national funds

Conference

PETRA '13

Sponsor:

NSF
FORTH
HERACLEIA
U of Tex at Arlington
TEI
UCG
NCRS
Fulbrigh, Greece
Ionian

PETRA '13: The 6th International Conference on PErvasive Technologies Related to Assistive Environments

May 29 - 31, 2013

Rhodes, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
178
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Khan MMittal MGoyal LRoy S(2021)A deep survey on supervised learning based human detection and activity classification methodsMultimedia Tools and Applications10.1007/s11042-021-10811-5Online publication date: 27-May-2021
https://doi.org/10.1007/s11042-021-10811-5
Styliadis CKonstantinidis EBillis ABamidis PMakedon FClements MPelachaud CKalogeraki VMaglogiannis I(2014)Employing affection in elderly healthcare serious games interventionsProceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/2674396.2674456(1-4)Online publication date: 27-May-2014
https://dl.acm.org/doi/10.1145/2674396.2674456
Maglogiannis IMakedon FClements MPelachaud CKalogeraki VMaglogiannis I(2014)Human centered computing for the development of assistive environmentsProceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/2674396.2674453(1-7)Online publication date: 27-May-2014
https://dl.acm.org/doi/10.1145/2674396.2674453
Delibasis KPlagianakos VMaglogiannis I(2014)Refinement of human silhouette segmentation in omni-directional indoor videosComputer Vision and Image Understanding10.1016/j.cviu.2014.06.011128(65-83)Online publication date: Nov-2014
https://doi.org/10.1016/j.cviu.2014.06.011
Maglogiannis IDelibasis KKosmopoulos DGoudas TDoukas C(2014)Activity Recognition in Assistive EnvironmentsProceedings of the 8th International Conference on Universal Access in Human-Computer Interaction. Aging and Assistive Environments - Volume 851510.1007/978-3-319-07446-7_51(525-536)Online publication date: 22-Jun-2014
https://dl.acm.org/doi/10.1007/978-3-319-07446-7_51

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents