research-article

Coverage quality and smoothness criteria for online view selection in a multi-camera network

Authors:

Aaron Mavrinac,

Yonghong TanAuthors Info & Claims

ACM Transactions on Sensor Networks (TOSN), Volume 10, Issue 2

Article No.: 33, Pages 1 - 19

https://doi.org/10.1145/2530373

Published: 31 January 2014 Publication History

Abstract

The problem of online selection of monocular view sequences for an arbitrary task in a calibrated multi-camera network is investigated. An objective function for the quality of a view sequence is derived from a novel task-oriented, model-based instantaneous coverage quality criterion and a criterion of the smoothness of view transitions over time. The former is quantified by a priori information about the camera system, environment, and task generally available in the target application class. The latter is derived from qualitative definitions of undesirable transition effects. A scalable online algorithm with robust suboptimal performance is presented based on this objective function. Experimental results demonstrate the performance of the method—and therefore the criteria—as well as its robustness to several identified sources of nonsmoothness.

References

[1]

Jose Luis Alarcon Herrera, Aaron Mavrinac, and Xiang Chen. 2011. Sensor planning for range cameras via a coverage strength model. In Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics. 838--843.

[2]

Herbert Bay, Tinne Tuytelaars, and Luc Van Gool. 2006. SURF: Speeded up robust features. In Proceedings of the 9^th European Conference on Computer Vision. 404--417.

Digital Library

[3]

Duane C. Brown. 1966. Decentering distortion of lenses. Photogrammetric Engin. 32, 3, 444--462.

[4]

Qin Cai and Jake K. Aggarwal. 1999. Tracking human motion in structured environments using a distributed-camera system. IEEE Trans. Pattern Anal. Mach. Intell. 21, 11, 1241--1247.

Digital Library

[5]

Fahad Daniyal, Murtaza Taj, and Andrea Cavallaro. 2009. Content and task-based view selection from multiple video streams. Multimedia Tools Appl. 46, 235--258.

Digital Library

[6]

Ugur Murat Erdem and Stan Sclaroff. 2012. Event prediction in a hybrid camera network. ACM Trans. Sens. Netw. 8, 2, 1--27.

Digital Library

[7]

Ye-Peng Guan. 2009. Automatic optimal view selection for natural hci. In Proceedings of the 2^nd International Congress on Image and Signal Processing (CISP'09). 1--5.

[8]

Abhinav Gupta, Anurag Mittal, and Larry S. Davis. 2007. COST: An approach for camera selection and multi-object inference ordering in dynamic scenes. In Proceedings of the 11^th IEEE International Conference on Computer Vision. 1--8.

[9]

Chris Harris and Mike Stephens. 1988. A combined corner and edge detector. In Proceedings of the 4^th Alvey Vision Conference. 147--151.

[10]

Volkan Isler, Sanjeev Khanna, John Spletzer, and Camillo J. Taylor. 2005. Target tracking with distributed sensors: The focus of attention problem. Comput. Vis. Image Understand. 100, 1--2, 225--247.

Digital Library

[11]

Hao Jiang, Sidney Fels, and James J. Little. 2008. Optimizing multiple object tracking and best view video synthesis. IEEE Trans. Multimedia 10, 6, 997--1012.

Digital Library

[12]

Huang Lee, Linda Tessens, Marleen Morbee, Hamid Aghajan, and Wilfried Philips. 2008. Sub-optimal camera selection in practical vision networks through shape approximation. In Proceedings of the 10^th International Conference Advanced Concepts for Intelligent Vision Systems. 266--277.

Digital Library

[13]

David G. Lowe. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 2, 91--110.

Digital Library

[14]

Yi Ma, Stefano Soatto, Jana Kosecka, and S. Shankar Sastry. 2004. An Invitation to 3-D Computer Vision. Springer.

[15]

Renita Machado, Wensheng Zhang, Guiling Wang, and Sirin Tekinay. 2010. Coverage properties of clustered wireless sensor networks. ACM Trans. Sens. Netw. 7, 2, 1--21.

Digital Library

[16]

Aaron Mavrinac, Jose Luis Alarcon Herrera, and Xiang Chen. 2010a. A fuzzy model for coverage evaluation of cameras and multi-camera networks. In Proceedings of the 4^th ACM/IEEE International Confeerence Distributed Smart Cameras. 95--102.

Digital Library

[17]

Aaron Mavrinac, Jose Luis Alarcon Herrera, and Xiang Chen. 2010b. Evaluating the fuzzy coverage model for 3d multi-camera network applications. In Proceedings of the 3^rd International Conference on Intelligent Robotics and Applications. 692--701.

Digital Library

[18]

Aaron Mavrinac and Xiang Chen. 2013. Modeling coverage in camera networks: A survey. Int. J. Comput. Vis. 101, 1, 205--226.

Digital Library

[19]

Aaron Mavrinac, Durga Rajan, Yonghong Tan, and Xiang Chen. 2012. Task-oriented optimal view selection in a calibrated multi-camera system. In Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[20]

Tomas Moller and Ben Trumbore. 1997. Fast, minimum storage ray/triangle intersection. J. Graph. Tools 2, 1, 21--28.

Digital Library

[21]

Marleen Morbee, Linda Tessens, Huang Lee, Wilfried Philips, and Hamid Aghajan. 2008. Optimal camera selection in vision networks for shape approximation. In Proceedings of the 10^th IEEE International Workshop on Multimedia Signal Processing. 46--51.

[22]

Kim C. Ng, Hiroshi Ishiguro, Mohan Trivedi, and Takushi Sogo. 2004. An integrated surveillance system human tracking and view synthesis using multiple omni-directional vision sensors. Image Vis. Comput. 22, 7, 551--561.

[23]

Han-Saem Park, Soojung Lim, Jun-Ki Min, and Sung-Bae Cho. 2008. Optimal view selection and event retrieval in multi-camera office environment. In Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems. 106--110.

[24]

Johnny Park, Priya C. Bhat, and Avinash C. Kak. 2006. A look-up table based approach for solving the camera selection problem in large camera networks. In Proceedings of the International Workshop on Distributed Smart Cameras.

[25]

Richard J. Radke. 2010. A survey of distributed computer vision algorithms. In Handbook of Ambient Intelligence and Smart Environments, Hideyuki Nakashima, Hamid Aghajan, and Juan Carlos Augusto, Eds., Springer, 35--55.

[26]

Changsong Shen, Chris Zhang, and Sidney Fels. 2007. A multi-camera surveillance system that estimates quality-of-view measurement. In Proceedings of the IEEE International Conference Image Processing. 193--196.

[27]

Babak Shirmohammadi and Camillo J. Taylor. 2012. Self-localizing smart camera networks. ACM Trans. Sens. Netw. 8, 2, 1--26.

Digital Library

[28]

Lauro Snidaro, Ruixin Niu, Pramod K. Varshney, and Gian Luca Foresti. 2003. Automatic camera selection and fusion for outdoor surveillance under changing weather conditions. In Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance. 364--369.

Digital Library

[29]

Stanislava Soro and Wendi B. Heinzelman. 2007. Camera selection in visual sensor networks. In Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance. 81--86.

Digital Library

[30]

Linda Tessens, Marleen Morbee, Huang Lee, Wilfried Philips, and Hamid Aghajan. 2008. Principal view determination for camera selection in distributed smart camera networks. In Proceedings of the 2^nd ACM/IEEE International Conference on Distributed Smart Cameras.

[31]

Pere-Pau Vazquez, Miquel Feixas, Mateu Sbert, and Wolfgang Heidrich. 1999. Viewpoint selection using viewpoint entropy. In Proceedings of the Vision, Modeling, and Visualization Conference. 274--280.

Digital Library

Cited By

Li CChen XChai L(2024)Simultaneous Coverage and Mapping of Stereo Camera Network for Unknown Deformable ObjectIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2023.334653073(1-10)Online publication date: 2024
https://doi.org/10.1109/TIM.2023.3346530
Puligandla VLoncaric S(2022)A Multiresolution Approach for Large Real-World Camera Placement Optimization ProblemsIEEE Access10.1109/ACCESS.2022.317681710(61601-61616)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3176817
Ozkan MSecil STurgut KDutagaci HUyanik CParlaktuna O(2022)Surface profile-guided scan method for autonomous 3D reconstruction of unknown objects using an industrial robotThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02241-z38:11(3953-3977)Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1007/s00371-021-02241-z
Show More Cited By

Index Terms

Coverage quality and smoothness criteria for online view selection in a multi-camera network
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Animation
      1. Motion capture
      2. Motion processing

Recommendations

Camera selection for tracking in distributed smart camera networks

Tracking persons with multiple cameras with overlapping fields of view instead of with one camera leads to more robust decisions. However, operating multiple cameras instead of one requires more processing power and communication bandwidth, which are ...
Camera Network Calibration and Synchronization from Silhouettes in Archived Video

In this paper we present an automatic method for calibrating a network of cameras that works by analyzing only the motion of silhouettes in the multiple video streams. This is particularly useful for automatic reconstruction of a dynamic event using a ...
Adaptive online camera coordination for multi-camera multi-target surveillance

Online camera selection is introduced as a result of the improved mobility of cameras and the increased scale of surveillance systems. Most existing camera assignment algorithms achieve an optimal observation under the assumption of the unlimited camera ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Sensor Networks

ACM Transactions on Sensor Networks Volume 10, Issue 2

January 2014

609 pages

ISSN:1550-4859

EISSN:1550-4867

DOI:10.1145/2575808

Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 31 January 2014

Accepted: 01 March 2013

Revised: 01 December 2012

Received: 01 July 2012

Published in TOSN Volume 10, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
321
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li CChen XChai L(2024)Simultaneous Coverage and Mapping of Stereo Camera Network for Unknown Deformable ObjectIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2023.334653073(1-10)Online publication date: 2024
https://doi.org/10.1109/TIM.2023.3346530
Puligandla VLoncaric S(2022)A Multiresolution Approach for Large Real-World Camera Placement Optimization ProblemsIEEE Access10.1109/ACCESS.2022.317681710(61601-61616)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3176817
Ozkan MSecil STurgut KDutagaci HUyanik CParlaktuna O(2022)Surface profile-guided scan method for autonomous 3D reconstruction of unknown objects using an industrial robotThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02241-z38:11(3953-3977)Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1007/s00371-021-02241-z
Lei ZChen XChen XChai L(2021)Radial Coverage Strength for Optimization of Monocular Multicamera DeploymentIEEE/ASME Transactions on Mechatronics10.1109/TMECH.2021.305608126:6(3221-3231)Online publication date: Dec-2021
https://doi.org/10.1109/TMECH.2021.3056081
Feng YChen ZChen X(2020)Distributed $\mathcal{H}_\infty$ Gaussian Consensus Filtering for Discrete-Time Systems over Lossy Sensor NetworksSIAM Journal on Control and Optimization10.1137/19M127370058:1(34-58)Online publication date: 2-Jan-2020
https://doi.org/10.1137/19M1273700
Simonjan JRinner B(2019)Decentralized and Resource-efficient Self-Calibration of Visual Sensor NetworksAd Hoc Networks10.1016/j.adhoc.2019.01.007Online publication date: Mar-2019
https://doi.org/10.1016/j.adhoc.2019.01.007
Zhang XChen XFarzadpour FFang Y(2018)A Visual Distance Approach for Multicamera Deployment With Coverage OptimizationIEEE/ASME Transactions on Mechatronics10.1109/TMECH.2018.283439323:3(1007-1018)Online publication date: Jun-2018
https://doi.org/10.1109/TMECH.2018.2834393
Fedorov ILawal NO'Nils MAlqaysi H(2017)Placement Strategy of Multi-Camera Volumetric Surveillance System for Activities MonitoringProceedings of the 11th International Conference on Distributed Smart Cameras10.1145/3131885.3131911(113-118)Online publication date: 5-Sep-2017
https://dl.acm.org/doi/10.1145/3131885.3131911
Farzadpour FZhang XChen XTong Zhang (2017)On performance measurement for a heterogeneous planar field sensor network2017 IEEE International Conference on Advanced Intelligent Mechatronics (AIM)10.1109/AIM.2017.8014013(166-171)Online publication date: Jul-2017
https://doi.org/10.1109/AIM.2017.8014013
Konda KConci NDe Natale F(2016)Global Coverage Maximization in PTZ-Camera Networks Based on Visual Quality AssessmentIEEE Sensors Journal10.1109/JSEN.2016.258417916:16(6317-6332)Online publication date: Aug-2016
https://doi.org/10.1109/JSEN.2016.2584179
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents