research-article

Collaborative localization in visual sensor networks

Authors:

Mahmut Karakaya,

Hairong QiAuthors Info & Claims

ACM Transactions on Sensor Networks (TOSN), Volume 10, Issue 2

Article No.: 18, Pages 1 - 24

https://doi.org/10.1145/2529999

Published: 31 January 2014 Publication History

Abstract

Collaboration in visual sensor networks is essential not only to compensate for the limitations of each sensor node but also to tolerate inaccurate information generated by faulty sensors. This article focuses on the design of a collaborative target localization algorithm that is resilient to sensor faults. We first develop a distributed solution to fault-tolerant target localization based on a so-called certainty map. To tolerate potential sensor faults, a voting mechanism is adopted and a threshold value needs to be specified which is the key to the realization of the distributed solution. Analytical study is conducted to derive the lower and upper bounds for the threshold such that the probability of faulty sensors negatively impacts the localization performance is less than a small value. Second, we focus on the detection and correction of one type of sensor faults, error in camera orientation. We construct a generative image model in each camera based on the detected target location to estimate camera's orientation, detect inaccuracies in camera orientations and correct them before they cascade. Based on results obtained from both simulation and real experiments, we show that the proposed method is effective in localization accuracy as well as fault detection and correction performance.

References

[1]

A. Abbo and R. Kleihorst. 2002. A programmable smart camera architecture. In Advanced Concepts for Intelligent Vision Systems.

[2]

R. Abedi, N. Aslam, and S. Ghani. 2011. Fault tolerance analysis of heterogeneous wireless sensor network. In Proceedings of the 24th Canadian Conference on Electrical and Computer Engineering. 000175--000179.

[3]

H. Aghajan and Andrea Cavallaro. 2009. Multi-Camera Networks: Principles and Applications. Academic Press, Oxford, UK.

Digital Library

[4]

J. Bredin, E. Demaine, M. Hajiaghayi, and D. Rus. 2010. Deploying sensor networks with guaranteed fault tolerance. IEEE/ACM Trans Network. 18, 1, 216--228.

Digital Library

[5]

P. Chen, P. Ahammad, et al. 2008. Citric: A low-bandwidth wireless camera network platform. In Proceedings of the 2nd ACM/IEEE International Conference on Distributed Smart Cameras. 1--10.

[6]

Thomas Clouqueur, Kewal K. Saluja, and Parameswaran Ramanathan. 2004. Fault tolerance in collaborative sensor networks for target detection. IEEE Trans. Comput. 53, 3, 320--333.

Digital Library

[7]

Dhanya Devarajan and Richard J. Radke. 2007. Calibrating distributed camera networks using belief propagation. EURASIP J. Adv. Signal Process. 60696.

Digital Library

[8]

Min Ding, Fang Liu, Andrew Thaeler, Dechang Chen, and Xiuzhen Cheng. 2007. Fault-tolerant target localization in sensor networks. EURASIP J. Wirel. Commun. Netw. 1, 19--19.

Digital Library

[9]

F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua. 2008. Multicamera people tracking with a probabilistic occupancy map. IEEE Trans. Pattern Anal. Mach. Intell. 30, 2, 267--282.

Digital Library

[10]

A. Goode, A. Rowe, and K. Agyeman. 2012. Welcome the new cmucam4. http://www.cmucam.org/projects/cmucam4/.

[11]

G. Gualdi, A. Prati, and R. Cucchiara. 2008. Video streaming for mobile video surveillance. IEEE Trans. Multimedia 10, 6, 1142--1154.

Digital Library

[12]

Stephan Hengstler, Daniel Prashanth, Sufen Fong, and Hamid Aghajan. 2007. Mesheye: a hybrid-resolution smart camera mote for applications in distributed intelligent surveillance. In Proceedings of the 6th International Conference on Information Processing in Sensor Networks. ACM, 360--369.

Digital Library

[13]

Sean Hynes and Neil C. Rowe. 2004. A multi-agent simulation for assessing massive sensor deployment. J. Battlefield Tech. 7, 23--36.

[14]

A. Kandhalu, A. Rowe, and R. Rajkumar. 2009. Dspcam: A camera sensor system for surveillance networks. In Proceedings of the 3rd ACM/IEEE International Conference on Distributed Smart Cameras. 1--7.

[15]

M. Karakaya and Hairong Qi. 2009. Target detection and counting using a progressive certainty map in distributed visual sensor networks. In Proceedings of the 3rd ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC). 1--8.

[16]

Mahmut Karakaya and Hairong Qi. 2010. Fault detection, correction, and tolerance for collaborative target localization in visual sensor networks. In Proceedings of the 4th ACM/IEEE International Conference on Distributed Smart Cameras, (ICDSC'10). ACM, New York, 111--118.

Digital Library

[17]

Mahmut Karakaya and Hairong Qi. 2011. Distributed target localization using a progressive certainty map in visual sensor networks. Ad Hoc Netw. 9, 4, 576--590.

Digital Library

[18]

M. Karakaya and Hairong Qi. 2012. Coverage estimation in heterogeneous visual sensor networks. In Proceedings of the IEEE 8th International Conference on Distributed Computing in Sensor Systems. 41--49.

Digital Library

[19]

L. Klein. 1993. A Boolean algebra approach to multiple sensor voting fusion. IEEE Trans. Aerosp. Navig. Electron. 29, 2, 317--327.

[20]

Leslie Lamport, Robert Shostak, and Marshall Pease. 1982. The byzantine generals problem. ACM Trans. Program. Lang. Syst. 4, 3, 382--401.

Digital Library

[21]

Christian Micheloni, Marco Lestuzzi, and Gian Luca Foresti. 2008. Adaptive video communication for an intelligent distributed system: Tuning sensors parameters for surveillance purposes. Mach. Vision Appl. 19, 5--6, 359--373.

Digital Library

[22]

C. Micheloni, B. Rinner, and G. L. Foresti. 2010. Video analysis in pan-tilt-zoom camera networks. IEEE Signal Process. Mag. 27, 5, 78--90.

[23]

Lilia Paradis and Qi Han. 2007. A survey of fault management in wireless sensor networks. J. Netw. Syst. Manage. 15, 2, 171--190.

Digital Library

[24]

C. Poelman and T. Kanade. 1997. A paraperspective factorization method for shape and motion recovery. IEEE Trans. Pattern Anal. Mach. Intell. 19, 3, 206--218.

Digital Library

[25]

Juhua Pu, Zhang Xiong, and Xiaofeng Lu. 2009. Fault-tolerant deployment with k-connectivity and partial k-connectivity in sensor networks. Wirel. Commun. Mobile Comput. 9, 7, 909--919.

Digital Library

[26]

Cheng Qian and Hairong Qi. 2008. A distributed solution to detect targets in crowds using visual sensor networks. In Proceedings of the 2nd ACM/IEEE International Conference on Distributed Smart Cameras. 1--10.

[27]

M. Rahimi, D. Estrin, R. Baer, H. Uyeno, and J. Warrior. 2004. Cyclops, image sensing and interpretation in wireless networks. In Proceedings of the 2nd International Conference on Embedded Networked Sensor Systems (SenSys'04). ACM, New York, 311--311.

Digital Library

[28]

B. Rinner and W. Wolf. 2008. A bright future for distributed smart cameras. Proc. IEEE 96, 10, 1562--1564.

[29]

A. Rowe, A. Goode, D. Goel, and I. Nourbakhsh. 2007. Cmucam3: An open programmable embedded vision sensor. Tech. rep. CMU-RI-TR-07-13. Robotics Institute, Carnegie Mellon University.

[30]

Chiu-Ching Tuan, Yi-Chao Wu, Wei-Shiou Chang, and Wen-Tzeng Huang. 2010. Fault tolerance by quartile method in wireless sensor and actor networks. In Proceedings of the International Conference on Complex, Intelligent and Software Intensive Systems. 758--763.

Digital Library

[31]

Yun Wang, Fei Li, and Fang Fang. 2010. Poisson versus Gaussian distribution for object tracking in wireless sensor networks. In Proceedings of the 2nd International Workshop on Intelligent Systems and Applications. 1--4.

[32]

D. Yang, H. Gonzalez-Banos, and L. Guibas. 2003. Counting people in crowds with a real-time network of simple image sensors. In Proceedings of the 9th IEEE International Conference on Computer Vision, 122--129.

Digital Library

[33]

Mengjie Yu, H. Mokhtar, and M. Merabti. 2007. Fault management in wireless sensor networks. IEEE Wirel. Commun. 14, 6, 13--19.

Digital Library

Cited By

Bandarupalli ABhat AChaterji SReiter MKate ABagchi S(2024)SensorBFT: Fault-Tolerant Target Localization Using Voronoi Diagrams and Approximate Agreement2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS60910.2024.00026(186-197)Online publication date: 23-Jul-2024
https://doi.org/10.1109/ICDCS60910.2024.00026
Zhang SCao Y(2019)Cooperative Localization Approach for Multi-Robot Systems Based on State Estimation Error CompensationSensors10.3390/s1918384219:18(3842)Online publication date: 5-Sep-2019
https://doi.org/10.3390/s19183842
Papangelis KPotena DSmari WStorti EWu K(2019)Advanced technologies and systems for collaboration and computer supported cooperative workFuture Generation Computer Systems10.1016/j.future.2019.02.04195:C(764-774)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1016/j.future.2019.02.041
Show More Cited By

Index Terms

Collaborative localization in visual sensor networks
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
      1. Image processing

Recommendations

Multiple feature points representation in target localization of wireless visual sensor networks

This paper discusses the target localization problem in wireless visual sensor networks. Additive noises and measurement errors will affect the accuracy of target localization when the visual nodes are equipped with low-resolution cameras. In the goal ...
Coverage analysis for target localization in camera sensor networks

Camera sensor networks have recently emerged as a critical research topic. In this paper, we investigate the coverage problem for camera sensor networks. Specially, compared to the coverage problem for target detection which has been intensively studied, ...
Localization-Oriented Coverage in Wireless Camera Sensor Networks

In this paper, we investigate the coverage problem from the perspective of target localization for wireless camera sensor networks. We first propose a novel localization-oriented sensing model based on the perspective projection of camera sensors. Based ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Sensor Networks

ACM Transactions on Sensor Networks Volume 10, Issue 2

January 2014

609 pages

ISSN:1550-4859

EISSN:1550-4867

DOI:10.1145/2575808

Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 31 January 2014

Accepted: 01 December 2012

Revised: 01 October 2012

Received: 01 April 2012

Published in TOSN Volume 10, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Meliksah University, Turkey

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
505
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bandarupalli ABhat AChaterji SReiter MKate ABagchi S(2024)SensorBFT: Fault-Tolerant Target Localization Using Voronoi Diagrams and Approximate Agreement2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS60910.2024.00026(186-197)Online publication date: 23-Jul-2024
https://doi.org/10.1109/ICDCS60910.2024.00026
Zhang SCao Y(2019)Cooperative Localization Approach for Multi-Robot Systems Based on State Estimation Error CompensationSensors10.3390/s1918384219:18(3842)Online publication date: 5-Sep-2019
https://doi.org/10.3390/s19183842
Papangelis KPotena DSmari WStorti EWu K(2019)Advanced technologies and systems for collaboration and computer supported cooperative workFuture Generation Computer Systems10.1016/j.future.2019.02.04195:C(764-774)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1016/j.future.2019.02.041
Kyrkou CChristoforou ETimotheou STheocharides TPanayiotou CPolycarpou M(2018)Optimizing the Detection Performance of Smart Camera Networks Through a Probabilistic Image-Based ModelIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2017.265136228:5(1197-1211)Online publication date: May-2018
https://doi.org/10.1109/TCSVT.2017.2651362
Feng SWu CZhang Y(2017)Collaborative Synchronization Mechanism in Wireless Multimedia Sensor NetworksWireless Personal Communications: An International Journal10.1007/s11277-017-4276-296:2(1929-1943)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1007/s11277-017-4276-2
Kyrkou CChristoforou ETheocharides TPanayiotou CPolycarpou MCarmona-Galán RRodríguez-Vázquez Á(2015)A camera uncertainty model for collaborative visual sensor network applicationsProceedings of the 9th International Conference on Distributed Smart Cameras10.1145/2789116.2789130(86-91)Online publication date: 8-Sep-2015
https://dl.acm.org/doi/10.1145/2789116.2789130
Abbas A(2015)TrustLP: A trust-based localization protocol for wireless sensor networks2015 13th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt)10.1109/WIOPT.2015.7151115(529-536)Online publication date: May-2015
https://doi.org/10.1109/WIOPT.2015.7151115
Laoudias CTsangaridis PPolycarpou MPanayiotou CKyrkou CTheocharides T(2015)Cooperative fault-tolerant target tracking in Camera Sensor Networks2015 IEEE International Conference on Communications (ICC)10.1109/ICC.2015.7249382(6634-6639)Online publication date: Jun-2015
https://doi.org/10.1109/ICC.2015.7249382
Laoudias CTsangaridis PPolycarpou MPanayiotou CKyrkou CTheocharides T(2015)Fault-tolerant tracking of multiple targets in collaborative Camera Networks2015 European Control Conference (ECC)10.1109/ECC.2015.7331025(3191-3196)Online publication date: Jul-2015
https://doi.org/10.1109/ECC.2015.7331025
Wang XŞekercioğlu YDrummond T(2014)Vision-Based Cooperative Pose Estimation for Localization in Multi-Robot Systems Equipped with RGB-D CamerasRobotics10.3390/robotics40100014:1(1-22)Online publication date: 26-Dec-2014
https://doi.org/10.3390/robotics4010001

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents