Nothing Special   »   [go: up one dir, main page]
Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF
  • Research Article
  • Open access
  • Published:

Multi-Agent Framework in Visual Sensor Networks

EURASIP Journal on Advances in Signal Processing volume 2007, Article number: 098639 (2006) Cite this article

Abstract

The recent interest in the surveillance of public, military, and commercial scenarios is increasing the need to develop and deploy intelligent and/or automated distributed visual surveillance systems. Many applications based on distributed resources use the so-called software agent technology. In this paper, a multi-agent framework is applied to coordinate videocamera-based surveillance. The ability to coordinate agents improves the global image and task distribution efficiency. In our proposal, a software agent is embedded in each camera and controls the capture parameters. Then coordination is based on the exchange of high-level messages among agents. Agents use an internal symbolic model to interpret the current situation from the messages from all other agents to improve global coordination.

References

  1. Airport Surface Detection Equipment Model X (ASDE-X), https://doi.org/www.sensis.com/docs/128

  2. Weber ME, Stone ML: Low altitude wind shear detection using airport surveillance radars. IEEE Aerospace and Electronic Systems Magazine 1995,10(6):3–9. 10.1109/62.387970

    Article  Google Scholar 

  3. Pozzobon A, Sciutto G, Recagno V: Security in ports: the user requirements for surveillance system. In Advanced Video-Based Surveillance Systems. Edited by: Regazzoni CS, Fabri G, Vernazza G. Kluwer Academic, Boston, Mass, USA; 1998.

    Google Scholar 

  4. Avis P: Surveillance and Canadian maritime domestic security. Canadian Military Journal 2003,4(1):9–15.

    Google Scholar 

  5. Lo BPL, Sun J, Velastin SA: Fusing visual and audio information in a distributed intelligent surveillance system for public transport systems. Acta Automatica Sinica 2003,29(3):393–407.

    Google Scholar 

  6. Nwagboso C: User focused surveillance systems integration for intelligent transport systems. In Advanced Video-Based Surveillance Systems. Edited by: Regazzoni CS, Fabri G, Vernazza G. Kluwer Academic, Boston, Mass, USA; 1998:8–12. chapter 1.1

    Google Scholar 

  7. ADVISOR specification documents (internal classification 2001)

  8. https://doi.org/dilnxsrv.king.ac.uk/cromatica/

  9. Ronetti N, Dambra C: Railway station surveillance: the Italian case. In Multimedia Video Based Surveillance Systems. Edited by: Foresti GL, Mahonen P, Regazzoni CS. Kluwer Academic, Boston, Mass, USA; 2000:13–20.

    Chapter  Google Scholar 

  10. Pellegrini M, Tonani P: Highway traffic monitoring. In Advanced Video-Based Surveillance Systems. Edited by: Regazzoni CS, Fabri G, Vernazza G. Kluwer Academic, Boston, Mass, USA; 1998.

    Google Scholar 

  11. Beymer D, McLauchlan P, Coifman B, Malik J: A real-time computer vision system for measuring traffic parameters. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '97), June 1997, San Juan, Puerto Rico, USA 495–502.

    Chapter  Google Scholar 

  12. Zhi-Hong Z: Lane detection and car tracking on the highway. Acta Automatica Sinica 2003,29(3):450–456.

    Google Scholar 

  13. Jian-Guang L, Qi-Feing L, Tie-Niu T, Wei-Ming H: 3-D model based visual traffic surveillance. Acta Automatica Sinica 2003,29(3):434–449.

    Google Scholar 

  14. Ferryman JM, Maybank SJ, Worrall AD: Visual surveillance for moving vehicles. International Journal of Computer Vision 2000,37(2):187–197. 10.1023/A:1008155721192

    Article  MATH  Google Scholar 

  15. https://doi.org/www.detec.no

  16. https://doi.org/www.gotchanow.com

  17. https://doi.org/secure30.softcomca.com/fge_biz

  18. Brodsky T, Cohen R, Cohen-Solal E, et al.: Visual surveillance in retail stores and in the home. In Advanced Video-based Surveillance Systems. Kluwer Academic, Boston, Mass, USA; 2001:50–61. chapter 4

    Google Scholar 

  19. Cucchiara R, Grana C, Prati A, Tardini G, Vezzani R: Using computer vision techniques for dangerous situation detection in domotic applications. Proceedings of the IEE Workshop on Intelligent Distributed Surveillance Systems (IDSS '04), February 2004, London, UK 1–5.

    Google Scholar 

  20. Greenhill D, Remagnino P, Jones GA: VIGILANT: content querying of video surveillance streams. In Video-Based Surveillance Systems. Edited by: Remagnino P, Jones GA, Paragios N, Regazzoni CS. Kluwer Academic, Boston, Mass, USA; 2002:193–205.

    Chapter  Google Scholar 

  21. Micheloni C, Foresti GL, Snidaro L: A co-operative multicamera system for video-surveillance of parking lots. Proceedings of the IEE Workshop on Intelligent Distributed Surveillance Systems (IDSS '03), February 2003, London, UK 21–24.

    Google Scholar 

  22. Boult TE, Micheals RJ, Gao X, Eckmann M: Into the woods: visual surveillance of noncooperative and camouflaged targets in complex outdoor settings. Proceedings of the IEEE 2001,89(10):1382–1401. 10.1109/5.959337

    Article  Google Scholar 

  23. Xu M, Lowey L, Orwell J: Architecture and algorithms for tracking football players with multiple cameras. Proceedings of the IEE Workshop on Intelligent Distributed Surveillance Systems (IDSS '04), February 2004, London, UK 51–56.

    Chapter  Google Scholar 

  24. Krumm J, Harris S, Meyers B, Brumit B, Hale M, Shafer S: Multi-camera multi-person tracking for easy living. Proceedings of 3rd IEEE International Workshop on Visual Surveillance (VS '00), July 2000, Dublin, Ireland 3–10.

    Chapter  Google Scholar 

  25. Heikkilä J, Silvén O: A real-time system for monitoring of cyclists and pedestrians. Proceedings of 2nd IEEE International Workshop on Visual Surveillance (VS '99), 1999, Fort Collins, Colo, USA 74–81.

    Chapter  Google Scholar 

  26. Haritaoglu I, Harwood D, Davis LS:: real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):809–830. 10.1109/34.868683

    Article  Google Scholar 

  27. https://doi.org/www.cieffe.com

  28. https://doi.org/www.objectvideo.com

  29. https://doi.org/www.nice.com

  30. https://doi.org/www.pi-vision.com

  31. https://doi.org/www.ipsotek.com

  32. https://doi.org/www.neurodynamics.com

  33. Haritaoglu I, Harwood D, Davis LS: Hydra: multiple people detection and tracking using silhouettes. Proceedings of 2nd IEEE Workshop on Visual Surveillance (VS '99), July 1999, Fort Collins, Colo, USA 6–13.

    Chapter  Google Scholar 

  34. Batista J, Peixoto P, Araujo H: Real-time active visual surveillance by integrating peripheral motion detection with foveated tracking. Proceedings of the IEEE Workshop on Visual Surveillance (VS '98), January 1998, Bombay, India 18–25.

    Google Scholar 

  35. Ivanov Y, Bobick A, Liu J: Fast lighting independent background subtraction. International Journal of Computer Vision 2000,37(2):199–207. 10.1023/A:1008107805263

    Article  MATH  Google Scholar 

  36. Pless R, Brodsky T, Aloimonos Y: Detecting independent motion: the statistics of temporal continuity. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):768–773. 10.1109/34.868679

    Article  Google Scholar 

  37. Liu L-C, Chien J-C, Chuang HY-H, Li CC: A frame-level FSBM motion estimation architecture with large search range. Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '03), July 2003, Miami, Fla, USA 327–333.

    Google Scholar 

  38. Remagnino P, Baumberg A, Grove T, et al.: An integrated traffic and pedestrian model-based vision system. Proceedings of the British Machine Vision Conference (BMVC '97), 1997, Essex, UK 380–389.

    Google Scholar 

  39. Ng KC, Ishiguro H, Trivedi M, Sogo T: Monitoring dynamically changing environments by ubiquitous vision system. Proceedings of 2nd IEEE Workshop on Visual Surveillance (VS '99), July 1999, Fort Collins, Colo, USA 67–74.

    Chapter  Google Scholar 

  40. Orwell J, Remagnino P, Jones GA: Multi-camera colour tracking. Proceedings of the 2nd IEEE Workshop on Visual Surveillance (VS '99), July 1999, Fort Collins, Colo, USA 14–21.

    Chapter  Google Scholar 

  41. Darrell T, Gordon G, Woodfill J, Baker H, Harville M: Robust real-time people tracking in open environments using integrated stereo, color, and face detection. Proceedings of the 3rd IEEE Workshop on Visual Surveillance (VS '98), January 1998, Bombay, India 26–33.

    Google Scholar 

  42. Rota N, Thonnat M: Video sequence interpretation for visual surveillance. Proceedings of 3rd IEEE International Workshop on Visual Surveillance (VS '00), July 2000, Dublin, Ireland 59–68.

    Chapter  Google Scholar 

  43. Owens J, Hunter A: Application of the self-organising map to trajectory classification. Proceedings of 3rd IEEE International Workshop on Visual Surveillance (VS '00), July 2000, Dublin, Ireland 77–83.

    Chapter  Google Scholar 

  44. Stauffer C, Grimson WEL: Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):747–757. 10.1109/34.868677

    Article  Google Scholar 

  45. Stringa E, Regazzoni CS: Content-based retrieval and real time detection from video sequences acquired by surveillance systems. Proceedings of the IEEE International Conference on Image Processing (ICIP '98), October 1998, Chicago, Ill, USA 3: 138–142.

    Article  Google Scholar 

  46. Decleir C, Hacid M-S, Koulourndijan J: A database approach for modeling and querying video data. Proceedings of the 15th International Conference on Data Engineering (ICDE '99), March 1999, Sydney, Australia 1–22.

    Google Scholar 

  47. Makris D, Ellis T, Black J: Bridging the gaps between cameras. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04), June-July 2004, Washington, DC, USA 2: 205–210.

    Google Scholar 

  48. Black J, Ellis T, Rosin P: A novel method for video tracking performance evaluation. Proceedings of the IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, October 2003, Nice, France 125–132.

    Google Scholar 

  49. Valera M, Velastin SA: Intelligent distributed surveillance systems: a review. IEE Proceedings: Vision, Image and Signal Processing 2005,152(2):192–204. 10.1049/ip-vis:20041147

    Google Scholar 

  50. Shoham Y: Agent-oriented programming. Artificial Intelligence 1993,60(1):51–92. 10.1016/0004-3702(93)90034-9

    Article  MathSciNet  Google Scholar 

  51. Newell A: Unified Theories of Cognition. Harvard University Press, Cambridge, Mass, USA; 1990.

    Google Scholar 

  52. Brooks RA: A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation 1986,2(1):14–23.

    Article  Google Scholar 

  53. Labrou Y, Finin T, Peng Y: Agent communication languages: the current landscape. IEEE Intelligent Systems & Their Applications 1999,14(2):45–52. 10.1109/5254.757631

    Article  Google Scholar 

  54. Rao A, Georgeff M: BDI agents: from theory to practice. In Proceedings of the 1st International Conference on Multi-Agent Systems (ICMAS '95), June 1995, San Francisco, Calif, USA. Edited by: Lesser V. The MIT Press; 312–319.

    Google Scholar 

  55. Pokahr A, Braubach L, Lamersdorf W: Jadex: implementing a BDI-infrastructure for JADE agents. EXP - In Search of Innovation (Special Issue on JADE), September 2003 3(3):76–85. https://doi.org/vsis-www.informatik.uni-hamburg.de/projects/jadex/

    Google Scholar 

  56. Bellifemine F, Poggi A, Rimassa G: Developing multi-agent systems with JADE. Proceedings of the 7th International Workshop Agent Theories Architectures and Languages (ATAL '00), July 2000, Boston, Mass, USA 89–103. https://doi.org/jade.tilab.com/

    MATH  Google Scholar 

  57. Nguyen NT, Venkatesh S, West G, Bui HH: Multiple camera coordination in a surveillance system. Acta Automatica Sinica 2003,29(3):408–422.

    Google Scholar 

  58. Bui HH, Venkatesh S, West GAW: Tracking and surveillance in wide-area spatial environments using the abstract hidden Markov model. International Journal of Pattern Recognition and Artificial Intelligence 2001,15(1):177–196. 10.1142/S0218001401000782

    Article  Google Scholar 

  59. Rath TM, Manmatha R: Features for word spotting in historical manuscripts. Proceedings of the 7th International Conference on Document Analysis and Recognition (ICDAR '03), August 2003, Edinburgh, Scotland 1: 218–222.

    Article  Google Scholar 

  60. Oates T, Schmill MD, Cohen PR: A method for clustering the experiences of a mobile robot that accords with human judgments. In Proceedings of the 7th National Conference on Artificial Intelligence and 12th Conference on Innovative Applications of Artificial Intelligence, July–August 2000, Austin, Tex, USA. AAAI Press; 846–851.

    Google Scholar 

  61. Nguyen NT, Bui HH, Venkatesh S, West G: Recognising and monitoring high-level behaviours in complex spatial environments. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '03), June 2003, Madison, Wis, USA 2: 620–625.

    Google Scholar 

  62. Ivanov YA, Bobick AF: Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):852–872. 10.1109/34.868686

    Article  Google Scholar 

  63. Pavlidis I, Morellas V, Tsiamyrtzis P, Harp S: Urban surveillance systems: from the laboratory to the commercial world. Proceedings of the IEEE 2001,89(10):1478–1497. 10.1109/5.959342

    Article  Google Scholar 

  64. Collins RT, Lipton AJ, Kanade T, et al.: A system for video surveillance and monitoring. In Tech. Rep. CMU-RI-TR-00-12. Robotics Institute, Carnegie Mellon University, Pittsburgh, Pa, USA; 2000.

    Google Scholar 

  65. Regazzoni CS, Ramesh V, Foresti GL: Special issue on video communications, processing, and understanding for third generation surveillance systems. Proceedings of the IEEE 2001,89(10):1355–1539.

    Article  Google Scholar 

  66. Christensen M, Alblas R: V2- design issues in distributed video surveillance systems. Department of Computer Science, Aalborg University, Aalborg, Denmark; 2000.

    Google Scholar 

  67. Collins RT, Lipton AJ, Fujiyoshi H, Kanade T: Algorithms for cooperative multisensor surveillance. Proceedings of the IEEE 2001,89(10):1456–1477. 10.1109/5.959341

    Article  Google Scholar 

  68. Yuan X, Sun Z, Varol Y, Bebis G: A distributed visual surveillance system. Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '03), July 2003, Miami, Fla, USA 199–205.

    Google Scholar 

  69. Pavlidis I, Morellas V: Two examples of indoor and outdoor surveillance systems. In Video Based Surveillance Systems: Computer Vision and Distributed Processing. Edited by: Remagnino P, Graeme JA, Paragios N, Regazzoni C. Kluwer Academic, Boston, Mass, USA; 2002:39–50.

    Chapter  Google Scholar 

  70. Besada JA, García J, Portillo J, Molina JM, Varona A, Gonzalez G: Airport surface surveillance based on video images. IEEE Transactions on Aerospace and Electronic Systems 2005,41(3):1075–1082. 10.1109/TAES.2005.1541452

    Article  Google Scholar 

  71. García J, Molina JM, Besada JA, Portillo JI: A multitarget tracking video system based on fuzzy and neuro-fuzzy techniques. EURASIP Journal on Applied Signal Processing 2005,2005(14):2341–2358. special issue on Advances in Intelligent Vision Systems: Methods and Applications 10.1155/ASP.2005.2341

    MATH  Google Scholar 

  72. García J, Pérez O, Berlanga A, Molina JM: An evaluation metric for adjusting parameters of surveillance video systems. In Focus on Robotics and Intelligent Systems Research. Nova Science, New York, NY, USA; 2004.

    Google Scholar 

  73. Pérez O, García J, Berlanga A, Molina JM: Evolving parameters of surveillance video systems for non-overfitted learning. Proceedings of the 7th European Workshop on Evolutionary Computation in Image Analysis and Signal Processing (EvoIASP '05), March-April 2005, Lausanne, Switzerland 386–395.

    Google Scholar 

  74. Varshney PK, Coman IL: Distributed multi-sensor surveillance: issues and recent advances. In Video-Based Surveillance Systems. Computer Vision and Distributed Processing. Kluwer Academic, Boston, Mass, USA; 2002:239–250.

    Chapter  Google Scholar 

  75. Marchesotti L, Piva S, Regazzoni C: An agent-based approach for tracking people in indoor complex environments. Proceedings of the 12th International Conference on Image Analysis and Processing (ICIAP '03), September 2003, Mantova, Italy 99–102.

    Google Scholar 

  76. Bratman M: Intention, Plans, and Practical Reason. Harvard University Press, Cambridge, Mass, USA; 1987.

    Google Scholar 

  77. Braubach L, Pokahr A, Moldt D, Lamersdorf W: Goal representation for BDI agent systems. Proceedings of the 2nd Workshop on Programming Multiagent Systems: Languages, Frameworks, Techniques, and Tools (ProMAS '04), July 2004, New York, NY, USA

    Google Scholar 

  78. Carbó J, Orfila A, Ribagorda A: Adaptive agents applied to intrusion detection. In Proceedings of the 3rd International Central and Eastern European Conference on Multi-Agent Systems (CEEMAS '03), June 2003, Prague, Czech Republic, Lecture Notes in Artificial Intelligence. Volume 2691. Springer; 445–453.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Grupo de Inteligencia Artificial Aplicada, Departamento de Informática, Universidad Carlos III de Madrid, Avda. Universidad Carlos III 22, Colmenarejo, Madrid, 28270, Spain

    M. A. Patricio, J. Carbó, O. Pérez, J. García & J. M. Molina

Authors
  1. M. A. Patricio
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. Carbó
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. O. Pérez
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. J. García
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. J. M. Molina
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. A. Patricio.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://doi.org/creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Patricio, M.A., Carbó, J., Pérez, O. et al. Multi-Agent Framework in Visual Sensor Networks. EURASIP J. Adv. Signal Process. 2007, 098639 (2006). https://doi.org/10.1155/2007/98639

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/98639

Keywords