research-article

Semi-interactive tracing of persons in real-life surveillance data

Authors:

Michael J. Metternich,

Marcel WorringAuthors Info & Claims

MiFor '10: Proceedings of the 2nd ACM workshop on Multimedia in forensics, security and intelligence

Pages 43 - 48

https://doi.org/10.1145/1877972.1877985

Published: 29 October 2010 Publication History

Abstract

To increase public safety, more and more surveillance cameras have been placed over the years. To deal with the resulting information overload many methods have been deployed, focusing either on real-time crime detection or post-incident investigation. In this paper we concentrate on post-incident investigation i.e. crime reconstruction using video data. For a complete crime reconstruction, the location of all persons of interest should be known before and during the incident. To do so, we follow persons within the field of view of a single camera (tracking) and between different cameras (tracing).

We present a semi-interactive approach to post-incident investigation. This method is specifically capable of tracking and tracing persons of interest. Our system supports the analytical reasoning process of the investigator with automatic analysis, visualization methods, and interaction processing. We show that the automatic tracing method significantly speeds up tracing of persons with clear visual characteristics. Tracing of persons without obvious characteristics is an inherently difficult task, but we show that intelligent use of interactive methods greatly improves the tracing performance of our system.

References

[1]

A. Alahi, P. Vandergheynst, M. Bierlaire, and M. Kunt. Cascade of descriptors to detect and trace objects across any network of cameras. In CVIU, 2010.

Digital Library

[2]

J. Black and T. Ellis. Multi camera image tracking. In IVC, 2006.

[3]

S. Calderara, A. Prati, and R. Cucchiara. Hecol. Homography and epipolar-based consistent labeling for outdoor park surveillance. In CVIU, 2008.

Digital Library

[4]

N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In CVPR, 2005.

Digital Library

[5]

P. Dollar, C. Wojek, B. Schiele, and P. Perona. Pedestrian detection: A benchmark. In CVPR, 2009.

[6]

M. Farenzena, L. Bazzani, A. Perina, V. Murino, and M. Cristani. Person re-identification by symmetry-driven accumulation of local features. In CVPR, 2010.

[7]

W. Forstner and B. Moonen. A metric for covariance matrices. In Qua vadis geodesia, 1999.

[8]

D. Gray, S. Brennan, and H. Tao. Evaluating appearance models for recognition, reacquisition, and tracking. In PETS, 2007.

[9]

D. Gray and H. Tao. Viewpoint invariant pedestrian recognition with an ensemble of localized features. In ECCV, 2008.

Digital Library

[10]

T. Huang, C. Dagli, S. Rajaram, E. Chang, M. Mandel, G. Poliner, and D. Ellis. Active learning for interactive multimedia retrieval. In ICPR, 2008.

[11]

F. Janoos, S. Singh, O. Irfanoglu, R. Parent, and R. Machiraju. Activity analysis using spatio-temporal activity maps in surveillance applications. In VAST. 2007.

Digital Library

[12]

A. Khashman. Modes: moving objects detection and extraction system. In ACC, 2008.

Digital Library

[13]

P. Koppen and M. Worring. Multi-target tracking in time-lapse video forensics. In MiFor, 2009.

Digital Library

[14]

G. Lavee, M. Rudzsky, E. Rivlin, and A. Borzin. Video event modeling and recognition in generalized stochastic petri nets. In CirSysVideo, 2010.

[15]

Y. Livnat, J. Agutter, S. Moon, and S. Foresti. Visual correlation for situational awareness. In INFOVIS. 2005.

Digital Library

[16]

W. E. Mackay and G. Davenport. Virtual video editing in interactive multimedia applications. In Commun. ACM, 1989.

Digital Library

[17]

M. Metternich, M. Worring, and A. W. M. Smeulders. Color based tracing in real-life surveillance data. In Springer Trans. on DHMS, In Press, 2010.

Digital Library

[18]

R. J. Radke, S. Andra, O. Al-Kofahi, and B. Roysam. Image change detection algorithms: A systematic survey. In IEEE Trans. on Image Processing, 2005.

Digital Library

[19]

J. Rocchio. Salton: the Smart Retrieval System. Experiments in Automatic Document Processing. chapter Relevance Feedback in Information Retrieval. 1971.

[20]

O. Tuzel, F. Porikli, and P. Meer. Region covariance. A fast descriptor for detection and classification. In ECCV, 2006.

Digital Library

[21]

A. Yilmaz, O. Javed, and M. Shah. Object tracking. A survey. In ACM Comput. Surv., 2006.

Digital Library

[22]

Z. Zivkovic and F. van der Heijden. Efficient adaptive density estimation per image pixel for the task of background subtraction. In Pattern Recognition Letters, 2006.

Digital Library

Cited By

Hamid AMelaku LPelillo MPrati ACarmona-Galán RRodríguez-Vázquez Á(2015)Using dominant sets for data association in multi-camera trackingProceedings of the 9th International Conference on Distributed Smart Cameras10.1145/2789116.2789126(38-43)Online publication date: 8-Sep-2015
https://dl.acm.org/doi/10.1145/2789116.2789126
Wu YMinoh MMukunoki MLi WLao S(2012)Collaborative Sparse Approximation for Multiple-Shot Across-Camera Person Re-identificationProceedings of the 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance10.1109/AVSS.2012.21(209-214)Online publication date: 18-Sep-2012
https://dl.acm.org/doi/10.1109/AVSS.2012.21
Coppi DCalderara SCucchiara R(2011)Appearance tracking by transduction in surveillance scenariosProceedings of the 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance10.1109/AVSS.2011.6027309(142-147)Online publication date: 30-Aug-2011
https://dl.acm.org/doi/10.1109/AVSS.2011.6027309
Show More Cited By

Index Terms

Semi-interactive tracing of persons in real-life surveillance data
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
      2. Computer vision tasks
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Perception

Recommendations

Color based tracing in real-life surveillance data
Transactions on data hiding and multimedia security V

For post incident investigation a complete reconstruction of an event is needed based on surveillance footage of the crime scene and surrounding areas. Reconstruction of the whereabouts of the people in the incident requires the ability to follow ...
Track based relevance feedback for tracing persons in surveillance videos

While surveillance cameras are a powerful tool for the prevention, detection and resolving of crimes, for most cases the amount of video data has become unmanageable. To ease the analysis, various automatic methods have been proposed, focusing on data-...
Groupware Accessibility for Persons with Disabilities
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services

The accessibility issues of Groupware applications prevent visually impaired and other persons with disabilities access to these highly graphical interfaces. To address the accessibility issues persons with disabilities have with Groupware, a recent ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MiFor '10: Proceedings of the 2nd ACM workshop on Multimedia in forensics, security and intelligence

October 2010

134 pages

ISBN:9781450301572

DOI:10.1145/1877972

Program Chairs:
Sebastiano Battiato
University of Catania, Italy
,
Sabu Emmanuel
Nanyang Technological University, Singapore
,
Adrian Ulges
German Research Center for Artificial Intelligence, Germany
,
Marcel Worring
University of Amsterdam, The Netherlands

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '10

Sponsor:

SIGMM

MM '10: ACM Multimedia Conference

October 29, 2010

Firenze, Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
122
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hamid AMelaku LPelillo MPrati ACarmona-Galán RRodríguez-Vázquez Á(2015)Using dominant sets for data association in multi-camera trackingProceedings of the 9th International Conference on Distributed Smart Cameras10.1145/2789116.2789126(38-43)Online publication date: 8-Sep-2015
https://dl.acm.org/doi/10.1145/2789116.2789126
Wu YMinoh MMukunoki MLi WLao S(2012)Collaborative Sparse Approximation for Multiple-Shot Across-Camera Person Re-identificationProceedings of the 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance10.1109/AVSS.2012.21(209-214)Online publication date: 18-Sep-2012
https://dl.acm.org/doi/10.1109/AVSS.2012.21
Coppi DCalderara SCucchiara R(2011)Appearance tracking by transduction in surveillance scenariosProceedings of the 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance10.1109/AVSS.2011.6027309(142-147)Online publication date: 30-Aug-2011
https://dl.acm.org/doi/10.1109/AVSS.2011.6027309
Battiato SEmmanuel SUlges AWorring Mdel Bimbo AChang SSmeulders A(2010)Second ACM international workshop on multimedia in forensics, security and intelligence (MiFor 2010)Proceedings of the 18th ACM international conference on Multimedia10.1145/1873951.1874348(1741-1742)Online publication date: 25-Oct-2010
https://dl.acm.org/doi/10.1145/1873951.1874348

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten