research-article

Mobile video annotation for enhanced rich media communication during emergency handling

Authors:

Menelaos Bakopoulos,

Sofia Tsekeridou,

Ramjee PrasadAuthors Info & Claims

ISABEL '11: Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies

Article No.: 32, Pages 1 - 5

https://doi.org/10.1145/2093698.2093730

Published: 26 October 2011 Publication History

Abstract

In this work we present a novel video annotation and media enrichment methodology for enhanced visual communication among first responders (FRs) and their command centers complementing voice communications in order to overcome current shortcomings of the latter. For this purpose, an initial taxonomy of emergency cases and sub-cases handled by a variety of FR teams has been defined along with a core set of associated rich media annotation templates to enrich captured video footage with commonly-agreed alert signs and messages. The primary aim is to define a fully-functional, extensible and self-descriptive visual language for fast and self-explanatory emergency communication. FRs on site equipped with mobile devices (PDAs) are able to quickly author content enriched video alerts to effectively communicate the arisen situation to their Command centers using the subsequently proposed video annotation prototype. Both qualitative and quantitative system evaluation in lab tests and field trials with the participation of real end users prove the effectiveness of the proposed system.

References

[1]

Schöning, J., Rohs, M., Krüger, A. and Stasch, C. Improving the Communication ofSpatial Information in Crisis Response by Combining Paper Maps and Mobile Devices. SpringerVerlag Berlin, Heidelberg, Germany, 2009.

[2]

Rothkrantz, L., J. M., Datcu, D., Fitrianie, S. and Tatomir, B. Personal Mobile Support for Crisis Management Using Ad-Hoc Networks. In Proc of The 11th International Conference on Human Computer Interaction (Las Vegas, Nevada, USA, 22--27 July 2005).

[3]

Fintrianie, S. and Rothkrantz, L. J. M. A Visual Communication Language for Crisis Management. The International Journal of Intelligent Control and Systems, 12, 2 (June 2007), 208 216.

[4]

Tatomir, B. and Rothkrantz, L. Crisis Management using Mobile ad-hoc Wireless Networks. In Proc of Second International Conference on Information Systems for Crisis Response and Management (Brussels, Belgium, April 18--20 2005).

[5]

Amanatiadis, A. A., Chrysostomou, D., Koulouriotis, D. and Gasteratos, A. A Fuzzy Multi-Sensor Architecture for Indoor Navigation. In Proc of IEEE International Conference on Imaging Systems and Techniques (Thessaloniki, Greece, July 2010).

[6]

Krejcar, O. User Localization for Intelligent Crisis Management. Artificial Intelligence Applications and Innovations, (2042006), 221--227.

[7]

Concejero, P., Munuera, J. and Lorenz, M. The MESH Mobile Video Annotation Tool. In Proc of the Nordic Conference on Human-ComputerIinteraction. (Lund, Sweden, 2008).

Digital Library

[8]

Lahti, J., Jarvinen, S., Peltola, J., Vildjiounaite, E. and Palola, M. Context Aware Capture and Sharing of Mobile Videos. IGI Global, Hershey, PA, 2009.

[9]

Lahti, J., Westermann, U., Palola, M., Peltola, J., and Vildjiounaite, E. MobiCon: integrated capture, annotation, and sharing of video clips with mobile phones. In Proc of ACM Multimedia. 2005, 798--799.

Digital Library

[10]

Catarci, T., De Tiziana, M., Marrella, A., Mecella, M., Salvatore, B., Vetere, G., Dustdar, S., Juszczyk, L., Manzoor, A. and Truong, H.-L. Pervasive software environments for supporting disaster responses. IEEE Internet Computing, Volume 12 Issue 1 (January 2008).

Digital Library

[11]

Samadi, S. and Paparo, A. What's a rich media ad, anyway?. http://googleblog.blogspot.com/2009/04/whats-rich-media-ad-anyway.html

[12]

Bakopoulos, M., Tsekeridou, S., Giannaka, E., Tan, Z.-H. and Prasad, R. Command & Control: Information Merging, Selective Visualization and Decision Support for Emergency Handling. In Proceedings of the 8th International Conference on Information Systems for Crisis Response and Management (Lisbon, Portugal, May 8--11, 2011, 2011).

[13]

FFMPEG. http://www.ffmpeg.com

[14]

W3C Synchronized multimedia integration language. http://www.w3.org/AudioVideo/

[15]

Dick C. A. Bulterman, Jack Jansen, Kleanthis Kleanthous, Kees Blom, Daniel Benden. Ambulant: a fast, multi-platform open source SMIL player. In Proc of ACM Multimedia'2004. pp.492~495.

Digital Library

[16]

Deltour, R., Layaïda, N. and Weck, D. LimSee2: A Cross-Platform SMIL Authoring Tool. 2005. http://wam.inrialpes.fr/publications/2005/LimSee2-ERCIM.html

Cited By

Cunha BCorreia RPimentel MPinheiro de Cristo Mde Oliveira DMachado Pereira ABenevenuto FMoreno MRoesler V(2015)Mobile Video AnnotationsProceedings of the 21st Brazilian Symposium on Multimedia and the Web10.1145/2820426.2820449(245-252)Online publication date: 27-Oct-2015
https://dl.acm.org/doi/10.1145/2820426.2820449
Cunha BMachado Neto OPimentel MMarinai SMarriott K(2013)MoViAProceedings of the 2013 ACM symposium on Document engineering10.1145/2494266.2494267(219-222)Online publication date: 10-Sep-2013
https://dl.acm.org/doi/10.1145/2494266.2494267

Index Terms

Mobile video annotation for enhanced rich media communication during emergency handling
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Understanding the use of social media by organisations for crisis communication

Many businesses have commenced using social media for crisis communication with stakeholders. However there is little guidance in literature to assist organisational crisis managers with the selection of an appropriate crisis response strategy. ...
The MESH mobile video annotation tool
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges

In this paper we describe the MESH Mobile Video Annotation tool, which provides a solution for a mobile user to make annotations of video files stored in his/her mobile device, using MESH ontology, in addition to free-text or manual annotations.

This ...
The dynamic role of social media during Hurricane #Sandy

Social media has introduced a key ingredient, and a potentially unfamiliar variable, into the practice of crisis communication. In this paper, the authors critically assess the social media milestones related to Hurricane Sandy according to situational ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ISABEL '11: Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies

October 2011

949 pages

ISBN:9781450309134

DOI:10.1145/2093698

Conference Chair:
Simone Frattasi,
Program Chair:
Nicola Marchetti

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Universitat Pompeu Fabra
IEEE
Technical University of Catalonia Spain: Technical University of Catalonia (UPC), Spain
River Publishers: River Publishers
CTTC: Technological Center for Telecommunications of Catalonia
CTIF: Kyranova Ltd, Center for TeleInFrastruktur

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ISABEL '11

Sponsor:

Technical University of Catalonia Spain
River Publishers
CTTC
CTIF

ISABEL '11: International Symposium on Applied Sciences in Biomedical and Communication Technologies

October 26 - 29, 2011

Barcelona, Spain

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
110
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cunha BCorreia RPimentel MPinheiro de Cristo Mde Oliveira DMachado Pereira ABenevenuto FMoreno MRoesler V(2015)Mobile Video AnnotationsProceedings of the 21st Brazilian Symposium on Multimedia and the Web10.1145/2820426.2820449(245-252)Online publication date: 27-Oct-2015
https://dl.acm.org/doi/10.1145/2820426.2820449
Cunha BMachado Neto OPimentel MMarinai SMarriott K(2013)MoViAProceedings of the 2013 ACM symposium on Document engineering10.1145/2494266.2494267(219-222)Online publication date: 10-Sep-2013
https://dl.acm.org/doi/10.1145/2494266.2494267

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents