demonstration

Models for video enrichment

Authors:

Benoît Encelle,

Pierre-Antoine Champin,

Yannick Prié,

Olivier AubertAuthors Info & Claims

DocEng '11: Proceedings of the 11th ACM symposium on Document engineering

Pages 85 - 88

https://doi.org/10.1145/2034691.2034710

Published: 19 September 2011 Publication History

Get Access

Abstract

Videos are commonly being augmented with additional content such as captions, images, audio, hyperlinks, etc., which are rendered while the video is being played. We call the result of this rendering "enriched videos". This article details an annotation-based approach for producing enriched videos: enrichment is mainly composed of textual annotations associated to temporal parts of the video that are rendered while playing it. The key notion of enriched video and associated concepts is first introduced and we second expose the models we have developed for annotating videos and for presenting annotations during the playing of the videos. Finally, an overview of a general workflow for producing/viewing enriched videos is presented. This workflow particularly illustrates the usage of the proposed models in order to improve the accessibility of videos for sensory disabled people.

References

[1]

O. Aubert and Y. Prié. 2007. Advene: an open-source framework for integrating and visualising audiovisual metadata. In 15th international conference on Multimedia (MULTIMEDIA '07). ACM, 1005--1008.

Digital Library

Google Scholar

[2]

D.C.A. Bulterman. 2003. Using SMIL to encode interactive, peer-level multimedia annotations. In 2003 ACM symposium on Document engineering (DocEng '03). ACM, 32--41.

Digital Library

Google Scholar

[3]

R.G. Cattelan, C. Teixeira, R. Goularte, and Maria Da Graça C. Pimentel. 2008. Watch-and-comment as a paradigm toward ubiquitous interactive video editing. ACM Trans. Multimedia Comput. Commun. Appl. 4, 4.

Digital Library

Google Scholar

[4]

J. Díaz Cintas. 2005. Back to the Future in Subtitling. In Marie Curie Euroconferences MuTra: Challenges of Multidimensional Translation, University of Saarland, 200.

Google Scholar

[5]

B. Encelle. Modèle pour la spécification de modèles de présentation d'annotations associées à des videos. Online : http://liris.cnrs.fr/Documents/Liris-5147.pdf. Accessed 06/14/11.

Google Scholar

[6]

L. Gagnon, S. Foucher, M. Heritier, M. Lalonde, D. Byrns, C. Chapdelaine, J. Turner, S. Mathieu, D. Laurendeau, N. T. Nguyen, and D. Ouellet. 2009. Towards computer-vision software tools to increase production and accessibility of video description for people with vision loss. Univers. Access Inf. Soc. 8, 3 (July 2009), 199--218.

Digital Library

Google Scholar

[7]

J. Geißler. Surfing the movie space: advanced navigation in movie-only hypermedia. In 3th international conference on Multimedia (MULTIMEDIA '95). ACM, 391--400.

Digital Library

Google Scholar

[8]

S. Pfeiffer and C. Parker. Accessibility for the HTML5 "video" element. In 6th International Cross-Disciplinary Conference on Web Accessibililty (W4A '09). ACM, 98--100.

Digital Library

Google Scholar

[9]

N. Sawhney, D. Balcom, and I. Smith. 1996. HyperCafe: narrative and aesthetic properties of hypervideo. In 7th ACM conference on Hypertext (HYPERTEXT '96). ACM, 1--10.

Digital Library

Google Scholar

[10]

W3C, Cascading Style Sheets Level 2 Revision 1 (CSS 2.1) Specification. Online : http://www.w3.org/TR/CSS2/. Accessed 06/14/11.

Google Scholar

[11]

1W3C, Web Content Accessibility Guidelines (WCAG) 2.0. Online : http://www.w3.org/TR/WCAG20/. Accessed 06/14/11.

Google Scholar

[12]

W3C, XML Path Language (XPath) 2.0. Online : http://www.w3.org/TR/xpath20/. Accessed 06/14/11.

Google Scholar

Cited By

View all

Nevsky ANeate TSimperl EVatavu R(2023)Accessibility Research in Digital Audiovisual Media: What Has Been Achieved and What Should Be Done Next?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596159(94-114)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596159
Gao WXiang WLiu XWang XSun L(2022)Impacts of Presenting Extra Information in Short Videos via Text and Voice on User Experience2022 14th International Conference on Quality of Multimedia Experience (QoMEX)10.1109/QoMEX55416.2022.9900918(1-6)Online publication date: 5-Sep-2022
https://doi.org/10.1109/QoMEX55416.2022.9900918
Uscamayta ACunha BMartins DPimentel MRoesler VValdeni de Lima JSaibel Santos CWillrich R(2017)Collaborative Ad-hoc Multimedia Authoring via Mobile DevicesProceedings of the 23rd Brazillian Symposium on Multimedia and the Web10.1145/3126858.3131572(61-64)Online publication date: 17-Oct-2017
https://dl.acm.org/doi/10.1145/3126858.3131572

Index Terms

Models for video enrichment
1. Applied computing
  1. Document management and text processing
    1. Document preparation
      1. Multi / mixed media creation

Recommendations

Video Annotation by Cascading Microtasks: a Crowdsourcing Approach
WebMedia '17: Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web

This paper presents a general approach to perform crowdsourcing video annotation without requiring trained workers nor experts. It consists of dividing complex annotation tasks into simple and small microtasks and cascading them to generate a final ...
Annotation-based video enrichment for blind people: a pilot study on the use of earcons and speech synthesis
ASSETS '11: The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility

Our approach to address the question of online video accessibility for people with sensory disabilities is based on video annotations that are rendered as video enrichments during the playing of the video. We present an exploratory work that focuses on ...
Using explicit discourse rules to guide video enrichment
WWW '13 Companion: Proceedings of the 22nd International Conference on World Wide Web

Video content analysis and named entity extraction are increasingly used to automatically generate content annotations for TV programs. A potential use of these annotations is to provide an entry point to background information that users can consume on ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

DocEng '11: Proceedings of the 11th ACM symposium on Document engineering

September 2011

296 pages

ISBN:9781450308632

DOI:10.1145/2034691

Conference Chair:
Matthew Hardy
Adobe Systems, Inc., USA
,
Program Chair:
Frank Wm. Tompa
University of Waterloo, Canada

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGDOC: ACM Special Interest Group for Design of Communications

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 September 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

DocEng '11

Sponsor:

SIGWEB

DocEng '11: ACM Symposium on Document Engineering

September 19 - 22, 2011

California, Mountain View, USA

Acceptance Rates

Overall Acceptance Rate 194 of 564 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
164
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Nevsky ANeate TSimperl EVatavu R(2023)Accessibility Research in Digital Audiovisual Media: What Has Been Achieved and What Should Be Done Next?Proceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596159(94-114)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596159
Gao WXiang WLiu XWang XSun L(2022)Impacts of Presenting Extra Information in Short Videos via Text and Voice on User Experience2022 14th International Conference on Quality of Multimedia Experience (QoMEX)10.1109/QoMEX55416.2022.9900918(1-6)Online publication date: 5-Sep-2022
https://doi.org/10.1109/QoMEX55416.2022.9900918
Uscamayta ACunha BMartins DPimentel MRoesler VValdeni de Lima JSaibel Santos CWillrich R(2017)Collaborative Ad-hoc Multimedia Authoring via Mobile DevicesProceedings of the 23rd Brazillian Symposium on Multimedia and the Web10.1145/3126858.3131572(61-64)Online publication date: 17-Oct-2017
https://dl.acm.org/doi/10.1145/3126858.3131572

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Video Annotation by Cascading Microtasks: a Crowdsourcing Approach

Annotation-based video enrichment for blind people: a pilot study on the use of earcons and speech synthesis

Using explicit discourse rules to guide video enrichment