research-article

Spatio-temporal Validation of Multimedia Documents

Authors:

Joel A.F. dos Santos,

Christiano Braga,

Débora C. Muchaluat-Saade,

Cécile Roisin,

Nabil LayaïdaAuthors Info & Claims

DocEng '15: Proceedings of the 2015 ACM Symposium on Document Engineering

Pages 133 - 142

https://doi.org/10.1145/2682571.2797060

Published: 08 September 2015 Publication History

Abstract

A multimedia document authoring system should provide analysis and validation tools that help authors find and correct mistakes before document deployment. Although very useful, multimedia validation tools are not often provided. Spatial validation of multimedia documents may be performed over the initial position of media items before presentation starts. However, such an approach does not lead to ideal results when media item placement changes over time. Some document authoring languages allow the definition of spatio-temporal relationships among media items and they can be moved or resized during runtime. Current validation approaches do not verify dynamic spatio-temporal relationships. This paper presents a novel approach for spatio-temporal validation of multimedia documents. We model the document state, extending the Simple Hypermedia Model (SHM), comprising media item positioning during the whole document presentation. Mapping between document states represent time lapse or user interaction. We also define a set of atomic formulas upon which the author's expectations related to the spatio-temporal layout can be described and analyzed.

References

[1]

J. F. Allen. Maintaining Knowledge about Temporal Intervals. Communications of the ACM, 26(11):832--843, 1983.

Digital Library

[2]

C. W. Barrett, R. Sebastiani, S. A. Seshia, and C. Tinelli. Satisfiability modulo theories. Handbook of satisfiability, 185:825--885, 2009.

[3]

L. Belouaer and F. Maris. SMT Spatio-Temporal Planning. In ICAPS 2012 Workshop on Constraint Satisfaction Techniques for Planning and Scheduling Problems (COPLAS 2012), pages 6--15, 2012.

[4]

E. Bertino, E. Ferrari, A. Perego, and D. Santi. A Constraint-Based Approach for the Authoring of Multi-Topic Multimedia Presentations. In IEEE International Conference on Multimedia and Expo, pages 578--581, Amsterdam, Netherlands, July 2005. IEEE Computer Society.

[5]

A. Bossi and O. Gaggi. Analysis and verification of SMIL documents. Multimedia Systems, 17(6):487--506, 2011.

Digital Library

[6]

M. Clavel, S. Eker, F. Durán, P. Lincoln, N. Martí-Oliet, and J. Meseguer. All about Maude - A High-performance Logical Framework: how to Specify, Program, and Verify Systems in Rewriting Logic, volume 4350. Springer-Verlag New York Inc, 2007.

Digital Library

[7]

M. de Oliveira, M. Turine, and P. Masiero. A statechart-based model for hypermedia applications. ACM Transactions on Information Systems (TOIS), 19(1):52, 2001.

Digital Library

[8]

J. A. F. dos Santos, C. Braga, and D. C. Muchaluat-Saade. A Model-driven Approach for the Analysis of Multimedia Document. In SLE (Doctoral Symposium), pages 37--44, Dresden, Germany, 2012.

[9]

J. A. F. dos Santos, C. Braga, and D. C. Muchaluat-Saade. An Executable Semantics for a Multimedia Authoring Language. In Formal Methods: Foundations and Applications, pages 67--82. Springer, Brasília, Brazil, 2013.

[10]

B. Dutertre. Yices 2.2. In A. Biere and R. Bloem, editors, Computer-Aided Verification (CAV'2014), volume 8559 of Lecture Notes in Computer Science, pages 737--744. Springer, July 2014.

Digital Library

[11]

S. Elias, K. Easwarakumar, and R. Chbeir. Dynamic consistency checking for temporal and spatial relations in multimedia presentations. In Proceedings of the 2006 ACM symposium on Applied computing, pages 1380--1384, Dijon, France, 2006. ACM.

Digital Library

[12]

M. F. Felix. Formal Analysis of Software Models Oriented by Architectural Abstractions. PhD thesis, Pontifícia Universidade Católica do Rio de Janeiro, 2004. in Portuguese.

[13]

H. L. Hardman. Modeling and Authoring Hypermedia Documents. PhD thesis, Universität Amsterdam, 1998.

[14]

ITU. Nested Context Language (NCL) and Ginga-NCL for IPTV services. http://www.itu.int/rec/T-REC-H.761--200904-S, 2009. ITU-T Recommendation H.761.

[15]

Júnior, D. P. and Farines, J. and Koliver, C. An Approach to Verify Live NCL Applications. In Proceedings of the 18th Brazilian Symposium on Multimedia and the Web, pages 223--232, São Paulo, Brazil, 2012. ACM.

Digital Library

[16]

P. King, P. Schmitz, and S. Thompson. Behavioral reactivity and real time programming in xml: functional programming meets smil animation. In Proceedings of the 2004 ACM symposium on Document engineering, pages 57--66. ACM, 2004.

Digital Library

[17]

S. Laborie, J. Euzenat, and N. Layaïda. Semantic adaptation of multimedia documents. Multimedia tools and applications, 55(3):379--398, 2011.

Digital Library

[18]

A. Pnueli. The temporal logic of programs. In 18th Annual Symposium on Foundations of Computer Science, pages 46--57, Providence, USA, 1977. IEEE.

Digital Library

[19]

D. A. Randell, Z. Cui, and A. G. Cohn. A spatial logic based on regions and connection. Principles of Knowledge Representation and Reasoning, pages 165--176, 1992.

[20]

C. Santos, L. Soares, G. de Souza, and J. Courtiat. Design methodology and formal validation of hypermedia documents. In Proceedings of the sixth ACM International Conference on Multimedia, pages 39--48, Bristol, United Kingdom, 1998. ACM.

Digital Library

[21]

L. F. G. Soares and S. D. J. Barbosa. Programming in NCL 3.0: developing applications for the Ginga middleware, Digital TV and Web. Elsevier, 2009. in Portuguese.

[22]

L. F. G. Soares, R. F. Rodrigues, and D. C. Muchaluat-Saade. Modeling, authoring and formatting hypermedia documents in the HyperProp system. Multimedia Systems, 2000.

Digital Library

[23]

W3C. Synchronized Multimedia Integration Language - SMIL 3.0 Specification. http://www.w3c.org/TR/SMIL3, 2008. World-Wide Web Consortium Recommendation.

Cited By

Jain AKerne ALupfer NBritain GPerrine AChoe YKeyser JHuang RHealy PBilauca MBonnici A(2021)Recognizing creative visual designProceedings of the 21st ACM Symposium on Document Engineering10.1145/3469096.3469869(1-10)Online publication date: 16-Aug-2021
https://dl.acm.org/doi/10.1145/3469096.3469869
Santos JMuchaluat-Saade DRoisin CLayaïda N(2018)A Hybrid Approach for Spatio-Temporal Validation of Declarative Multimedia DocumentsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/326712714:4(1-24)Online publication date: 30-Oct-2018
https://dl.acm.org/doi/10.1145/3267127
de Mattos DMuchaluat-Saade D(2018)STEVEProceedings of the ACM Symposium on Document Engineering 201810.1145/3209280.3209521(1-10)Online publication date: 28-Aug-2018
https://dl.acm.org/doi/10.1145/3209280.3209521
Show More Cited By

Index Terms

Spatio-temporal Validation of Multimedia Documents

Recommendations

Challenges in Interactive Multimedia Document Consistency Verification
Webmedia '16: Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web

A multimedia document may be specified manually or automatically generated, instantiated, adapted or has its content and structure dynamically edited. Therefore, changes in a document specification may occur from its creation to its execution. Such ...
A Hybrid Approach for Spatio-Temporal Validation of Declarative Multimedia Documents
Special Section on Deep Learning for Intelligent Multimedia Analytics

Declarative multimedia documents represent the description of multimedia applications in terms of media items and relationships among them. Relationships specify how media items are dynamically arranged in time and space during runtime. Although a ...
Specifying temporal behavior in interactive multimedia documents

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DocEng '15: Proceedings of the 2015 ACM Symposium on Document Engineering

September 2015

248 pages

ISBN:9781450333078

DOI:10.1145/2682571

General Chair:
Christine Vanoirbeek
EPFL, Switzerland
,
Program Chair:
Pierre Genevès
CNRS, France

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

DocEng '15

Sponsor:

SIGWEB

DocEng '15: ACM Symposium on Document Engineering 2015

September 8 - 11, 2015

Lausanne, Switzerland

Acceptance Rates

DocEng '15 Paper Acceptance Rate 11 of 31 submissions, 35%;

Overall Acceptance Rate 194 of 564 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
108
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jain AKerne ALupfer NBritain GPerrine AChoe YKeyser JHuang RHealy PBilauca MBonnici A(2021)Recognizing creative visual designProceedings of the 21st ACM Symposium on Document Engineering10.1145/3469096.3469869(1-10)Online publication date: 16-Aug-2021
https://dl.acm.org/doi/10.1145/3469096.3469869
Santos JMuchaluat-Saade DRoisin CLayaïda N(2018)A Hybrid Approach for Spatio-Temporal Validation of Declarative Multimedia DocumentsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/326712714:4(1-24)Online publication date: 30-Oct-2018
https://dl.acm.org/doi/10.1145/3267127
de Mattos DMuchaluat-Saade D(2018)STEVEProceedings of the ACM Symposium on Document Engineering 201810.1145/3209280.3209521(1-10)Online publication date: 28-Aug-2018
https://dl.acm.org/doi/10.1145/3209280.3209521
Picinin DFarines JSantos CKoliver C(2018)A design-oriented method to build correct hypermedia documentsMultimedia Tools and Applications10.1007/s11042-017-5325-277:16(21003-21032)Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1007/s11042-017-5325-2
Ferreira CMaia LSalles CTrinta FViana W(2017)A Model-Based Approach for Designing Location-Based Games2017 16th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)10.1109/SBGames.2017.00012(29-38)Online publication date: Nov-2017
https://doi.org/10.1109/SBGames.2017.00012
Mattos DMuchaluat Saade Dde Jesus Lima Gomes Fde Andrade Lira Rabelo Rde Salles Soares Neto CWillrich RCamillo Teixeira Cde Almeida Jde Carvalho W(2016)STEVEProceedings of the 22nd Brazilian Symposium on Multimedia and the Web10.1145/2976796.2976865(63-70)Online publication date: 8-Nov-2016
https://dl.acm.org/doi/10.1145/2976796.2976865
Poli JBoudet LMercier D(2016)Online temporal reasoning for event and data streams processing2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)10.1109/FUZZ-IEEE.2016.7737974(2257-2264)Online publication date: Jul-2016
https://doi.org/10.1109/FUZZ-IEEE.2016.7737974

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents