article

Structured multimedia authoring

Authors:

Dick C. A. Bulterman,

Lynda HardmanAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 1, Issue 1

Pages 89 - 109

https://doi.org/10.1145/1047936.1047943

Published: 01 February 2005 Publication History

Abstract

Authoring context sensitive, interactive multimedia presentations is much more complex than authoring either purely audiovisual applications or text. Interactions among media objects need to be described as a set of spatio-temporal relationships that account for synchronous and asynchronous interactions, as well as on-demand linking behavior. This article considers the issues that need to be addressed by an authoring environment. We begin with a partitioning of concerns based on seven classes of authoring problems. We then describe a selection of multimedia authoring environments within four different authoring paradigms: structured, timeline, graph and scripting. We next provide observations and insights into the authoring process and argue that the structured paradigm provides the most useful framework for presentation authoring. We close with an example application of the structured multimedia authoring paradigm in the context of our own structure-based system GRiNS.

References

[1]

Adobe Systems 2002. Encore 1.5 DVD Editing Software. See: http://www.adobe.com/.

[2]

Baekcer, R., Rosenthal, A. J., Friedlander, N., Smith, E., and cohen, A. 1996. A multimedia system for authoring motion pictures. In Proceedings of the ACM Multimedia '96, (Boston, Mass, Nov), ACM, New York, 31--42.

[3]

Bailey, B., Konstan, J., Cooley, R., and Dejong, M. 1998. Nsync-A toolkit for building interactive multimedia presentations. In Proceedings of the ACM Multimedia '98 (Bristol, UK), ACM, New York, 257--266.

[4]

Buchanan, M. C. and Zellweger, P. T. 2005. Automatic temporal layout mechanisms revisited, ACM Trans. Multimed. Comput. Commun. Appl. 1(1)., 60--88.

Digital Library

[5]

Bulterman, D. C. A. 2003. Using SMIL to encode interactive, peer-level multimedia annotations. In Proceedings of the ACM Symposium on Document Engineering 2003 (Grenoble, France, Nov.). ACM, New York, 32--41.

[6]

Bulterman, D. C. A., Hardman, L., Jansen, J., Mullender, K. S., and Rutledge, L. 1997. GRiNS: A graphical interface for SMIL. In Proceedings of WWW-7 (Brisbane, Australia).

[7]

Bulterman, D. C. A., Jansen, J., Kleanthis, K. Blom K., and Benden, D. 2004. The ambulant SMIL 2.0 open source SMIL player. In Proceedings of ACM Multimedia 2004 (New York, N.Y., Oct.). ACM, New York, 492--495.

[8]

Bulterman, D. C. A. and Rutledge, L. 2004. SMIL 2.0: Interactive multimedia for web and mobile devices. Springer-Verlag, Heidelberg, Germany, ISBN: 3-540-20234-X.

[9]

Bulterman, D. C. A., Van Rossum, G., and Van Liere, R., 1991. A structure for transportable, dynamic, multimedia documents. In Proceedings of the Summer USENIX Conference (Nashvile, Tenn.). 137--155.

[10]

Eun, S., No, E. S., Kim, H. C., Yoon, H., and Maeng, S. R. 1994. Eventor: An authoring system for interactive multimedia applications. Multimed. Syst. 2, 129--140.

Digital Library

[11]

Falkovych, K., Werner, J., and Nack, F. 2004. Semantic-based support for the semi-atomatic construction of multimedia presentation. Position paper In Proceedings of the 1st International Workshop on Interaction Design and the Semantic Web (New York, N.Y., May).

[12]

Fujikawa, K., Shimojo, S., Matsuura, T., Nishio, S., and Miyahara, H. 1991. Multimedia presentation system ‘harmony’ with temporal and active media. In Proceedings of the Summer 1991 USENIX Conference. (Nashville, Tenn., June). 75--93.

[13]

Hamakawa, R. and Rekimoto, J. 1994. Object composition and playback models for handling multimedia data. Multimed. Syst. 2, 26--35.

Digital Library

[14]

Hardman, L. 1998. Modelling and authoring hypermedia documents. Ph.D. dissertation. Univ. Amsterdam. ISBN: 90-74795-93-5. (Available at http://www.cwi.nl/~lynda/thesis/.)

[15]

Hardman, L. and Bulterman, D. C. A. 1995. Authoring support for durable interactive multimedia presentation. In State of the Art Report in Eurographics'95 (Maastricht, The Netherlands, Aug. 29--Sept. 1). (Available at http://ftp.cwi.nl/mmpapers/eg95/pa.gz.)

[16]

Hardman, L., Bulterman, D. C. A., and Van Rossum, G. 1994. The Amsterdam hypermedia model: Adding tune and context to the Dexter model. Commun. ACM 37, 2(Feb.), 50--62.

Digital Library

[17]

Hardman, L., Schmitz, P., Van Ossenbruggen, J., Ten Kate, W. R. T., and Rutledge, L. 2000. The link vs. the event: Activating and deactivating elements in time-based hypermedia. In New Rev. Hypermed. Multimed. 6 89--109.

[18]

Hardman, L., Van Rossum G., and Bulterman, D. C. A. 1993. Structured multimedia authoring. In Proceedings of ACM Multimedia '93 (Anaheim, Clif., Aug.). ACM, New York, 283--289.

[19]

Hodges, M. E., Sasnett, R. M., and Ackerman, M. S. 1989. A construction set for multimedia applications. IEEE Soft. (6), 1(Jan.), 37--43.

[20]

Ietf (Internet Engineering Task Force). 1996. Realtime streaming protocol, http://www.cs.columbia.edu/~hgs/rtp/.

[21]

Iso (International Standards Organization). 1999. ISO/IEC 14496:1999 (MPEG-4), Available at: http://wwwam.HHI.DE/mpeg-video/standards/mpeg-4.htm.

[22]

Koegel (Buford), J. F. and Heines, J. M. 1993. Improving visual programming languages for multimedia authoring. In Proceedings of ED-MEDIA '93, World Conference on Educational Multimedia and Hypermedia (Charlottsville, Va, June,) 286--293.

[23]

Koegel (Buford), J. F. (ED.). 1994. Multimedia Systems. Addison-Wesley, New York. ISBN 0-201-53258-1.

[24]

Little, T. D. C. and ghafoor, A. 1990. Multimedia object models for synchronization and databases. In Proceedings of the 6th International Conference on Data Engineering, (Los Angeles, Calif.), pages 20--27.

[25]

Macromedia. 1997. Authorware version 4. Director version 6. See: http://www.macromedia.com/.

[26]

Ogawa, R., Harada, H., and Kaneko, A. 1990. Scenario-based hypermedia: A model and a system. In Proceedings of ECHT '90 (Nov.). INRIA France, 38--51.

[27]

Rubin, B. and Davenport, G. 1989. Structured content modeling for cinematic information. SIGCHI Bull. (Oct.). 21 2, 78--79.

[28]

Siochi, A., Fox, E. A., Hix, D., Schwartz, E. E., Narasimhan, A., and Wake, W. 1991. The integrator: A prototype for flexible development of interactive digital multimedia applications. Interact. Multimed. 2 (3), 5--26.

[29]

Soares, L. F. G., Rodrigues, R., and Muchaluat Saade, D. 2000. Modeling, authoring and formatting hypermedia documents in the HyperProp system, Multimed. Syst. 8 (2). 118--134.

Digital Library

[30]

Tien, T. T. and Roisin, C. 2002. A multimedia model based on structured media and sub-elements for complex multimedia authoring and presentation. Internat. J. Softw. Eng. Knowl. Eng. 12 (5), 473--500.

[31]

Van Rossum, G. and Drake, F. 2003. A introduction to Python. Network Theory, Ltd. (See also: http://www.python.org/.)

[32]

Van Rossum, G., Jansen, J., Mullender, K. S., and Bulterman, D. C. A. 1993. CMIFed: a presentation environment for portable hypermedia documents. In Proceedings of ACM Multimedia'93 (Anaheim, Calif. Aug.). ACM, New York, 183--188.

[33]

Wam Reasearch Group 2003. The LimSee2 Authoring System for SMIL. See: http://wam.inrialpes.fr/software/limsee2/.

[34]

W3C (World Wide Web Consortium). 2001. Synchronized multimedia integration language, version 2.0.W3C Recommendation. Editors: J. Ayers, D. C. A. Bulterman, A. Cohen, et al., http://www.w3.org/TR/Rec-smil20/.

Cited By

İNAL MÇAKIR R(2021)Yabancı Dil Olarak Türkçe Öğretiminde Çoklu Ortam Materyallerinin KullanımıUse of Multimedia Materials in Teaching Turkish as a Foreign LanguageJournal of Interdisciplinary Education: Theory and Practice10.47157/jietp.9549463:2(87-112)Online publication date: 1-Dec-2021
https://doi.org/10.47157/jietp.954946
Mattos DMuchaluat-Saade DGhinea G(2021)Beyond Multimedia AuthoringACM Computing Surveys10.1145/346442254:7(1-31)Online publication date: 18-Jul-2021
https://dl.acm.org/doi/10.1145/3464422
Shu XWu JWu XLiang HCui WWu YQu H(2021)DancingWords: exploring animated word clouds to tell storiesJournal of Visualization10.1007/s12650-020-00689-024:1(85-100)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1007/s12650-020-00689-0
Show More Cited By

Index Terms

Structured multimedia authoring

Recommendations

Beyond Multimedia Authoring: On the Need for Mulsemedia Authoring Tools

The mulsemedia (Multiple Sensorial Media (MulSeMedia)) concept has been explored to provide users with new sensations using other senses beyond sight and hearing. The demand for producing such applications has motivated various studies in the mulsemedia ...
Structured multimedia authoring
MULTIMEDIA '93: Proceedings of the first ACM international conference on Multimedia
A collaborative multimedia authoring system based on the conceptual temporal relations
PCM'04: Proceedings of the 5th Pacific Rim Conference on Advances in Multimedia Information Processing - Volume Part II

We developed a SMIL-based collaborative multimedia authoring tool supporting a mechanism for conceptually representing the temporal relations between different media. Among the many editors that make up our system, the temporal relation editor provides ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 1, Issue 1

February 2005

125 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/1047936

Issue’s Table of Contents

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 February 2005

Published in TOMM Volume 1, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

97
Total Citations
View Citations
2,323
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)4

Reflects downloads up to 20 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

İNAL MÇAKIR R(2021)Yabancı Dil Olarak Türkçe Öğretiminde Çoklu Ortam Materyallerinin KullanımıUse of Multimedia Materials in Teaching Turkish as a Foreign LanguageJournal of Interdisciplinary Education: Theory and Practice10.47157/jietp.9549463:2(87-112)Online publication date: 1-Dec-2021
https://doi.org/10.47157/jietp.954946
Mattos DMuchaluat-Saade DGhinea G(2021)Beyond Multimedia AuthoringACM Computing Surveys10.1145/346442254:7(1-31)Online publication date: 18-Jul-2021
https://dl.acm.org/doi/10.1145/3464422
Shu XWu JWu XLiang HCui WWu YQu H(2021)DancingWords: exploring animated word clouds to tell storiesJournal of Visualization10.1007/s12650-020-00689-024:1(85-100)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1007/s12650-020-00689-0
Cao RDey SCunningham AWalsh JSmith RZucco JThomas B(2019)Examining the use of narrative constructs in data videosVisual Informatics10.1016/j.visinf.2019.12.002Online publication date: Dec-2019
https://doi.org/10.1016/j.visinf.2019.12.002
Babych BChen YEisele AHunsicker SPinnis MSkadiņa ISkadiņš RThurmair GVasiļjevs AVerlic MZhang X(2019)Training, Enhancing, Evaluating and Using MT Systems with Comparable DataUsing Comparable Corpora for Under-Resourced Areas of Machine Translation10.1007/978-3-319-99004-0_6(189-254)Online publication date: 7-Feb-2019
https://doi.org/10.1007/978-3-319-99004-0_6
de Mattos DMuchaluat-Saade D(2018)STEVEProceedings of the ACM Symposium on Document Engineering 201810.1145/3209280.3209521(1-10)Online publication date: 28-Aug-2018
https://dl.acm.org/doi/10.1145/3209280.3209521
Meixner BGlancy MRogers MWard CRöggla TCesar PRedi JNiamut OBulterman Dvan den Broeck WDarnell MZimmermann R(2017)Multi-Screen DirectorAdjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video10.1145/3084289.3089924(57-62)Online publication date: 14-Jun-2017
https://dl.acm.org/doi/10.1145/3084289.3089924
Meixner B(2017)Hypervideos and Interactive Multimedia PresentationsACM Computing Surveys10.1145/303892550:1(1-34)Online publication date: 6-Mar-2017
https://dl.acm.org/doi/10.1145/3038925
Amini FRiche NLee BMonroy-Hernandez AIrani P(2017)Authoring Data-Driven Videos with DataClipsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.259864723:1(501-510)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1109/TVCG.2016.2598647
Lee DPark JSong M(2017)An App-Based Authoring System for Personalized Sensory Stimulation of Children With Developmental DisabilitiesIEEE Access10.1109/ACCESS.2017.27121235(10583-10593)Online publication date: 2017
https://doi.org/10.1109/ACCESS.2017.2712123
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents