research-article

Socially-aware multimedia authoring: Past, present, and future

Authors:

Dick C. A. Bulterman,

Rodrigo Laiola GuimarãesAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 9, Issue 1s

Article No.: 35, Pages 1 - 23

https://doi.org/10.1145/2491893

Published: 17 October 2013 Publication History

Abstract

Creating compelling multimedia productions is a nontrivial task. This is as true for creating professional content as it is for nonprofessional editors. During the past 20 years, authoring networked content has been a part of the research agenda of the multimedia community. Unfortunately, authoring has been seen as an initial enterprise that occurs before ‘real’ content processing takes place. This limits the options open to authors and to viewers of rich multimedia content for creating and receiving focused, highly personal media presentations. This article reflects on the history of multimedia authoring. We focus on the particular task of supporting socially-aware multimedia, in which the relationships within particular social groups among authors and viewers can be exploited to create highly personal media experiences. We provide an overview of the requirements and characteristics of socially-aware multimedia authoring within the context of exploiting community content. We continue with a short historical perspective on authoring support for these types of situations. We then present an overview of a current system for supporting socially-aware multimedia authoring within the community content. We conclude with a discussion of the issues that we feel can provide a fruitful basis for future multimedia authoring support. We argue that providing support for socially-aware multimedia authoring can have a profound impact on the nature and architecture of the entire multimedia information processing pipeline.

References

[1]

Abowd, G. D., Gauger, M., and Lachenmann, A. 2003. The family video archive: An annotation and browsing environment for home movies. In Proceedings of the ACM International Workshop on Multimedia Information Retrieval. 1--8.

Digital Library

[2]

Adams, B., Venkatesh, S., and Jain, R. 2005. IMCE: Integrated media creation environment. ACM Trans. Multimedia Comput. Commun. Appl. 1, 3, 211--247.

Digital Library

[3]

Bocconi, S., Nack, F., and Hardman, L. 2008. Automatic generation of matter-of-opinion video documentaries. J. Web Semantics 6, 2, 139--150.

Digital Library

[4]

Bulterman, D. C. A. and Hardman, L. 2005. Structured multimedia authoring. ACM Trans. Multimedia Comput. Commun. Appl. 1, 1, 89--109.

Digital Library

[5]

Cattelan, R. G., Teixeira, C., Goularte, R., and Pimentel, M. D. 2008. Watch-and-comment as a paradigm toward ubiquitous interactive video editing. ACM Trans. Multimedia Comput. Commun. Appl. 4, 4, Article 28.

Digital Library

[6]

Cesar, P., Bulterman, D. C., Jansen, J., Geerts, D., Knoche, H., and Seager, W. 2009. Fragment, tag, enrich, and send: Enhancing social sharing of video. ACM Trans. Multimedia Comput. Commun. Appl. 5, 3--19.

Digital Library

[7]

Ding, J. R., Yang, J. F., and Lin, J. K. 2006, Motion-based adaptive GOP algorithms for efficient H.264/AVC compression. In Proceedings of the Joint Conference on Information Sciences (CIS'06).

[8]

Eisenstein, S. 1949. Film Form: Essays in Film Theory. Hartcour, New York.

[9]

Gao, B., Jansen, J., Cesar, P., and Bulterman, D. C. A. 2011. Accurate and low-delay seeking within and across mash-ups of highly-compressed videos. In Proceedings of the NOSSDAV. 105--110.

Digital Library

[10]

Guimaraes, R. L., Cesar, P., Bulterman, D. C. A., Zsombori, V., and Kegel, I. 2011. Creating personalized memories from social events: Community-based support for multi-camera recordings of school concerts. In Proceedings of the ACM International Conference on Multimedia. 303--312.

Digital Library

[11]

Guimaraes, R. L., Cesar, P., and Bulterman, D. C. A. 2012. Let me comment on your video: Supporting personalized end-user comments within third-party online videos. In Proceedings of the WebMedia. 253--260.

Digital Library

[12]

Hardman, L., Van Rossum, G., and Bulterman, D. C. A. 1993. Structured multimedia authoring. In Proceedings of the ACM International Conference on Multimedia. 283--289.

Digital Library

[13]

Ibanez, J., Aylett, R., Delgado-Mata, C., and Molinuevo, E. 2009. On the implications of the virtual storyteller's point of view. Knowl. Eng. Rev. 23, 4, 339--367.

Digital Library

[14]

Kennedy, L. S. and Naaman, M. 2009. Less talk, more rock: automated organization of community-contributed collections of concert videos. In Proceedings of the International Conference on WWW. 311--320.

Digital Library

[15]

Kirk, D., Sellen, A., Harper, R., and Wood, K. 2007. Understanding videowork. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 61--70.

Digital Library

[16]

Kruitbosch, G. and Nack, F. 2008. Broadcast yourself on YouTube: Really&quest; In Proceedings of the 3rd ACM International Workshop on Human-Centered Computing (HCC'08). ACM, New York, NY, 7--10.

Digital Library

[17]

Lienhart, R. 1999. Abstracting home video automatically. In Proceedings of the ACM International Conference on Multimedia. 37--40.

Digital Library

[18]

Naci, S. U. and Hanjalic, A. 2007. Intelligent browsing of concert videos. In Proceedings of the ACM International Conference on Multimedia. 150--151.

Digital Library

[19]

Pea, R., Mills, M., Rosen, J., Dauber, K., Effelsberg, W., and Hoffert, E. 2004. The diver project: Interactive digital video repurposing. IEEE Multimedia 11, 1, 54--61.

Digital Library

[20]

Piacenza, A., Guerrini, F., Adami, N., Leonardi, R., Porteous, J., Teutenberg, J., and Cavazza, M. 2011. Generating story variants with constrained video recombination. In Proceedings of the ACM International Conference on Multimedia. 223--232.

Digital Library

[21]

Purcell, K. 2010. The State of Online Video, The Pew Research Center's Internet & American Life Project. http://www.pewinternet.org/Reports/2010/State-of-Online-Video.aspx. (Last accessed June 2010).

[22]

Rowe, L. A. and Jain, R. 2005. ACM SIGMM retreat report on future directions in multimedia research. ACM Trans. Multimedia Comput. Commun. Appl. 1, 1, 3--13.

Digital Library

[23]

Schmandt, C. 1993. Phoneshell: The telephone as computer terminal. In Proceedings of the ACM International Conference on Multimedia. 373--382.

Digital Library

[24]

Shamma, D. A., Shaw, R., Shafton, P. L., and Liu, Y. 2007. Watch what I watch: using community activity to understand content. In Proceedings of the International Workshop on Multimedia Information Retrieval. 275--284.

Digital Library

[25]

Shipman, F., Girgensohn, A., and Wilcox, L. 2008. Authoring, viewing, and generating hypervideo: An overview of Hyper-Hitchcock. ACM Trans. Multimedia Comput. Commun. Appl. 5, 2, Article 15.

Digital Library

[26]

Shrestha, P., De With, P. H. N., Weda, H., Barbieri, M., and Aarts, E. H. L. 2010. Automatic mashup generation from multiple-camera concert recordings. In Proceedings of the ACM International Conference on Multimedia. 541--550.

Digital Library

[27]

Singh, V. K., Luo, J., Joshi, D., Lei, P., Das, M., and Stubler, P. 2011. Reliving on demand: A total viewer experience. In Proceedings of the ACM International Conference on Multimedia. 333--342.

Digital Library

[28]

Snoek, C., Freiburg, B., Oomen, J., and Ordelman, R. 2010. Crowdsourcing rock n' roll multimedia retrieval. In Proceedings of the ACM International Conference on Multimedia. 1535--1538.

Digital Library

[29]

Soares, L. F. G., Moreno, M. F., Neto, C. S. S., and Moreno, M. F. 2010. Ginga-NCL: Declarative middleware for multimedia IPTV services. Commun. Mag. 48, 6, 74--81.

Digital Library

[30]

Stockhammer, T. 2011. Dynamic adaptive streaming over HTTP-Standards and design principles. In Proceedings of the Multimedia Systems Conference (MMsys'11). 133--143.

Digital Library

[31]

Su, K., Naaman, M., Gurjar, A., Patel, M., and Ellis, D. P. W. 2012. Making a scene: Alignment of complete sets of clips based on pairwise audio match. In Proceedings of the ACM International Conference on Multimedia Retrieval. Article 26.

Digital Library

[32]

Sundaram, H. and Chang, S.-F. 2000. Determining computable scenes in films and their structures using audio-visual memory models. In Proceedings of the ACM International Conference on Multimedia. 95--104.

Digital Library

[33]

Ursu, M. F., Thomas, M., Kegel, I., Williams, D., Tuomola, M., Lindstedt, I., Wright, T., Leurdijk, A., Zsombori, V., Sussner, J., Myrestam, U., and Hall, N. 2008. Interactive TV narratives: Opportunities, progress, and challenges. ACM Trans. Multimedia Comput. Commun. Appl. 4, 4, Article 25.

Digital Library

[34]

Xie, L., Natsev, A., Kender, J. R., Hill, M., and Smith, J. R. 2011. Visual memes in social media: Tracking real-world news in Youtube videos. In Proceedings of the ACM International Conference on Multimedia. 53--62.

Digital Library

[35]

Zsombori, V., Frantzis, M., Guimaraes, R. L., Ursu, M. F., Cesar, P., KEgel, I., CRaigie, R., and Bulterman, D. C. A. 2011. Automatic generation of video narratives from shared UGC. In Proceedings of the ACM Conference on Hypertext and Hypermedia. 325--334.

Digital Library

Cited By

Wagenpfeil SEngel FKevitt PHemmje M(2021)AI-Based Semantic Multimedia Indexing and Retrieval for Social Media on SmartphonesInformation10.3390/info1201004312:1(43)Online publication date: 19-Jan-2021
https://doi.org/10.3390/info12010043
Borges TGuimarães Rde Salles Soares Neto C(2020)Toward Assessing the Quality of Subtitles based on SRT Files ProcessingProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3428658.3431758(153-156)Online publication date: 30-Nov-2020
https://dl.acm.org/doi/10.1145/3428658.3431758
Wagenpfeil SHemmje M(2020)Towards AI-based Semantic Multimedia Indexing and Retrieval for Social Media on Smartphones2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMA10.1109/SMAP49528.2020.9248445(1-9)Online publication date: 29-Oct-2020
https://doi.org/10.1109/SMAP49528.2020.9248445
Show More Cited By

Index Terms

Socially-aware multimedia authoring: Past, present, and future
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Socially-aware multimedia: adding personal and temporal contexts to media
WebMedia '12: Proceedings of the 18th Brazilian symposium on Multimedia and the web

Multimedia data has two general characteristics that separate it from other types of ICT data: it is inherently intended for human consumption and it is inherently temporal. In this context, it is interesting to note that most multimedia research has ...
International workshop on socially-aware multimedia (SAM'12)
MM '12: Proceedings of the 20th ACM international conference on Multimedia

Multimedia social communication is filtering into everyday use. Videoconferencing is appearing in the living room and beyond, television is becoming smart and social, and media sharing applications are transforming the way we converse and recall events. ...
2nd international workshop on socially-aware multimedia (SAM'13)
MM '13: Proceedings of the 21st ACM international conference on Multimedia

Multimedia social communication is becoming commonplace. Television is becoming smart and social; media sharing applications are transforming the way we converse and recall events and videoconferencing is a common application on our computers, phones, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 9, Issue 1s

Special Sections on the 20th Anniversary of ACM International Conference on Multimedia, Best Papers of ACM Multimedia 2012

October 2013

218 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2523001

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2013

Accepted: 01 July 2013

Revised: 01 April 2013

Received: 01 October 2012

Published in TOMM Volume 9, Issue 1s

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Seventh Framework Programme

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
491
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)3

Reflects downloads up to 16 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wagenpfeil SEngel FKevitt PHemmje M(2021)AI-Based Semantic Multimedia Indexing and Retrieval for Social Media on SmartphonesInformation10.3390/info1201004312:1(43)Online publication date: 19-Jan-2021
https://doi.org/10.3390/info12010043
Borges TGuimarães Rde Salles Soares Neto C(2020)Toward Assessing the Quality of Subtitles based on SRT Files ProcessingProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3428658.3431758(153-156)Online publication date: 30-Nov-2020
https://dl.acm.org/doi/10.1145/3428658.3431758
Wagenpfeil SHemmje M(2020)Towards AI-based Semantic Multimedia Indexing and Retrieval for Social Media on Smartphones2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMA10.1109/SMAP49528.2020.9248445(1-9)Online publication date: 29-Oct-2020
https://doi.org/10.1109/SMAP49528.2020.9248445
Bartindale TVarghese DSchofield GTsukamoto MBrewster SFitzpatrick GCox AKostakos V(2019)Our StoryProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300667(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300667
Zhang ZSun RWang XZhao C(2019)A Situational Analytic Method for User Behavior Pattern in Multimedia Social NetworksIEEE Transactions on Big Data10.1109/TBDATA.2017.26576235:4(520-528)Online publication date: 1-Dec-2019
https://doi.org/10.1109/TBDATA.2017.2657623
Guimarães RBrito JSantos CMota MSerique BPrates RCandello H(2018)Investigating the Influence of Subtitles Synchronization in the Viewer's Quality of ExperienceProceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems10.1145/3274192.3274222(1-10)Online publication date: 22-Oct-2018
https://dl.acm.org/doi/10.1145/3274192.3274222
Brito JGuimaraes RSantos CRoesler VValdeni de Lima JSaibel Santos CWillrich R(2017)Investigating the Collaborative Process of Subtitles Creation and Sharing for Videos on the WebProceedings of the 23rd Brazillian Symposium on Multimedia and the Web10.1145/3126858.3131592(69-72)Online publication date: 17-Oct-2017
https://dl.acm.org/doi/10.1145/3126858.3131592
Uscamayta ACunha BMartins DPimentel MRoesler VValdeni de Lima JSaibel Santos CWillrich R(2017)Collaborative Ad-hoc Multimedia Authoring via Mobile DevicesProceedings of the 23rd Brazillian Symposium on Multimedia and the Web10.1145/3126858.3131572(61-64)Online publication date: 17-Oct-2017
https://dl.acm.org/doi/10.1145/3126858.3131572
Bartindale TSchofield GWright PKaye JDruin ALampe CMorris DHourcade J(2016)Scaffolding Community Documentary Film Making using Commissioning TemplatesProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858102(2705-2716)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858102
Shamma DKennedy LLi JThomee BJin HYuan JGergle DMorris MBjørn PKonstan J(2016)Finding Weather PhotosProceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing10.1145/2818048.2819989(86-96)Online publication date: 27-Feb-2016
https://dl.acm.org/doi/10.1145/2818048.2819989

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents