Abstract
HTML5 is driving a strong trend towards interoperable Web-based applications, enabling a wider range of devices to run this kind of applications. The key challenge of next-generation media applications is to federate cooperative devices to provide multi-device experiences overcoming current second screen solutions within the connected TV industry. There is a gap on the experience of users, since they perceive devices as isolated pieces of applications when they would prefer to have a single experience through multiple devices at the same time. This paper proposes a unified methodology and a common specification over Web Components for the adaptation of a single application, seamlessly running different instances on one or more devices simultaneously, according to the multi-device context of the user and the specific features of the devices. The solution presented in this paper extends current Web standards towards an interoperable architecture and offers broadcasters and media application developers the possibility to easily design applications that will automatically provide a unique consistent experience across the connected devices. The architectural design is targeted to be included in the roadmap of the standards.
Similar content being viewed by others
Notes
DIAL Discovery And Launch protocol specification. Version 1.7.2 (2015) http://www.dial-multiscreen.org/dial-protocol-specification.
SMIL 3.0. December 2008. http://www.w3.org/TR/SMIL/.
Gridster.js website. http://gridster.net/.
CSS Regions library, April 2014. http://github.com/FremyCompany/css-regions-polyfill.
Mozilla XUL. http://developer.mozilla.org/en-US/docs/Mozilla/Tech/XUL.
EnyoJS. http://enyojs.com/.
Bootstrap. http://getbootstrap.com/.
Polymer library’s website: http://www.polymer-project.org/.
A polyfill is a downloadable code which provides facilities that are not built natively in a Web browser.
Lazy loading is a design pattern to defer initialisation of an object until the point at which it is needed, contributing to the efficiency of the application.
Video of one of the performed experiments http://vimeo.com/113514286.
References
Anthes G (2012) HTML5 leads a web revolution. Commun ACM 55(7):16–17
Courtois C, D’heer E (2012) Second screen applications and tablet users: constellation, awareness, experience, and interest. In: Proceedings of the 10th European conference on interactive TV and video. ACM, pp 153–156
Claudy L (2012) The broadcast empire strikes back. IEEE Spectrum 49(12):52–58
Cesar P, Bulterman DC, Jansen AJ (2008) Usages of the secondary screen in an interactive television environment: control, enrich, share, and transfer television content. In Changing television environments. Springer Berlin, pp 168–177
Millward Brown (2014) Marketing in a multi-screen world. In: AdReaction 2014
Zorrilla M, Tamayo I, Martin A, Olaizola IG (2013) Cloud session mainte-nance to synchronise HbbTV applications and home network devices. In: IEEE international symposium on broadband multimedia systems and broadcasting (BMSB). IEEE, pp 1–6
Ziegler Christoph (2013) Second screen for HbbTV—automatic application launch and app-to-app communication enabling novel TV programme related second-screen scenarios. In: IEEE third international conference on consumer electronics Berlin (ICCE-Berlin), 2013. (ICCE Berlin 2013), IEEE
Merkel K (2011) Hybrid broadcast broadband TV, the new way to a comprehensive TV experience. In: 2011 14th ITG conference on, electronic media technology (CEMT). IEEE, pp 1–4
Weiser M (1991) The computer for the 21st century. Sci Am 265(3):94–104
TVP-CPA: Cross-Platform Authentication (2014) Publication as an EBU recommendation: EBU Tech 3366. https://tech.ebu.ch/docs/tech/tech3366.pdf
Zorrilla M, Martin A, Tamayo I, O’Halpin S, Hazael-Massieux D (2014) Reaching devices around an HbbTV television. In: 2014 IEEE international symposium on broadband multimedia systems and broadcasting (BMSB). IEEE, pp 1–7
Desruelle H, Lyle J, Isenberg S, Gielen F (2012) On the challenges of building a web-based ubiquitous application platform. In: Proceedings of the 2012 ACM conference on ubiquitous computing. ACM, pp 733–736
Desruelle H, Isenberg S, Botsikas A, Vergori P, Gielen F (2014) Accessible user interface support for multi-device ubiquitous applications: architectural modifiability considerations. Univers Access Inf Soc 1–15
Brandenburg R, Veenhuizen A (2013) Immersive second-screen experiences using hybrid media synchronization. In: Media synchronization workshop 2013 (MediaSync)
W3C Community Group (2015) Multi-device timing community group. https://www.w3.org/community/webtiming/
W3C Editor’s Draft (2015) Timing object. http://webtiming.github.io/timingobject/#broadcasting—time-consistent-live-web-productions
Arntzen Ingar M, Njål T Borch, Christopher P Needham (2013) The media state vector: a unifying concept for multi-device media navigation. In: Proceedings of the 5th workshop on mobile video, ACM
MediaScape EU project report (2014) Usage scenarios and requirements. Deliverable D2.1. http://mediascapeproject.eu/files/D2.1.pdf
Nielsen report (2014). Shifts in viewing: The cross platform report. http://www.nielsen.com/us/en/insights/reports/2014/shifts-in-viewing-the-cross-platform-report-q2-2014.html
Nielsen report (2014) State of the media: audio today. http://www.nielsen.com/us/en/insights/reports/2014/state-of-the-media-audio-today-q3-2014.html
Strategy Analytics (2014) 2013 Smart TV shipments grew 55 %. http://www.strategyanalytics.com/default.aspx?mod=pressreleaseviewer&a0=5472
An Ericsson Consumer Insight Summary Report (2013) TV and media. Identifying the needs of tomorrow’s video consumer. Ericsson ConsumerLab. http://www.ericsson.com/res/docs/2013/consumerlab/tv-and-media-consumerlab2013.pdf
Gartner report (2014). Forecast: PCs, Ultramobiles, and mobile phones, Worldwide, 2010–2017. http://www.gartner.com/newsroom/id/2645115
NAPTE survey (2014) https://www.natpe.com/press/release/130
Nielsen survey (2014) Sports fans amplify the action across screens. http://www.nielsensocial.com/sports-fans-amplify-the-action-across-screens/
Nielsen survey (2014) Who’s tweeting about tv? http://www.nielsensocial.com/whos-tweeting-about-tv/
Soares LFG, Costa RM, Moreno MF, Moreno MF (2009) Multiple exhibition devices in DTV systems. In: Proceedings of the 17th ACM international conference on Multimedia. ACM, pp 281–290
Soares LFG, Moreno MF, De Salles Soares Neto C (2010) Ginga-NCL: declarative middleware for multimedia IPTV services. Commun Mag IEEE 48(6):74–81
W3C World-Wide Web Consortium (2008) Synchronized multimedia integration language—SMIL 3.0 Specification, W3C Recommendation. http://www.w3.org/TR/2008/REC-SMIL3-20081201/
Pereira FC (2002) The MPEG-4 book. Prentice Hall Professional. ISBN: 0-13-061621-4
Manjunath BS, Salembier P, Sikora T (eds) (2002) Introduction to MPEG-7: multimedia content description interface (vol 1). Wiley, New York
W3C Editor’s draft (2014) HTML 5.1 nightly. A vocabulary and associated APIs for HTML and XHTML. http://www.w3.org/html/wg/drafts/html/master/embedded-content.html#the-source-element-when-used-with-the-picture-element
W3C Recommendation (2012) Media queries. http://www.w3.org/TR/css3-mediaqueries/
W3C Recommendation (2010) Mobile Web application best practices. http://www.w3.org/TR/mwabp/
W3C Working Draft (2014) CSS flexible box layout module level 1. http://www.w3.org/TR/css3-flexbox/
W3C Working Draft (2014) CSS regions module level 1. http://www.w3.org/TR/css3-regions/
W3C Working Draft (2014) CSS grid layout module level 1. http://www.w3.org/TR/css3-grid-layout/
W3C Working Group Note (2014) Introduction to Web components. http://w3c.github.io/webcomponents/explainer/
Techrunch (2013) Google believes Web components are the future of Web development. http://techcrunch.com/2013/05/19/google-believes-web-components-are-the-future-of-web-development/
Zorrilla M, Martin A, Tamayo I (2015) User interface adaptation for multi-device Web-based media applications. In: 2015 IEEE international symposium on broadband multimedia systems and broadcasting (BMSB). Pending to be published. IEEE
W3C Editor’s Draft (2014) Media queries level 4. http://dev.w3.org/csswg/mediaqueries4/#script-custom-mq
Acknowledgments
The MediaScape project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement 610404. The contribution from the UPV/EHU has been supported by the Basque Council under Grant Agreement IT395-10. The first author would like to thank Iñigo Tamayo, Angel Martin, Ana Dominguez and Igor G. Olaizola, researchers in Vicomtech-IK4, for supporting the architectural design and implementation presented in the paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zorrilla, M., Borch, N., Daoust, F. et al. A Web-based distributed architecture for multi-device adaptation in media applications. Pers Ubiquit Comput 19, 803–820 (2015). https://doi.org/10.1007/s00779-015-0864-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-015-0864-x