Building interactive experiences block by block
Pages 289 - 301
Abstract
This paper proposes a system, created with the goal of simplifying the design and development of interactive experiences to help explore a space. It has four components: XploreDescription, XploreBuilder, urSpace and an infrastructure.
The XploreDescription, is a language grammar to describe interactive experiences with interactions based on gestures and user's actions. The XploreBuilder is a visual tool used to design interactive experiences by assembling building blocks. urSpace creates interactive experiences and is built on top of an infrastructure that uses existing video camera and wireless networks to provide means to support interactive experiences using mobile devices. Description files of the space and interactive experience generated by XploreBuilder are parsed by urSpace, that creates the interactive experience application. This application can be immediately accessed using the user's mobile device.
Interactive experiences based on interaction with the space like mobile augmented reality games can be created quickly and with little or no experience of programming.
References
[1]
Zahid Akhtar, Niki Martinel, Christian Micheloni, and Gian Luca Foresti. 2014. Mobile Re-Identification Based on Local Features Analysis. In Proceedings of the International Conference on Distributed Smart Cameras (ICDSC '14). ACM, New York, NY, USA, Article 11, 6 pages.
[2]
Vasilios Anagnostopoulos, Sotiris Chatzis, Constantinos Lalos, Anastasios Doulamis, Dimitrios Kosmopoulos, Theodora Varvarigou, Helmut Neuschmied, Georg Thallinger, Stuart E. Middleton, Matthew Addis, Eduardo Bustos, and Fabrizio Giorgini. 2006. A Cross Media Platform for Personalized Leisure & Entertainment: The POLYMNIA Approach. In AXMEDIS '06: Proceedings of the Second International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution. IEEE Computer Society, Washington, DC, USA, 283--290.
[3]
Arduino. 2015. Arduino. (June 2015). http://www.arduino.cc
[4]
R. M. Beales, S. E. Middleton, and M. J. Addis. 2007. Ambient multi-camera personal documentaries. In Visual Media Production, 2007. IETCVMP. 4th European Conference on. 1--1.
[5]
Blizzard. 2015a. Diablo. (June 2015). http://us.battle.net/d3/en/
[6]
Blizzard. 2015b. World Of Warcraft. (June 2015). http://eu.battle.net/en/int?r=wow
[7]
M. Bramberger, J. Brunner, B. Rinner, and H. Schwabach. 2004. Real-time video analysis on an embedded smart camera for traffic surveillance. In Real-Time and Embedded Technology and Applications Symposium, 2004. Proceedings. RTAS 2004. 10th IEEE. 174-181.
[8]
G. Chanda and F. Dellaert. 2004. Grammatical methods in computer vision: An overview. Technical Report GIT-GVU-04-29, College of Computing, Georgia Institute of Technology, Atlanta, GA, USA (2004) ftp://ftp.cc.gatech.edu/pub/gvu/tr/2004/04-29.pdf (2004).
[9]
Kuo-En Chang, Chia-Tzu Chang, Huei-Tse Hou, Yao-Ting Sung, Huei-Lin Chao, and Cheng-Ming Lee. 2014. Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum. Computers and Education 71, 0 (2014), 185--197.
[10]
J. Connell, A. Senior, A. Hampapur, Y. Tian, L. Brown, and Pankanti. June 2004. Detection and Tracking in the IBM PeopleVision System. IEEE ICME (June 2004).
[11]
A. Fevgas, P. Tsompanopoulou, and P. Bozanis. 2011. iMuse Mobile Tour: A personalized multimedia museum guide opens to groups. In Computers and Communications (ISCC), 2011 IEEE Symposium on. 971-975.
[12]
Giuseppe Ghiani, Fabio Paternò, Carmen Santoro, and Lucio Davide Spano. 2009b. UbiCicero: A location-aware, multi-device museum guide. Interacting with Computers 21, 4 (2009), 288--303.
[13]
Giuseppe Ghiani, Fabio Paternò, and LucioDavide Spano. 2009a. Cicero Designer: An Environment for End-User Development of Multi-Device Museum Guides. In End-User Development, Volkmar Pipek, MaryBeth Rosson, Boris de Ruyter, and Volker Wulf (Eds.). Lecture Notes in Computer Science, Vol. 5435. Springer Berlin Heidelberg, 265-274.
[14]
Eva Hornecker. 2010. Creative Idea Exploration Within the Structure of a Guiding Framework: The Card Brainstorming Game. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10). ACM, New York, NY, USA, 101-108.
[15]
Sherry Hsi and Holly Fait. 2005. RFID Enhances Visitors' Museum Experience at the Exploratorium. Commun. ACM 48, 9 (Sept. 2005), 60-65.
[16]
Yo-Ping Huang, Shan-Shan Wang, and F E Sandnes. 2011. RFID-Based Guide Gives Museum Visitors More Freedom. IT Professional 13, 2 (2011), 25-29.
[17]
H. Kuehne, A. Arslan, and T. Serre. 2014. The Language of Actions: Recovering the Syntax and Semantics of Goal-Directed Human Activities. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on. 780-787.
[18]
Tsvi Kuflik, Oliviero Stock, Massimo Zancanaro, Ariel Gorfinkel, Sadek Jbara, Shahar Kats, Julia Sheidin, and Nadav Kashtan. 2011. A Visitor's Guide in an Active Museum: Presentations, Communications, and Reflection. J. Comput. Cult. Herit. 3, 3, Article 11 (Feb. 2011), 25 pages.
[19]
Yann Laurillau and Fabio Paternò. 2004. Supporting Museum Co-visits Using Mobile Devices. In Mobile Human-Computer Interaction - MobileHCI 2004, Stephen Brewster and Mark Dunlop (Eds.). Lecture Notes in Computer Science, Vol. 3160. Springer Berlin Heidelberg, 451-455.
[20]
Lego. 2015. Lego Mindstorms. (June 2015). http://mindstorms.lego.com
[21]
Yang Li, Ziyan Wu, Srikrishna Karanam, and Richard J. Radke. 2014. Real-World Re-Identification in an Airport Camera Network. In Proceedings of the International Conference on Distributed Smart Cameras (ICDSC '14). ACM, New York, NY, USA, Article 35, 6 pages.
[22]
Giuseppe Lisanti, Iacopo Masi, and Alberto Del Bimbo. 2014. Matching People Across Camera Views Using Kernel Canonical Correlation Analysis. In Proceedings of the International Conference on Distributed Smart Cameras (ICDSC '14). ACM, New York, NY, USA, Article 10, 6 pages.
[23]
Jussi Mattila and Antti Väätänen. 2006. UbiPlay: An Interactive Playground and Visual Programming Tools for Children. In Proceedings of the 2006 Conference on Interaction Design and Children (IDC '06). ACM, New York, NY, USA, 129-136.
[24]
Microsoft. 2015a. Kinect. (April 2015). https://www.microsoft.com/en-us/kinectforwindows/
[25]
Microsoft. 2015b. Kodu. (June 2015). http://research.microsoft.com/en-us/projects/kodu/
[26]
MIT. 2015. Scratch Programming Language. (June 2015). https://scratch.mit.edu
[27]
A. Mody, M. Akram, K. Rony, M. S. Aman, and R. Kamoua. 2009. Enhancing user experience at museums using smart phones with RFID. In Systems, Applications and Technology Conference, 2009. LISAT '09. IEEE Long Island. 1-5.
[28]
Mojang. 2015. Minecraft. (June 2015). https://minecraft.net
[29]
Sylvie C. W. Ong and Surendra Ranganath. 2005. Automatic Sign Language Analysis: A Survey and the Future Beyond Lexical Meaning. IEEE Trans. Pattern Anal. Mach. Intell. 27, 6 (June 2005), 873-891.
[30]
S. K. Ong, M. L. Yuan, and A. Y. Nee. November 29 - December 02, 2005. Tracking points using projective reconstruction for augmented reality. In Proceedings of the 3rd international Conference on Computer Graphics and interactive Techniques in Australasia and South East Asia, GRAPHITE '05 (November 29 - December 02, 2005), 421--424.
[31]
Eva Pietroni and Andrea Adami. 2014. Interacting with Virtual Reconstructions in Museums: The Etruscanning Project. J. Comput. Cult. Herit. 7, 2, Article 9 (June 2014), 29 pages.
[32]
Jun Rekimoto and Katashi Nagao. 1995. The World Through the Computer: Computer Augmented Interaction with Real World Environments. In Proceedings of the 8th Annual ACM Symposium on User Interface and Software Technology (UIST '95). ACM, New York, NY, USA, 29-36.
[33]
B. Rinner, M. Jovanovic, and M. Quaritsch. 2007. Embedded Middleware on Distributed Smart Cameras. Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on 4 (2007), IV-1381--IV-1384.
[34]
Sarah Leon Rojas, Leif Oppermann, Lisa Blum, and Martin Wolpers. 2014. Natural Europe Educational Games Suite: Using Structured Museum-data for Creating Mobile Educational Games. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology (ACE '14). ACM, New York, NY, USA, Article 6, 6 pages.
[35]
M. S. Ryoo and J. K. Aggarwal. 2006. Recognition of Composite Human Activities through Context-Free Grammar Based Representation. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, Vol. 2. 1709-1718.
[36]
Rossana Santos and Nuno Correia. 2010. vuSpot: An Infrastructure for Augmented Information Sharing Using Surveillance Cameras. In Proceedings of the Fourth ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC '10). ACM, New York, NY, USA, 230-231.
[37]
Rossana Santos and Nuno Correia. 2012. UBI, the Guardian Dragon: Your Virtual Sidekick. In Proceedings of the 9th International Conference on Advances in Computer Entertainment (ACE '12). Springer-Verlag, Berlin, Heidelberg, 368-383.
[38]
H. S. Sawhney, A. Arpa, R. Kumar, S. Samarasekera, M. Aggarwal, S. Hsu, D. Nister, and K. Hanna. 2002. Video flashlights: real time rendering of multiple videos for immersive model visualization. In Proceedings of the 13th Eurographics Workshop on Rendering (2002), p.157-168.
[39]
D. Schmalstieg and Daniel Wagner. 2007. Experiences with Handheld Augmented Reality. In Mixed and Augmented Reality, 2007. ISMAR 2007. 6th IEEE and ACM International Symposium on. 3-18.
[40]
S. Sen, S. Roy, and S. K. Sarkar. 2014. A Proposal for Enhancing Museum Visiting Experience Implementing Active RFID Technology. In Advances in Computing and Communications (ICACC), 2014 Fourth International Conference on. 295-298.
[41]
Mitov Software. 2015. Visuino: visual development for arduino. (June 2015). www.visuino.com
[42]
Yale Song, D. Demirdjian, and R. Davis. 2011. Tracking body and hands for gesture recognition: NATOPS aircraft handling signals database. In Automatic Face Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on. 500-506.
[43]
Structure. 2015. OpenNi. (June 2015). http://structure.io/openni
[44]
Eugene M. Taranta II, Thaddeus K. Simons, Rahul Sukthankar, and Joseph J. Laviola Jr. 2015. Exploring the Benefits of Context in 3D Gesture Recognition for Game-Based Virtual Environments. ACM Trans. Interact. Intell. Syst. 5, 1, Article 1 (March 2015), 34 pages.
[45]
R. Tesoriero, J. Gallud, M. Lozano, and V. Penichet. 2008. Using active and passive RFID technology to support indoor location-aware systems. Consumer Electronics, IEEE Transactions on 54, 2 (May 2008), 578-583.
[46]
Roberto Vezzani, Davide Baltieri, and Rita Cucchiara. 2013. People Reidentification in Surveillance and Forensics: A Survey. ACM Comput. Surv. 46, 2, Article 29 (Dec. 2013), 37 pages.
[47]
Roberto Vezzani, Simone Calderara, Paolo Piccinini, and Rita Cucchiara. 2008. Smoke Detection in Video Surveillance: The Use of ViSOR (Video Surveillance On-line Repository). In Proceedings of the 2008 International Conference on Content-based Image and Video Retrieval (CIVR '08). ACM, New York, NY, USA, 289-298.
[48]
Paul Viola, Michael J. Jones, and Michael J. Jones. 2004. Robust Real-Time Face Detection. Int. J. Comput. Vision 57, 2 (2004), 137-154.
[49]
Jasper Visser. 2014. Museums in Time of Social and Technological Change. (April 2014). http://themuseumofthefuture.com/2014/04/18/museums-in-times-of-social-and-technological-change/
[50]
Daniel Wagner, Thomas Pintaric, Florian Ledermann, and Dieter Schmalstieg. 2005. Towards Massively Multi-user Augmented Reality on Handheld Devices. In Pervasive Computing, Hans-W. Gellersen, Roy Want, and Albrecht Schmidt (Eds.). Lecture Notes in Computer Science, Vol. 3468. Springer Berlin Heidelberg, 208-219.
[51]
Daniel Wagner and Dieter Schmalstieg. 2003. First Steps Towards Handheld Augmented Reality. In Proceedings of the 7th IEEE International Symposium on Wearable Computers (ISWC '03). IEEE Computer Society, Washington, DC, USA, 127-. http://dl.acm.org/citation.cfm?id=946249.946910
[52]
Wangyang Wei, Huadong Ma, Haitao Zhang, Yihong Gao, and Zhihong Wang. 2014. Person Re-identification Based on Human Body Parts Signature. In Proceedings of the International Conference on Distributed Smart Cameras (ICDSC '14). ACM, New York, NY, USA, Article 9, 6 pages.
[53]
Leonard Wein. 2014. Visual Recognition in Museum Guide Apps: Do Visitors Want It?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 635-638.
[54]
Eric Woods, Mark Billinghurst, Julian Looser, Graham Aldridge, Deidre Brown, Barbara Garrie, and Claudia Nelles. 2004. Augmenting the Science Centre and Museum Experience. In Proceedings of the 2Nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (GRAPHITE '04). ACM, New York, NY, USA, 230-236.
[55]
Zahoor Zafrulla, Helene Brashear, Thad Starner, Harley Hamilton, and Peter Presti. 2011. American Sign Language Recognition with the Kinect. In Proceedings of the 13th International Conference on Multimodal Interfaces (ICMI '11). ACM, New York, NY, USA, 279-286.
[56]
Zheng Zhang, Huadóng Ma, Huiyuan Fu, and Hao Huang. 2014. Distributed Human Action Recognition via 2D Conditional Random Field. In Proceedings of the International Conference on Distributed Smart Cameras (ICDSC '14). ACM, New York, NY, USA, Article 4, 6 pages.
[57]
W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld. 2003. Face Recognition: A Literature Survey. ACM Comput. Surv. 35, 4 (Dec. 2003), 399-458.
Index Terms
- Building interactive experiences block by block
Recommendations
Gaming Versus Storytelling: Understanding Children’s Interactive Experiences in a Museum Setting
Interactive StorytellingAbstractWhile gaming and storytelling are considered to be common approaches to engage audiences with a museum’s collections, a formal comparison of the two has not been found in literature. While gaming and storytelling are considered to be common ...
Citywide: Supporting Interactive Digital Experiences Across Physical Space
The Citywide project is exploring ways in which technology can provide people with rich and engaging digital experiences as they move through physical space, including historical experiences, performances and games. This paper describes some initial ...
Narrative Approaches to Design Multi-screen Augmented Reality Experiences
EVA London 2014: Proceedings of the EVA London 2014 on Electronic Visualisation and the ArtsAugmented Reality (AR) represents the future of the digital integrated museum experience. There is considerable scope for providing engaging and interactive experiences when using AR combined with traditional museum practices, particularly relative to ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2015
442 pages
ISBN:9781450336055
DOI:10.1145/2836041
- General Chairs:
- Clemens Holzmann,
- René Mayrhofer,
- Program Chairs:
- Jonna Häkkilä,
- Enrico Rukzio,
- Publications Chair:
- Michael Roland
Copyright © 2015 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- FH OOE: University of Applied Sciences Upper Austria
- Johannes Kepler Univ Linz: Johannes Kepler Universität Linz
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 30 November 2015
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- Fundacao para a Ciencia e a Tecnologia, Ministerio da Educacao e da Ciencia, Portugal
Conference
MUM '15
Sponsor:
- FH OOE
- Johannes Kepler Univ Linz
MUM '15: 14th International Conference on Mobile and Ubiquitous Multimedia
November 30 - December 2, 2015
Linz, Austria
Acceptance Rates
MUM '15 Paper Acceptance Rate 33 of 89 submissions, 37%;
Overall Acceptance Rate 190 of 465 submissions, 41%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 148Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in