research-article

Real world responses to interactive gesture based public displays

Authors:

Nigel DaviesAuthors Info & Claims

MUM '11: Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia

Pages 33 - 39

https://doi.org/10.1145/2107596.2107600

Published: 07 December 2011 Publication History

Abstract

Today, one does not have to travel far to find examples of digital signage, yet the adoption of interactive gesture based public displays remains quite rare. Subsequently, not much is known about them despite a large array of potential advantages. This paper contributes to our understanding of how people perceive, respond to and interact with such displays outside the controlled environment of a research lab. Unlike other works which have focused on isolated aspects of in-lab interaction, we present a detailed examination that addresses a wide range of responses to such a display - including those who ignore them completely. To facilitate our study we created an experimental coarse gesture based software suite and then deployed the system along with associated applications as part of an existing large scale public display network. Using this as a base, we executed four studies designed to passively observe the reactions of passers-by and followed these up with a fifth controlled experiment that compared the effectiveness of two different kinds of gesture in the context of menu item selection. To conclude, we present our key-findings and highlight possible avenues of further study for the future of gesture based digital signage.

References

[1]

Microsoft. XBOX Kinect Homepage. {Online} 2011. {Cited: October 26, 2011.} http://www.xbox.com/kinect.

[2]

dhiram via NewLaunches.com. Gesture based Interaction screen make the iPhone look from the 19th century. NewLaunches.com. {Online} January 19, 2008. {Cited: October 26, 2011.} http://www.newlaunches.com/archives/gesture_based_interaction_screen_make_the_iphone_look_from_the_19th_century.php.

[3]

Technovelgy LLC. Interactive Apple Store Has Reactive Walls. Technovelgy. {Online} Technovelgy LLC, November 24, 2007. {Cited: October 26, 2011.} http://www.technovelgy.com/ct/Science-Fiction-News.asp?NewsNum=1321.

[4]

Ahn, S, Lee, T, Kim, I, Kwon, Y, and Kim, H. Large Display Interaction Using Video Avatar and Hand Gesture Recognition. In Campilho, Aurélio and Kamel, Mohamed, eds., Image Analysis and Recognition. Springer Berlin / Heidelberg.

[5]

Brignull, H and Rogers, Y. Enticing People to Interact with Large Public Displays in Public Spaces. INTERACT'03 (2003), 17--24.

[6]

Churchhill, E, Nelson, L, and Denoue, L. Designing digital bulletin boards for social networking. In In Workshop on Public, Community and Situated Displays at CSCW 2000 (New Orleans 2002).

[7]

Hamker, F. The emergence of attention by population-based inference and its role in distributed processing and cognitive control of vision. Computer Vision and Image Understanding - Special issue: Attention and performance in computer vision, 100, 1--2 (October 2005), 64--106.

Digital Library

[8]

Huang, E, Koster, A, and Borchers, J. Overcoming Assumptions and Uncovering Practices: When Does the Public Really Look at Public Displays? Pervasive Computing, 5013/2008 (2008), 228--243.

Digital Library

[9]

Huang, E and Mynatt, E. Semi-Public Displays for Small, Co-located Groups. In Conference on Human Factors in Computing Systems Proceedings of the SIGCHI conference on Human factors in computing systems (Ft. Lauderdale, Florida 2003), ACM, 49--56.

Digital Library

[10]

Itti, L, Koch, C, and Niebur, E. A Model of Saliency-Based Visual Attention for Rapid Scene Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 11 (November 1998), 1254--1259.

Digital Library

[11]

Izadi, S, Fitzpatrick, G, Rodden, T, Brignull, H, Rogers, Y, and Lindley, S. The iterative design and study of a large display for shared and sociable spaces. In Proceedings of the 2005 conference on Designing for User eXperience (San Francisco, California 2005), AIGA: American Institute of Graphic Arts.

Digital Library

[12]

Lee, J, Lee, J, Kim, H, and Kim, J. Gesture-Based Interactions on Multiple Large Displays with a Tabletop Interface. In Stephanidis, Constantine, ed., Universal Access in Human-Computer Interaction. Ambient Interaction. Springer Berlin / Heidelberg, 2007.

Digital Library

[13]

Mccarthy, J, Costa, Tony J. and Liongosari, Edy S. UniCast, OutCast & GroupCast: Three Steps Toward Ubiquitous, Peripheral Displays. In UbiComp '01: Proceedings of the 3rd international conference on Ubiquitous Computing (2001), 332--345.

Digital Library

[14]

Müller, J, Alt, F, Michelis, D, and Schmidt, A. Requirements and design space for interactive public displays. In Proceedings of the international conference on Multimedia (Firenze, Italy 2010), 1285--1294.

Digital Library

[15]

Müller, J, Wilmsmann, D, Exeler, J, Buzeck, M, Schmidt, A, Jay, T, and Krüger, A. Display Blindness: The Effect of Expectations on Attention towards Digital Signage. In Tokuda, Hideyuki et al., eds., Pervasive Computing. Springer Berlin / Heidelberg, 2009.

Digital Library

[16]

Rogers, Y. and Lindley, S. Collaborating Around Large Interactive Displays: Which Way is Best to Meet? Interacting with Computers (2004).

[17]

Rubegni, E, Memarovic, N, and Langheinrich, M. Talking to Strangers: Using Large Public Displays to Facilitate Social Interaction. In 14th International Conference on Human-Computer Interaction (HCII 2011) (2011).

[18]

Rukzio, E. Physical Mobile Interactions: Mobile Devices as Pervasive Mediators for Interactions with the Real World. München, 2006.

[19]

Russell, D. M., Drews, C, and Sue, A. Social Aspects of Using Large Public Interactive Displays for Collaboration. UbiComp 2002: Ubiquitous Computing, 2498 (2002), 663--670.

Digital Library

[20]

Skog, T, Ljungblad, S, and Holmquist, L. E. Between Aesthetics and Utility: Designing Ambient Information Visualizations. INFOVIS 2003. IEEE Symposium (2003), 233--240.

Digital Library

[21]

Storz, O., Friday, A., Davies, N., Finney, J., Sas, C., and Sheridan, J. G. Public Ubiquitous Computing Systems: Lessons from the e-Campus Display Deployments. Pervasive Computing, IEEE, 5, 3 (July-Sept 2006), 40--47.

Digital Library

[22]

Tang, A, Finke, M, Blackstock, M, Leung, R, Deutscher, M, and Tain, G. Designing for Bystanders: Reflections on Building a Public Digital Forum. In Conference on Human Factors in Computing Systems Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (Florence, Italy 2008), ACM, 879--882.

Digital Library

[23]

Taylor, N and Cheverst, K. Social interaction around a rural community photo display. International Journal of Human-Computer Studies, 67, 12 (December 2009), 1037--1047.

Digital Library

[24]

Vogel, D and Balakrishnan, R. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proceedings of the 17th annual ACM symposium on User interface software and technology (Santa Fe, NM 2004), ACM, 137--146.

Digital Library

Cited By

Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Xie JZheng HLin JTang X(2024)Digital Gamification Design of Chinese Landscape Painting Based on Gesture InteractionHCI in Games10.1007/978-3-031-60692-2_10(127-142)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60692-2_10
Keppel JStrauss MFaltaous SLiebers JHeger RGruenefeld USchneegass S(2023)Don't Forget to Disinfect: Understanding Technology-Supported Hand Disinfection StationsProceedings of the ACM on Human-Computer Interaction10.1145/36042517:MHCI(1-18)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604251
Show More Cited By

Index Terms

Real world responses to interactive gesture based public displays
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Toolkit support for interactive projected displays
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia

This paper presents a software toolkit designed to enable the rapid development of multimedia-rich, multi-touch enabled, and interactive projection-based displays. For instance: door displays, floor displays, wall displays, and interactive tables. ...
Opportunistic at-glance information acquisition on interactive public displays
MUM '15: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia

The interaction process with interactive public displays can be viewed as a set of interaction phases. In this paper we report a wizard-of-Oz study that explores the last two phases: 1) subtle interaction, where users can interact with the display ...
Tackling challenges of interactive public displays using gaze
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

Falling hardware prices led to a widespread use of public displays. Common interaction techniques for such displays currently include touch, mid-air, or smartphone-based interaction. While these techniques are well understood from a technical ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '11: Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia

December 2011

242 pages

ISBN:9781450310963

DOI:10.1145/2107596

General Chairs:
Qionghai Dai
Tsinghua University, China
,
Ramesh Jain
University of California, Irvine
,
Program Chairs:
Xiangyang Ji
Tsinghua University, China
,
Matthias Kranz
Technische Universität München, Germany

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Tsinghua University: Tsinghua University

In-Cooperation

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 December 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Seventh Framework Programme

Conference

MUM'11

Sponsor:

Tsinghua University

MUM'11: The International Conference on Mobile and Ubiquitous Multimedia

December 7 - 9, 2011

Beijing, China

Acceptance Rates

MUM '11 Paper Acceptance Rate 29 of 66 submissions, 44%;

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
715
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Xie JZheng HLin JTang X(2024)Digital Gamification Design of Chinese Landscape Painting Based on Gesture InteractionHCI in Games10.1007/978-3-031-60692-2_10(127-142)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60692-2_10
Keppel JStrauss MFaltaous SLiebers JHeger RGruenefeld USchneegass S(2023)Don't Forget to Disinfect: Understanding Technology-Supported Hand Disinfection StationsProceedings of the ACM on Human-Computer Interaction10.1145/36042517:MHCI(1-18)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604251
Sheremetieva ARomanovych IFrish SMaksymenko MGeorgiou O(2023)What’s my future: a Multisensory and Multimodal Digital Human Agent Interactive ExperienceProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596161(40-46)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596161
Meng-Chew LLee-Yeng OJian-Wei N(2023)Digital Signage-Augmented Roadshow (DiSAR)2023 10th International Conference on ICT for Smart Society (ICISS)10.1109/ICISS59129.2023.10291352(1-8)Online publication date: 6-Sep-2023
https://doi.org/10.1109/ICISS59129.2023.10291352
Chatziantoniou AStivaktakis NSifakis MZidianakis EMargetis GPaparoulis GPartarakis NStephanidis C(2023)COVID-Free Interaction with Public DisplaysHCI International 2023 – Late Breaking Posters10.1007/978-3-031-49212-9_68(556-563)Online publication date: 12-Dec-2023
https://doi.org/10.1007/978-3-031-49212-9_68
Watson KBretin RKhamis MMathis F(2022)The Feet in Human-Centred Security: Investigating Foot-Based User Authentication for Public DisplaysExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519838(1-9)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519838
Mitsuhara HShishibori M(2021)Interactive Digital Signage System Enabling Viewers to Answer Quizzes by Body ActionsInformation and Technology in Education and Learning10.12937/itel.1.1.Dev.p0011:1(Dev-p001-Dev-p001)Online publication date: 2021
https://doi.org/10.12937/itel.1.1.Dev.p001
Faltaous SGruenefeld USchneegass S(2021)Towards a Universal Human-Computer Interaction Model for Multimodal InteractionsProceedings of Mensch und Computer 202110.1145/3473856.3474008(59-63)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3474008
Yoshida NYonezawa T(2021)Attention-Guidance Method Based on Conforming Behavior of Multiple Virtual Agents for PedestriansProceedings of the 21st ACM International Conference on Intelligent Virtual Agents10.1145/3472306.3478346(209-215)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3472306.3478346
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents