research-article

On the Other Hand: Embodied Metaphors for Interactions with Mnemonic Objects in Live Presentations

Authors:

Fabian Hemmert,

Gesche JoostAuthors Info & Claims

TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 211 - 217

https://doi.org/10.1145/2839462.2839470

Published: 14 February 2016 Publication History

Abstract

We describe a presentation system based on the embodied metaphors of giving presentations: topics are picked up, one goes through a series of points, and comes to a conclusion. Technically, our system is based on body tracking and hand-worn RFID readers. Wearing these readers, users can activate topics in live presentations by picking up RFID-tagged mnemonic objects. Each topic can consist of multiple points, which are mapped to positions on stage. Users can activate a point (and its corresponding slide) by walking up to its position on stage. Various actions, triggered by constellations of handheld objects and movements on stage, are supported by the system. We conducted a series of informal user feedback sessions. Its results indicate that our system has strengths and weaknesses, depending on presenter style and presentation context.

References

[1]

Thomas Augsten, Konstantin Kaefer, René Meusel, Caroline Fetzer, Dorian Kanitz, Thomas Stoff, Torsten Becker, Christian Holz, and Patrick Baudisch. 2010. Multitoe: High-Precision Interaction with Back-Projected Floors Based on High-Resolution Multi-Touch Input. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, 209--218.

Digital Library

[2]

Ralph Barthel, Kerstin L. Mackley, Andrew H. Smith, Angelina Karpovich, Martin Jode, and Chris Speed. 2013. An Internet of Old Things as an Augmented Memory System. Personal Ubiquitous Comput. 17, 2 (16 Feb. 2013), 321--333.

Digital Library

[3]

Thomas Baudel and Michel B. Lafon. 1993. Charade: Remote Control of Objects Using Free-hand Gestures. Commun. ACM 36, 7 (July 1993), 28--35.

Digital Library

[4]

Michael J. Beatty and Ralph R. Behnke. 1991. Effects of Public Speaking Trait Anxiety and Intensity of Speaking Task on Heart Rate During Performance. Human Communication Research 18, 2 (1 Dec. 1991), 147--176.

[5]

Xavier Benavides, Judith Amores, and Pattie Maes. 2014. TagMe: An Easy-to-use Toolkit for Turning the Personal Environment into an Extended Communications Interface. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14). ACM, New York, NY, USA, 2197--2202.

Digital Library

[6]

Hrvoje Benko, Ricardo Jota, and Andrew Wilson. 2012. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 199--208.

Digital Library

[7]

Hrvoje Benko, Andrew D. Wilson, and Federico Zannier. 2014. Dyadic Projected Spatial Augmented Reality. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 645--655.

Digital Library

[8]

Allen Bevans. 2011. Investigating the Effects of Bimanual Multitouch Interaction on Creativity. In Proceedings of the 8th ACM Conference on Creativity and Cognition (C&C '11). ACM, New York, NY, USA, 451--452.

Digital Library

[9]

Ionut Constandache, Sharad Agarwal, Ivan Tashev, and Romit R. Choudhury. 2014. Daredevil: Indoor Location Using Sound. SIGMOBILE Mob. Comput. Commun. Rev. 18, 2 (June 2014), 9--19.

Digital Library

[10]

Susan Wagner W. Cook, Terina Kuangyi K. Yip, and Susan Goldin-Meadow. 2010. Gesturing makes Memories that Last. Journal of memory and language 63, 4 (30 Nov. 2010), 465--475.

[11]

Stefania Cuccurullo, Rita Francese, Sharefa Murad, Ignazio Passero, and Maurizio Tucci. 2012. A Gestural Approach to Presentation Exploiting Motion Capture Metaphors. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12). ACM, New York, NY, USA, 148--155.

Digital Library

[12]

Paul Dourish. 2001. Where the Action Is: The Foundations of Embodied Interaction. The MIT Press.

[13]

Darren Edge and Alan F. Blackwell. 2009. Peripheral Tangible Interaction by Analytic Design. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI '09). ACM, New York, NY, USA, 69--76.

Digital Library

[14]

Darren Edge, Joan Savage, and Koji Yatani. 2013. HyperSlides: Dynamic Presentation Prototyping. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 671--680.

Digital Library

[15]

Alain Findeli, Denis Brouillet, Sophie Martin, Christopher Moineau, and Richard Tarrago. 2008. Research Through Design and Transdisciplinarity: A Tentative Contribution to the Methodology of Design Research. In Focused -- Current Design Research Projects and Methods. Swiss Design Network Symposium 2008. Swiss Design Network, Bern, 67--91.

[16]

Adam Fourney, Michael Terry, and Richard Mann. 2010. Gesturing in the Wild: Understanding the Effects and Implications of Gesture-Based Interaction for Dynamic Presentations. In Proceedings of the 24th BCS Interaction Specialist Group Conference, BCS '10. British Computer Society, Swinton, UK, 230--240. http://ewic.bcs.org/content/ConWebDoc/43350

Digital Library

[17]

Lance Good and Benjamin B. Bederson. 2002. Zoomable User Interfaces As a Medium for Slide Show Presentations. Information Visualization 1, 1 (March 2002), 35--49.

[18]

Yves Guiard. 1987. Asymmetric Division of Labor in Human Skilled Bimanual Action: the Kinematic Chain as a Model. Journal of motor behavior 19, 4 (Dec. 1987), 486--517. http://view.ncbi.nlm.nih.gov/ /15136274

[19]

Bart Hengeveld. 2013. LinguaBytes. interactions 20, 6 (Nov. 2013), 22--26.

Digital Library

[20]

Ken Hinckley, Randy Pausch, Dennis Proffitt, and Neal F. Kassell. 1998. Two-handed Virtual Manipulation. ACM Trans. Comput.-Hum. Interact. 5, 3 (Sept. 1998), 260--302.

Digital Library

[21]

Michael S. Horn, Erin T. Solovey, R. Jordan Crouser, and Robert J. K. Jacob. 2009. Comparing the Use of Tangible and Graphical Programming Languages for Informal Science Education. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 975--984.

Digital Library

[22]

Jörn Hurtienne and Johann H. Israel. 2007. Image Schemas and Their Metaphorical Extensions: Intuitive Patterns for Tangible Interaction. In Proceedings of the 1st international conference on Tangible and embedded interaction (TEI '07). ACM, New York, NY, USA, 127--134.

Digital Library

[23]

Amandine A. Jaco, Stéphanie Buisine, Jessy Barré, Améziane Aoussat, and Frédéric Vernier. 2014. Trains of Thought on the Tabletop: Visualizing Association of Ideas Improves Creativity. Personal Ubiquitous Comput. 18, 5 (June 2014), 1159--1167.

Digital Library

[24]

Robert J. K. Jacob. 1990. What You Look at is What You Get: Eye Movement-based Interaction Techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90). ACM, New York, NY, USA, 11--18.

Digital Library

[25]

Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-camera Units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 637--644.

Digital Library

[26]

Aisling Kelliher, David Birchfield, Ellen Campana, Sarah Hatton, Mina J. Glenberg, Christopher Martinez, Loren Olson, Philippos Savvides, Lisa Tolentino, Kelly Phillips, and Sibel Uysal. 2009. SMALLab: a Mixed-Reality Environment for Embodied and Mediated Learning. In MM '09: Proceedings of the seventeen ACM international conference on Multimedia. ACM, New York, NY, USA, 1029--1032.

Digital Library

[27]

Ye S. Kuo, Pat Pannuto, Ko J. Hsiao, and Prabal Dutta. 2014. Luxapose: Indoor Positioning with Mobile Phones and Visible Light. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom '14). ACM, New York, NY, USA, 447--458.

Digital Library

[28]

Jean B. Labrune and Wendy Mackay. 2006. Telebeads: Social Network Mnemonics for Teenagers. In Proceedings of the 2006 Conference on Interaction Design and Children (IDC '06). ACM, New York, NY, USA, 57--64.

Digital Library

[29]

George Lakoff and Mark Johnson. 2003. Metaphors We Live By (2nd ed.). University Of Chicago Press.

[30]

Andrea Leganchuk, Shumin Zhai, and William Buxton. 1998. Manual and Cognitive Benefits of Two-handed Input: An Experimental Study. ACM Trans. Comput.-Hum. Interact. 5, 4 (Dec. 1998), 326--359.

Digital Library

[31]

Leonhard Lichtschlag, Thorsten Karrer, and Jan Borchers. 2009. Fly: A Tool to Author Planar Presentations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 547--556.

Digital Library

[32]

Chi Y. Lin and Ming T. Hung. 2014. A Location-based Personal Task Reminder for Mobile Users. Personal Ubiquitous Comput. 18, 2 (Feb. 2014), 303--314.

Digital Library

[33]

Tiago Martins, Christa Sommerer, Laurent Mignonneau, and Nuno Correia. 2008. Gauntlet: A Wearable Interface for Ubiquitous Gaming. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '08). ACM, New York, NY, USA, 367--370.

Digital Library

[34]

Maurice Merleau-Ponty. 1962. Phenomenology of Perception (2 ed.). Routledge.

[35]

Les Nelson, Satoshi Ichimura, Elin R. Pedersen, and Lia Adams. 1999. Palette: A Paper Interface for Giving Presentations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 354--361.

Digital Library

[36]

Elin R. Pedersen, Tomas Sokoler, and Les Nelson. 2000. PaperButtons: Expanding a Tangible User Interface. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '00). ACM, New York, NY, USA, 216--223.

Digital Library

[37]

Jean Piaget. 1923. The Language and Thought of the Child.

[38]

Michael J. Reddy. 1979. The Conduit Metaphor: A Case of Frame Conflict in our Language about Language. In Metaphor and Thought, A. Ortony (Ed.). Cambridge University Press, 284--310.

[39]

Beat Signer and Moira C. Norrie. 2007. PaperPoint: A Paper-based Presentation and Interactive Paper Prototyping Tool. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI '07). ACM, New York, NY, USA, 57--64.

Digital Library

[40]

Ryan Spicer, Yu R. Lin, Aisling Kelliher, and Hari Sundaram. 2012. NextSlidePlease: Authoring and Delivering Agile Multimedia Presentations. ACM Trans. Multimedia Comput. Commun. Appl. 8, 4 (Nov. 2012).

Digital Library

[41]

Karen Tanenbaum, Joshua Tanenbaum, Alissa N. Antle, Jim Bizzocchi, Magy Seif el Nasr, and Marek Hatala. 2011. Experiencing the Reading Glove. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 137--144.

Digital Library

[42]

Ole Tillmann. 2015. (2015). http://www.tillmann.com Retrieved: November 1st, 2015.

[43]

Cathy P. Treadaway. 2009. Hand e-Craft: An Investigation into Hand Use in Digital Creative Practice. In Proceedings of the Seventh ACM Conference on Creativity and Cognition (C&C '09). ACM, New York, NY, USA, 185--194.

Digital Library

[44]

Ha Trinh, Lazlo Ring, and Timothy Bickmore. 2015. DynamicDuo: Co-presenting with Virtual Agents. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1739--1748.

Digital Library

[45]

Nina Valkanova, Robert Walter, Andrew V. Moere, and Jörg Müller. 2014. MyPosition: Sparking Civic Discourse by a Public Interactive Poll Visualization. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, New York, NY, USA, 1323--1332.

Digital Library

[46]

Julie Wagner, Stéphane Huot, and Wendy Mackay. 2012. BiTouch and BiPad: Designing Bimanual Interaction for Hand-held Tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2317--2326.

Digital Library

[47]

Malte Weiss, Simon Voelker, Christine Sutter, and Jan Borchers. 2010. BendDesk: Dragging Across the Curve. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, 1--10.

Digital Library

[48]

Raphael Wimmer, Fabian Hennecke, Florian Schulz, Sebastian Boring, Andreas Butz, and Heinrich Hussmann. 2010. Curve: Revisiting the Digital Desk. In Extending Boundaries: Proceedings of the 6th Nordic Conference on Human-Computer Interaction (NordiCHI '10). ACM, 561--570.

Digital Library

[49]

Frances A. Yates. 2001. The Art of Memory. University Of Chicago Press.

Cited By

Ullmer BShaer OMazalek AHummels C(2022)Weaving Fire into FormundefinedOnline publication date: 20-Jul-2022
Pereira AJulio RBastos G(2018)ROSRemote: Using ROS on Cloud to Access Robots RemotelyRobot Operating System (ROS)10.1007/978-3-319-91590-6_16(569-605)Online publication date: 6-Jul-2018

Index Terms

On the Other Hand: Embodied Metaphors for Interactions with Mnemonic Objects in Live Presentations
1. Human-centered computing

Recommendations

MiLa: An Audiovisual Instrument for Learning the Curwen Hand Signs
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

We present a novel musical system for learning the Curwen-Kodaly hand signs, which stand for solfege syllables and pitches (do, re, mi, etc.). These hand postures comprise a system of musical notation typically used in sight-singing training to ...
Embodied eTube Gestures and Agency
MOCO '24: Proceedings of the 9th International Conference on Movement and Computing

Following three years of working on the eTube with a collaborative interdisciplinary team, we describe the embodied and spatialized performance gestures developed in tandem with a microphone setup for interacting with musical improvising agents. Eric ...
JamGesture: an improvisation support system based on physical gesture observed with smartphone
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

The physical gestures promote musical comprehension because they can provide visual information of musical performance for others. Melodic outlines especially have a high affinity with intuitive physical gestures. We propose methods for recognizing ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2016

820 pages

ISBN:9781450335829

DOI:10.1145/2839462

Conference Chairs:
Saskia Bakker,
Caroline Hummels,
Brygg Ullmer,
Program Chairs:
Luc Geurts,
Bart Hengeveld,
Daniel Saakes,
Publications Chair:
Mendel Broekhuijsen

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 February 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

TEI '16

TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

February 14 - 17, 2016

Eindhoven, Netherlands

Acceptance Rates

TEI '16 Paper Acceptance Rate 45 of 178 submissions, 25%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
258
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ullmer BShaer OMazalek AHummels C(2022)Weaving Fire into FormundefinedOnline publication date: 20-Jul-2022
Pereira AJulio RBastos G(2018)ROSRemote: Using ROS on Cloud to Access Robots RemotelyRobot Operating System (ROS)10.1007/978-3-319-91590-6_16(569-605)Online publication date: 6-Jul-2018

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents