research-article

Instant user interfaces: repurposing everyday objects as input devices

Authors:

Christian Corsten,

Ignacio Avellino,

Jan BorchersAuthors Info & Claims

ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

Pages 71 - 80

https://doi.org/10.1145/2512349.2512799

Published: 06 October 2013 Publication History

Abstract

Dedicated input devices are frequently used for system control. We present Instant User Interfaces, an interaction paradigm that loosens this dependency and allows operating a system even when its dedicated controller is unavailable. We implemented a reliable, marker-free object tracking system that enables users to assign semantic meaning to different poses or to touches in different areas. With this system, users can repurpose everyday objects and program them in an ad-hoc manner, using a GUI or by demonstration, as input devices. Users tested and ranked these methods alongside a Wizard-of-Oz speech interface. The testers did not show a clear preference as a group, but had individual preferences.

Supplementary Material

suppl.mov (its134.mp4)

Supplemental video

Download
24.92 MB

References

[1]

Akaoka, E., Ginn, T., and Vertegaal, R. DisplayObjects: Prototyping Functional Physical Interfaces on 3D Styrofoam, Paper, or Cardboard Models. In Proc. TEI'10, 49--56.

Digital Library

[2]

Besl, P. J., and McKay, N. D. Method for Registration of 3-D Shapes. In Proc. TPAMI '92, 586--606.

[3]

Cheng, K.-Y., Liang, R.-H., Chen, B.-Y., Laing, R.-H., and Kuo, S.-Y. iCon: Utilizing Everyday Objects as Additional, Auxiliary and Instant Tabletop Controllers. In Proc. CHI '10, 1155--1164.

Digital Library

[4]

Fitzmaurice, G. W., and Buxton, W. An Empirical Evaluation of Graspable User Interfaces: Towards Specialized, Space-Multiplexed Input. In Proc. CHI '97, 43--50.

Digital Library

[5]

Greenberg, S., and Boyle, M. Customizable Physical Interfaces for Interacting with Conventional Applications. In Proc. UIST '02, 31--40.

Digital Library

[6]

Greenberg, S., and Fitchett, C. Phidgets: Easy Development of Physical Interfaces Through Physical Widgets. In Proc. UIST '01, 209--218.

Digital Library

[7]

Gustafson, S., Bierwirth, D., and Baudisch, P. Imaginary Interfaces: Spatial Interaction with Empty Hands and without Visual Feedback. In Proc. UIST '10, 927--930.

Digital Library

[8]

Gustafson, S., Holz, C., and Baudisch, P. Imaginary Phone: Learning Imaginary Interfaces by Transferring Spatial Memory from a Familiar Device. In Proc. UIST'11, 283--292.

Digital Library

[9]

Harrison, C., Benko, H., and Wilson, A. D. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proc. UIST '11, 441--450.

Digital Library

[10]

Harrison, C., Ramamurthy, S., and Hudson, S. E. On-Body Interaction: Armed and Dangerous. In Proc. TEI '12, 69--76.

Digital Library

[11]

Harrison, C., Tan, D., and Morris, D. Skinput: Appropriating the Body as an Input Surface. In Proc. CHI '10, 453--462.

Digital Library

[12]

Held, R., Gupta, A., Curless, B., and Agrawala, M. 3D Puppetry: A Kinect-Based Interface For 3D Animation. In Proc. UIST '12, 423--434.

Digital Library

[13]

Henderson, S. J., and Feiner, S. Opportunistic Controls: Leveraging Natural Affordances as Tangible User Interfaces for Augmented Reality. In Proc. VRST '08, 211--218.

Digital Library

[14]

Heun, V., Kasahara, S., and Maes, P. Smarter Objects: Using AR Technology to Program Physical Objects and Their Interactions. In CHI EA '13, 961--966.

Digital Library

[15]

Holman, D., and Vertegaal, R. Organic User Interfaces. Communications of the ACM 51, 6 (June 2008), 48--55.

Digital Library

[16]

Ishii, H., and Ullmer, B. Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms. In Proc. CHI '97, 234--241.

Digital Library

[17]

Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. KinectFusion: Real-Time 3D Reconstruction and Interaction Using a Moving Depth Camera. In Proc. UIST '11, 559--568.

Digital Library

[18]

Liu, K., Kaleas, D., and Ruuspakka, R. Prototyping Interaction with Everyday Artifacts: Training and Recognizing 3D Objects via Kinects. In Proc. TEI '12, 241--244.

Digital Library

[19]

Mistry, P., and Maes, P. WUW - Wear Ur World - A Wearable Gestural Interface. In CHI EA '09, 4111--4116.

Digital Library

[20]

Norman, D. A. The Design of Everyday Things. Basic Books (AZ), 2002.

Digital Library

[21]

Papazov, C., and Burschka, D. An Efficient RANSAC for 3D Object Recognition in Noisy and Occluded Scenes. In Proc. ACCV '10, 135--148.

Digital Library

[22]

Samsung Electronics. Samsung SmartView. http://www.samsung.com/au/tv/my-hub/apps-store/smart-view.html. {Online; accessed 12-Aug-2013}.

[23]

Serrien, D. J., Bogaerts, H., Suy, E., and Swinnen, S. P. The Identification of Coordination Constraints Across Planes of Motion. Experimental Brain Research 128, 1-2 (Sept. 1999), 250--255.

[24]

Shahrokni, A., Jenaro, J., Gustafsson, T., Vinnberg, A., Sandsj&, J., and Fjeld, M. One-Dimensional Force Feedback Slider: Going from an Analogue to a Digital Platform. In Proc. NordiCHI '06, 453--456.

Digital Library

[25]

Sterling, B. Shaping Things. MIT Press (MA), 2005.

[26]

Weiser, M. The Computer for the 21st Century. Pervasive Computing, IEEE 1, 1 (2002), 19--25.

Digital Library

[27]

Wilson, A. Using a Depth Camera as a Touch Sensor. In Proc. TABLETOP '10, 69--72.

Digital Library

[28]

Xiao, R., Harrison, C., and Hudson, S. E. WorldKit: Rapid and Easy Creation of Ad-Hoc Interactive Applications on Everyday Surfaces. In Proc. CHI '13, 879--888.

Digital Library

[29]

Yi, B., Cao, X., Fjeld, M., and Zhao, S. Exploring User Motivations for Eyes-Free Interaction on Mobile Devices. In Proc. CHI '12, 2789--2792.

Digital Library

[30]

Zerroug, A., Cassinelli, A., and Ishikawa, M. Invoked Computing: Spatial Audio and Video AR Invoked Through Miming. In Proc. VRIC '11, 31--32.

Cited By

Rayzhekov AMurer M(2025)The Well-Tempered Objects: Using Everyday Things for Tangible CompositionProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3705994(1-7)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3705994
He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Greenslade MClark ALukosch S(2024)Becoming Q: Using Design Workshops to Explore Everyday Objects as Interaction Devices for an Augmented Reality Spy GameProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682096(1-11)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682096
Show More Cited By

Recommendations

Opportunistic Interfaces for Augmented Reality: Transforming Everyday Objects into Tangible 6DoF Interfaces Using Ad hoc UI
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Real-time environmental tracking has become a fundamental capability in modern mobile phones and AR/VR devices. However, it only allows user interfaces to be anchored at a static location. Although fiducial and natural-feature tracking overlays ...
3D User Interfaces: New Directions and Perspectives

Three-dimensional user interfaces (3D UIs) let users interact with virtual objects, environments, or information using direct 3D input in the physical and/or virtual space. In this article, the founders and organizers of the IEEE Symposium on 3D User ...
On tangible user interfaces, humans and spatiality

Like the prehistoric twig and stone, tangible user interfaces (TUIs) are objects manipulated by humans. Tangible user interface success will depend on how well they exploit spatiality, the intuitive spatial skills humans have with the objects they use. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

October 2013

514 pages

ISBN:9781450322713

DOI:10.1145/2512349

General Chairs:
Aaron Quigley
University of St. Andrews, UK
,
Giulio Jacucci
HIIT / University of Helsinki, Finland
,
Program Chairs:
Michael Horn
Northwestern University, USA
,
Miguel Nacenta
University of St. Andrews, UK

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS '13

Sponsor:

SIGCHI

ITS '13: The ACM International Conference on Interactive Tabletops and Surfaces

October 6 - 9, 2013

St. Andrews, Scotland, United Kingdom

Acceptance Rates

ITS '13 Paper Acceptance Rate 35 of 121 submissions, 29%;

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
1,146
Total Downloads

Downloads (Last 12 months)85
Downloads (Last 6 weeks)5

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rayzhekov AMurer M(2025)The Well-Tempered Objects: Using Everyday Things for Tangible CompositionProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3705994(1-7)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3705994
He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Greenslade MClark ALukosch S(2024)Becoming Q: Using Design Workshops to Explore Everyday Objects as Interaction Devices for an Augmented Reality Spy GameProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682096(1-11)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682096
Zhang LYuan YLi JCassinelli AZhu K(2024)WhisperCup: A Design Exploration for Improving the Remote Communication between Chinese Parents and Their Adult Children through Digitally-Augmented Everyday ObjectsProceedings of the ACM on Human-Computer Interaction10.1145/36765348:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676534
Sharma AIvanov ALai FGrossman TSantosa S(2024)GraspUI: Seamlessly Integrating Object-Centric Gestures within the Seven Phases of GraspingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661551(1275-1289)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661551
Ganjeh PChamunorwa MParambil Gopal AMutyala S(2023)Vasi-Light: Using Everyday Decorative Items as Smarthome InterfacesProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3631879(565-567)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3631879
Greenslade MClark ALukosch S(2023)Using Everyday Objects as Props for Virtual Objects in First Person Augmented Reality Games: An Elicitation StudyProceedings of the ACM on Human-Computer Interaction10.1145/36110527:CHI PLAY(856-875)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611052
Gong WSantosa SGrossman TGlueck MClarke DLai F(2023)Affordance-Based and User-Defined Gestures for Spatial Tangible InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596032(1500-1514)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596032
Monteiro KVatsal RChulpongsatorn NParnami ASuzuki R(2023)Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine TeachingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581449(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581449
Grubert J(2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten