Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2512349.2512799acmconferencesArticle/Chapter ViewAbstractPublication PagesissConference Proceedingsconference-collections
research-article

Instant user interfaces: repurposing everyday objects as input devices

Published: 06 October 2013 Publication History

Abstract

Dedicated input devices are frequently used for system control. We present Instant User Interfaces, an interaction paradigm that loosens this dependency and allows operating a system even when its dedicated controller is unavailable. We implemented a reliable, marker-free object tracking system that enables users to assign semantic meaning to different poses or to touches in different areas. With this system, users can repurpose everyday objects and program them in an ad-hoc manner, using a GUI or by demonstration, as input devices. Users tested and ranked these methods alongside a Wizard-of-Oz speech interface. The testers did not show a clear preference as a group, but had individual preferences.

Supplementary Material

suppl.mov (its134.mp4)
Supplemental video

References

[1]
Akaoka, E., Ginn, T., and Vertegaal, R. DisplayObjects: Prototyping Functional Physical Interfaces on 3D Styrofoam, Paper, or Cardboard Models. In Proc. TEI'10, 49--56.
[2]
Besl, P. J., and McKay, N. D. Method for Registration of 3-D Shapes. In Proc. TPAMI '92, 586--606.
[3]
Cheng, K.-Y., Liang, R.-H., Chen, B.-Y., Laing, R.-H., and Kuo, S.-Y. iCon: Utilizing Everyday Objects as Additional, Auxiliary and Instant Tabletop Controllers. In Proc. CHI '10, 1155--1164.
[4]
Fitzmaurice, G. W., and Buxton, W. An Empirical Evaluation of Graspable User Interfaces: Towards Specialized, Space-Multiplexed Input. In Proc. CHI '97, 43--50.
[5]
Greenberg, S., and Boyle, M. Customizable Physical Interfaces for Interacting with Conventional Applications. In Proc. UIST '02, 31--40.
[6]
Greenberg, S., and Fitchett, C. Phidgets: Easy Development of Physical Interfaces Through Physical Widgets. In Proc. UIST '01, 209--218.
[7]
Gustafson, S., Bierwirth, D., and Baudisch, P. Imaginary Interfaces: Spatial Interaction with Empty Hands and without Visual Feedback. In Proc. UIST '10, 927--930.
[8]
Gustafson, S., Holz, C., and Baudisch, P. Imaginary Phone: Learning Imaginary Interfaces by Transferring Spatial Memory from a Familiar Device. In Proc. UIST'11, 283--292.
[9]
Harrison, C., Benko, H., and Wilson, A. D. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proc. UIST '11, 441--450.
[10]
Harrison, C., Ramamurthy, S., and Hudson, S. E. On-Body Interaction: Armed and Dangerous. In Proc. TEI '12, 69--76.
[11]
Harrison, C., Tan, D., and Morris, D. Skinput: Appropriating the Body as an Input Surface. In Proc. CHI '10, 453--462.
[12]
Held, R., Gupta, A., Curless, B., and Agrawala, M. 3D Puppetry: A Kinect-Based Interface For 3D Animation. In Proc. UIST '12, 423--434.
[13]
Henderson, S. J., and Feiner, S. Opportunistic Controls: Leveraging Natural Affordances as Tangible User Interfaces for Augmented Reality. In Proc. VRST '08, 211--218.
[14]
Heun, V., Kasahara, S., and Maes, P. Smarter Objects: Using AR Technology to Program Physical Objects and Their Interactions. In CHI EA '13, 961--966.
[15]
Holman, D., and Vertegaal, R. Organic User Interfaces. Communications of the ACM 51, 6 (June 2008), 48--55.
[16]
Ishii, H., and Ullmer, B. Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms. In Proc. CHI '97, 234--241.
[17]
Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. KinectFusion: Real-Time 3D Reconstruction and Interaction Using a Moving Depth Camera. In Proc. UIST '11, 559--568.
[18]
Liu, K., Kaleas, D., and Ruuspakka, R. Prototyping Interaction with Everyday Artifacts: Training and Recognizing 3D Objects via Kinects. In Proc. TEI '12, 241--244.
[19]
Mistry, P., and Maes, P. WUW - Wear Ur World - A Wearable Gestural Interface. In CHI EA '09, 4111--4116.
[20]
Norman, D. A. The Design of Everyday Things. Basic Books (AZ), 2002.
[21]
Papazov, C., and Burschka, D. An Efficient RANSAC for 3D Object Recognition in Noisy and Occluded Scenes. In Proc. ACCV '10, 135--148.
[22]
Samsung Electronics. Samsung SmartView. http://www.samsung.com/au/tv/my-hub/apps-store/smart-view.html. {Online; accessed 12-Aug-2013}.
[23]
Serrien, D. J., Bogaerts, H., Suy, E., and Swinnen, S. P. The Identification of Coordination Constraints Across Planes of Motion. Experimental Brain Research 128, 1-2 (Sept. 1999), 250--255.
[24]
Shahrokni, A., Jenaro, J., Gustafsson, T., Vinnberg, A., Sandsj&, J., and Fjeld, M. One-Dimensional Force Feedback Slider: Going from an Analogue to a Digital Platform. In Proc. NordiCHI '06, 453--456.
[25]
Sterling, B. Shaping Things. MIT Press (MA), 2005.
[26]
Weiser, M. The Computer for the 21st Century. Pervasive Computing, IEEE 1, 1 (2002), 19--25.
[27]
Wilson, A. Using a Depth Camera as a Touch Sensor. In Proc. TABLETOP '10, 69--72.
[28]
Xiao, R., Harrison, C., and Hudson, S. E. WorldKit: Rapid and Easy Creation of Ad-Hoc Interactive Applications on Everyday Surfaces. In Proc. CHI '13, 879--888.
[29]
Yi, B., Cao, X., Fjeld, M., and Zhao, S. Exploring User Motivations for Eyes-Free Interaction on Mobile Devices. In Proc. CHI '12, 2789--2792.
[30]
Zerroug, A., Cassinelli, A., and Ishikawa, M. Invoked Computing: Spatial Audio and Video AR Invoked Through Miming. In Proc. VRIC '11, 31--32.

Cited By

View all
  • (2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
  • (2024)Becoming Q: Using Design Workshops to Explore Everyday Objects as Interaction Devices for an Augmented Reality Spy GameProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682096(1-11)Online publication date: 7-Oct-2024
  • (2024)WhisperCup: A Design Exploration for Improving the Remote Communication between Chinese Parents and Their Adult Children through Digitally-Augmented Everyday ObjectsProceedings of the ACM on Human-Computer Interaction10.1145/36765348:MHCI(1-26)Online publication date: 24-Sep-2024
  • Show More Cited By

Index Terms

  1. Instant user interfaces: repurposing everyday objects as input devices

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
    October 2013
    514 pages
    ISBN:9781450322713
    DOI:10.1145/2512349
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 October 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. affordances
    2. everyday objects
    3. input devices
    4. instant uis

    Qualifiers

    • Research-article

    Conference

    ITS '13
    Sponsor:
    ITS '13: The ACM International Conference on Interactive Tabletops and Surfaces
    October 6 - 9, 2013
    St. Andrews, Scotland, United Kingdom

    Acceptance Rates

    ITS '13 Paper Acceptance Rate 35 of 121 submissions, 29%;
    Overall Acceptance Rate 119 of 418 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)94
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 23 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
    • (2024)Becoming Q: Using Design Workshops to Explore Everyday Objects as Interaction Devices for an Augmented Reality Spy GameProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682096(1-11)Online publication date: 7-Oct-2024
    • (2024)WhisperCup: A Design Exploration for Improving the Remote Communication between Chinese Parents and Their Adult Children through Digitally-Augmented Everyday ObjectsProceedings of the ACM on Human-Computer Interaction10.1145/36765348:MHCI(1-26)Online publication date: 24-Sep-2024
    • (2024)GraspUI: Seamlessly Integrating Object-Centric Gestures within the Seven Phases of GraspingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661551(1275-1289)Online publication date: 1-Jul-2024
    • (2023)Vasi-Light: Using Everyday Decorative Items as Smarthome InterfacesProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3631879(565-567)Online publication date: 3-Dec-2023
    • (2023)Using Everyday Objects as Props for Virtual Objects in First Person Augmented Reality Games: An Elicitation StudyProceedings of the ACM on Human-Computer Interaction10.1145/36110527:CHI PLAY(856-875)Online publication date: 4-Oct-2023
    • (2023)Affordance-Based and User-Defined Gestures for Spatial Tangible InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596032(1500-1514)Online publication date: 10-Jul-2023
    • (2023)Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine TeachingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581449(1-15)Online publication date: 19-Apr-2023
    • (2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
    • (2022)Exploration on Everyday Objects as an IoT Control InterfaceProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533472(1654-1668)Online publication date: 13-Jun-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media