Work in Progress

Turning everyday objects into passive tangible controllers

Authors:

Adam Drogemuller,

Bruce H ThomasAuthors Info & Claims

TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction

Article No.: 54, Pages 1 - 4

https://doi.org/10.1145/3430524.3442460

Published: 14 February 2021 Publication History

Abstract

In augmented reality (AR), gesture/hand-based interactions are becoming more common place over tangible user interfaces (TUIs) and physical controllers. Major concerns regard portability and battery-life with TUIs and physical controllers in an AR environment. For a TUI or physical controller to be usable ”on the go” and in the field, they need to be compact such that they can be easily deployable. Subsequently, it is desirable to be low-energy or powerless, such that the device remains functional after long periods. In this paper, we present our initial design towards a powerless, passive controller that leverages the optical camera of a AR head-mounted display (such as the Hololens or Magic Leap) for tracking. We discuss related work, design motivations, high and low fidelity designs, opportunistic/adaptable input modalities, and use cases. We conclude with propositions for future work.

References

[1]

Richard A. Bolt. 1980. “Put-That-There”: Voice and Gesture at the Graphics Interface. In Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques (Seattle, Washington, USA) (SIGGRAPH ’80). Association for Computing Machinery, New York, NY, USA, 262–270. https://doi.org/10.1145/800250.807503

Digital Library

[2]

Martin Feick, Scott Bateman, Anthony Tang, André Miede, and Nicolai Marquardt. 2020. TanGi: Tangible Proxies for Embodied Object Exploration and Manipulation in Virtual Reality. ArXiv abs/2001.03021(2020).

[3]

Luciano Gamberini and Anna Spagnolli. 2017. Towards a Definition of Symbiotic Relations Between Humans and Machines. In Symbiotic Interaction, Luciano Gamberini, Anna Spagnolli, Giulio Jacucci, Benjamin Blankertz, and Jonathan Freeman (Eds.). Springer International Publishing, Cham, 1–4.

[4]

Sergio Garrido-Jurado, Rafael MuÃ±oz-Salinas, Francisco Madrid-Cuevas, and Rafael Medina-Carnicer. 2015. Generation of fiducial marker dictionaries using Mixed Integer Linear Programming. Pattern Recognition 51 (10 2015). https://doi.org/10.1016/j.patcog.2015.09.023

Digital Library

[5]

Steven J. Henderson and Steven Feiner. 2008. Opportunistic Controls: Leveraging Natural Affordances as Tangible User Interfaces for Augmented Reality. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (Bordeaux, France) (VRST ’08). Association for Computing Machinery, New York, NY, USA, 211–218. https://doi.org/10.1145/1450579.1450625

Digital Library

[6]

Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1957–1967. https://doi.org/10.1145/2858036.2858134

Digital Library

[7]

Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical Atoms: Beyond Tangible Bits, toward Transformable Materials. Interactions 19, 1 (Jan. 2012), 38–51. https://doi.org/10.1145/2065327.2065337

Digital Library

[8]

Giulio Jacucci, Anna Spagnolli, Jonathan Freeman, and Luciano Gamberini. 2014. Symbiotic Interaction: A Critical Definition and Comparison to other Human-Computer Paradigms, Vol. 8820. 3–20. https://doi.org/10.1007/978-3-319-13500-7_1

[9]

Seokbin Kang, Ekta Shokeen, Virginia L Byrne, Leyla Norooz, Elizabeth Bonsignore, Caro Williams-pierce, and Jon E Froehlich. 2020. ARMath : Augmenting Everyday Life with Math Learning. (2020).

[10]

Annie Kelly, R. Benjamin Shapiro, Jonathan de Halleux, and Thomas Ball. 2018. ARcadia: A Rapid Prototyping Platform for Real-Time Tangible Interfaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3173574.3173983

Digital Library

[11]

Francisco Romero-Ramirez, Rafael Muñoz-Salinas, and Rafael Medina-Carnicer. 2018. Speeded Up Detection of Squared Fiducial Markers. Image and Vision Computing 76 (06 2018). https://doi.org/10.1016/j.imavis.2018.05.004

[12]

Eric Saund. 1999. Bringing the marks on a whiteboard to electronic life. In International Workshop on Cooperative Buildings. Springer, 69–78.

[13]

James A Walsh, Stewart Von Itzstein, and Bruce H Thomas. 2013. Tangible agile mapping: ad-hoc tangible user interaction definition. In Proceedings of the Fourteenth Australasian User Interface Conference-Volume 139. 3–12.

[14]

James A. Walsh, Stewart von Itzstein, and Bruce H. Thomas. 2014. Ephemeral interaction using everyday objects. Conferences in Research and Practice in Information Technology Series 150(2014), 29–37.

[15]

Kening Zhu, Taizhou Chen, Feng Han, and Yi-Shiun Wu. 2019. HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-Cost Twistable Artefacts. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300923

Digital Library

Cited By

Burnah TImtiaz MGuesgen HRudolph GBlagojevic R(2024)Passive Stylus Tracking: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36981448:ISS(427-461)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698144
He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Greenslade MClark ALukosch S(2024)Becoming Q: Using Design Workshops to Explore Everyday Objects as Interaction Devices for an Augmented Reality Spy GameProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682096(1-11)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682096
Show More Cited By

Index Terms

Turning everyday objects into passive tangible controllers
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Saving and restoring mechanisms for tangible user interfaces through tangible active objects
HCII'11: Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II

In this paper we present a proof of concept for saving and restoring mechanisms for Tangible User Interfaces (TUIs). We describe our actuated Tangible Active Objects (TAOs) and explain the design which allows equal user access to a dial-based fully ...
Tangible bots: interaction with active tangibles in tabletop interfaces
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present interaction techniques for tangible tabletop interfaces that use active, motorized tangibles, what we call Tangible Bots. Tangible Bots can reflect changes in the digital model and assist users by haptic feedback, by correcting errors, by ...
Tangible remote controllers for wall-size displays
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We explore the use of customizable tangible remote controllers for interacting with wall-size displays. Such controllers are especially suited to visual exploration tasks where users need to move to see details of complex visualizations. In addition, we ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2021

908 pages

ISBN:9781450382137

DOI:10.1145/3430524

Editor:
Raphael Wimmer
University of Regensburg, Germany
,
General Chairs:
Martin Kaltenbrunner
University of Art and Design Linz, Austria
,
Martin Murer
University of Salzburg, Austria
,
Program Chairs:
Katrin Wolf
Beuth University of Applied Sciences, Berlin, Germany
,
Ian Oakley
UNIST, Ulsan, Republic of Korea

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 February 2021

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

TEI '21

TEI '21: Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 14 - 17, 2021

Salzburg, Austria

Acceptance Rates

TEI '21 Paper Acceptance Rate 40 of 136 submissions, 29%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
812
Total Downloads

Downloads (Last 12 months)174
Downloads (Last 6 weeks)18

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Burnah TImtiaz MGuesgen HRudolph GBlagojevic R(2024)Passive Stylus Tracking: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36981448:ISS(427-461)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698144
He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Greenslade MClark ALukosch S(2024)Becoming Q: Using Design Workshops to Explore Everyday Objects as Interaction Devices for an Augmented Reality Spy GameProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682096(1-11)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682096
Ashraf MMarzouk MAmgad NAtia A(2024)Beyond Touch: A Comparative Study of Gesture and Tangible Interactions for Smart Tables Using Multi-Source Data2024 Intelligent Methods, Systems, and Applications (IMSA)10.1109/IMSA61967.2024.10652694(410-415)Online publication date: 13-Jul-2024
https://doi.org/10.1109/IMSA61967.2024.10652694
Jain RShi JDuan RZhu ZQian XRamani K(2023)Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented RealityProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606793(1-18)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606793
Chen MLiang SSmith G(2023)Stackable Music: A Marker-Based Augmented Reality Music Synthesis GameCompanion Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3573382.3616071(22-28)Online publication date: 6-Oct-2023
https://dl.acm.org/doi/10.1145/3573382.3616071
Gong WSantosa SGrossman TGlueck MClarke DLai F(2023)Affordance-Based and User-Defined Gestures for Spatial Tangible InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596032(1500-1514)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596032
Schön DKosch TMüller FSchmitz MGünther SBommhardt LMühlhäuser M(2023)Tailor Twist: Assessing Rotational Mid-Air Interactions for Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581461(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581461
Iok Fong CCardoso JEstadieu G(2022)Design Explorations for 3D-Printed Modular Markers for eXtended-Reality Tangible User InterfacesInternational Journal of Creative Interfaces and Computer Graphics10.4018/IJCICG.31142613:1(1-15)Online publication date: 14-Oct-2022
https://dl.acm.org/doi/10.4018/IJCICG.311426
Schulz AHornecker E(2022)Can you please cover both the "smart" and the "home"? Exploring expectations on smart homes considering changing needsProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568447(128-137)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568447
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents