Work in Progress

Flyables: Exploring 3D Interaction Spaces for Levitating Tangibles

Authors:

Pascal Knierim,

Alexander Achberger,

Markus FunkAuthors Info & Claims

TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 329 - 336

https://doi.org/10.1145/3173225.3173273

Published: 18 March 2018 Publication History

Abstract

Recent advances in technology and miniaturization allow the building of self-levitating tangible interfaces. This includes flying tangibles, which extend the mid-air interaction space from 2D to 3D. While a number of theoretical concepts about interaction with levitating tangibles were previously investigated by various researchers, a user-centered evaluation of the presented interaction modalities has attracted only minor attention from prior research. We present Flyables, a system adjusting flying tangibles in 3D space to enable interaction between users and levitating tangibles. Interaction concepts were evaluated in a user study(N=17), using quadcopters as operable levitating tangibles. Three different interaction modalities are evaluated to collect quantitative data and qualitative feedback. Our findings show preferred user interaction modalities using Flyables. We conclude our work with a discussion and future research within the domain of human-drone interaction.

Supplementary Material

suppl.mov (wip1042.mp4)

Supplemental video

Download
61.26 MB

References

[1]

Muhammad Abdullah, Minji Kim, Waseem Hassan, Yoshihiro Kuroda, and Seokhee Jeon. 2017. HapticDrone: An Encountered-Type Kinesthetic Haptic Interface with Controllable Force Feedback: Initial Example for 1D Haptic Feedback. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 115--117.

Digital Library

[2]

Parastoo Abtahi, David Y. Zhao, L. E. Jane, and James A. Landay. 2017. Drone Near Me: Exploring Touch-Based Human-Drone Interaction. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 34 (Sept. 2017), 8 pages.

Digital Library

[3]

Mauro Avila, Markus Funk, and Niels Henze. 2015. DroneNavigator: Using Drones for Navigating Visually Impaired Persons. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '15). ACM, New York, NY, USA, 327--328. Mauro Avila, Markus Funk, Matthias Hoppe, Robin Boldt, Katrin Wolf, and Niels Henze. 2017. DroneNavigator: Using Leashed and Free-Floating Quadcopters to Navigate Visually Impaired Travelers. In Proceedings of the 19th international ACM SIGACCESS conference on Computers & Accessibility. ACM, New York, NY, USA.

Digital Library

[4]

Jessica R Cauchard, Jane L E, Kevin Y Zhai, and James A Landay. 2015. Drone & me: an exploration into natural human-drone interaction. ACM, New York, New York, USA.

Digital Library

[5]

S Follmer, D Leithinger, A Olwal, A Hogge, and H Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation. UIST

Digital Library

[6]

(2013), 417--426. https://pdfs.semanticscholar.org/724e/c59ad61124d1561f5b2a3edb917b1f9c9f22.pdf

[7]

Antonio Gomes, Calvin Rubens, Sean Braley, and Roel Vertegaal. 2016. BitDrones: Towards Using 3D Nanocopter Displays as Interactive Self-Levitating Programmable Matter. ACM, New York, New York, USA.

Digital Library

[8]

David Holman and Roel Vertegaal. 2008. Organic user interfaces: designing computers in any way, shape, or form. Commun. ACM 51, 6 (June 2008), 48--55.

Digital Library

[9]

Hiroshi Ishii. 2008. Tangible bits: beyond pixels. ACM, New York, New York, USA.

Digital Library

[10]

Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. interactions 19, 1 (Jan. 2012), 38--51. 11. Sergi Jordà, Günter Geiger, Marcos Alonso, and Martin

Digital Library

[11]

Kaltenbrunner. 2007. The reacTable. In the 1st international conference. ACM Press, New York, New York, USA, 139--146.

[12]

Pascal Knierim, Thomas Kosch, Valentin Schwind, Markus Funk, Francisco Kiss, Stefan Schneegass, and Niels Henze. 2017. Tactile Drones -- Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA.

Digital Library

[13]

Diana Nowacka, Karim Ladha, Nils Y Hammerla, Daniel Jackson, Cassim Ladha, Enrico Rukzio, and Patrick Olivier. 2013. Touchbugs: actuated tangibles on multi-touch tables. ACM.

Digital Library

[14]

Kevin Pfeil, Seng Lee Koh, and Joseph LaViola. 2013. Exploring 3d gesture metaphors for interaction with unmanned aerial vehicles. ACM, New York, New York, USA.

Digital Library

[15]

Toshiya Yui and Tomoko Hashida. 2016. floatio: Floating Tangible User Interface Based on Animacy Perception. ACM, New York, New York, USA.

Digital Library

Cited By

Samaddar SPetrie H(2024)GUFO: Three studies in the initial development of an assistive drone for older people living independentlyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685409(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685409
Wilson-Small NGoedicke DPetersen KAzenkot SCastellano GRiek LCakmak MLeite I(2023)A Drone TeacherProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576985(311-320)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576985
Marichal SEzcurdia IMorales ROrtiz AMarzo AArdaiz O(2023)Hand-as-a-prop: using the hand as a haptic proxy for manipulation in virtual realityVirtual Reality10.1007/s10055-023-00846-427:4(2911-2925)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10055-023-00846-4
Show More Cited By

Index Terms

Flyables: Exploring 3D Interaction Spaces for Levitating Tangibles
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction techniques

Recommendations

Drone Near Me: Exploring Touch-Based Human-Drone Interaction

Personal drones are becoming more mainstream and are used for a variety of tasks, such as delivery and photography. The exposed blades in conventional drones raise serious safety concerns. To address this, commercial drones have been moving towards a ...
Drone & Wo: Cultural Influences on Human-Drone Interaction Techniques
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

As drones become ubiquitous, it is important to understand how cultural differences impact human-drone interaction. A previous elicitation study performed in the USA illustrated how users would intuitively interact with drones. We replicated this study ...
To touch or not to touch?: comparing 2D touch and 3D mid-air interaction on stereoscopic tabletop surfaces
SUI '13: Proceedings of the 1st symposium on Spatial user interaction

Recent developments in touch and display technologies have laid the groundwork to combine touch-sensitive display systems with stereoscopic three-dimensional (3D) display. Although this combination provides a compelling user experience, interaction with ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

March 2018

763 pages

ISBN:9781450355681

DOI:10.1145/3173225

General Chairs:
Ylva Fernaeus
KTH Royal Institute of Technology, Sweden
,
Donald McMillan
Stockholm University, Sweden
,
Martin Jonsson
Södertörn University, Sweden
,
Program Chairs:
Audrey Girouard
Carleton University, Canada
,
Jakob Tholander
Stockholm University, Sweden

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2018

Check for updates

Author Tags

Qualifiers

Work in progress

Funding Sources

German Federal Ministry of Education and Research

Conference

TEI '18

Sponsor:

SIGCHI

TEI '18: Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

March 18 - 21, 2018

Stockholm, Sweden

Acceptance Rates

TEI '18 Paper Acceptance Rate 37 of 130 submissions, 28%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
604
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)8

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Samaddar SPetrie H(2024)GUFO: Three studies in the initial development of an assistive drone for older people living independentlyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685409(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685409
Wilson-Small NGoedicke DPetersen KAzenkot SCastellano GRiek LCakmak MLeite I(2023)A Drone TeacherProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576985(311-320)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576985
Marichal SEzcurdia IMorales ROrtiz AMarzo AArdaiz O(2023)Hand-as-a-prop: using the hand as a haptic proxy for manipulation in virtual realityVirtual Reality10.1007/s10055-023-00846-427:4(2911-2925)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10055-023-00846-4
Auda JVerheyen NMayer SSchneegass S(2021)Flyables: Haptic Input Devices for Virtual Reality using QuadcoptersProceedings of the 27th ACM Symposium on Virtual Reality Software and Technology10.1145/3489849.3489855(1-11)Online publication date: 8-Dec-2021
https://dl.acm.org/doi/10.1145/3489849.3489855
Furumoto TKasai TFujiwara MMakino YShinoda H(2021)Midair Balloon Interface: A Soft and Lightweight Midair Object for Proximate InteractionsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474786(783-795)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474786
Huppert FHoelzl GKranz MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)GuideCopter - A Precise Drone-Based Haptic Guidance Interface for Blind or Visually Impaired PeopleProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445676(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445676
Mercado VMarchal MLecuyer A(2021)ENTROPiA: Towards Infinite Surface Haptic Displays in Virtual Reality Using Encountered-Type Rotating PropsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.296319027:3(2237-2243)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TVCG.2019.2963190
Mercado VMarchal MLecuyer A(2021)“Haptics On-Demand”: A Survey on Encountered-Type Haptic DisplaysIEEE Transactions on Haptics10.1109/TOH.2021.306115014:3(449-464)Online publication date: 1-Jul-2021
https://doi.org/10.1109/TOH.2021.3061150
Karmanova ESerpiva VPerminov SFedoseev ATsetserukou D(2021)SwarmPlay: Interactive Tic-tac-toe Board Game with Swarm of Nano-UAVs driven by Reinforcement Learning2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN)10.1109/RO-MAN50785.2021.9515355(1269-1274)Online publication date: 8-Aug-2021
https://doi.org/10.1109/RO-MAN50785.2021.9515355
Obaid MJohal WMubin OObaid MMubin ONagai YOsawa HAbdelrahman YFjeld M(2020)Domestic DronesProceedings of the 8th International Conference on Human-Agent Interaction10.1145/3406499.3415076(196-203)Online publication date: 10-Nov-2020
https://dl.acm.org/doi/10.1145/3406499.3415076
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents