research-article

Bicycles and Wheelchairs for Locomotion Control of a Simulated Telerobot Supported by Gaze- and Head-Interaction

Authors:

Katsumi Minakata,

Martin Thomsen,

John Paulin HansenAuthors Info & Claims

PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference

Pages 371 - 378

https://doi.org/10.1145/3197768.3201573

Published: 26 June 2018 Publication History

Abstract

We present an interface for control of a telerobot that supports field-of-view panning, mode selections and keyboard typing by head- and gaze-interaction. The utility of the interface was tested by 19 able-bodied participants controlling a virtual telerobot from a wheelchair mounted on rollers which measure its wheel rotations, and by 14 able-bodied participants controlling the telerobot with a exercise bike. Both groups tried the interface twice: with head- and with gaze-interaction. Comparing wheelchair and bike locomotion control, the wheelchair simulator was faster and more manoeuvrable. Comparing gaze- and head-interaction, the two input methods were preferred by an equal number of participants. However, participants made more errors typing with gaze than with head. We conclude that virtual reality is a viable way of specifying and testing interfaces for telerobots and an effective probe for eliciting peoples subjective experiences.

References

[1]

Jacopo Aleotti, Giorgio Micconi, Stefano Caselli, Giacomo Benassi, Nicola Zambelli, Manuele Bettelli, and Andrea Zappettini. 2017. Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface. Sensors 17, 10 (2017), 2234.

[2]

Marion Buchenau and Jane Fulton Suri. 2000. Experience prototyping. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques. ACM, 424--433.

Digital Library

[3]

F. T. Durso and T. R. Hackworth. 1995. Expertise and chess: a pilot study comparing situation awareness methodologies. In Experimental Analysis and Measurement of Situation Awareness, D. J. Garland and M. R. Endsley (Eds.). Embry-Riddle Aeronautical Press, Daytona Beach, FL, U.S.A., 295--303.

[4]

Mica R. Endsley. 2000. Direct measurement of situation awareness: validity and use of SAGAT Development of Queries. Lawrence Erlbaum Associates Publishers, Mahwah, NJ, US. 147--173 pages.

[5]

Yiannis Gatsoulis. 2007. Performance metrices for improving human-robot interaction. Advances in Climbing and Walking Robots, Proceedings (2007), 716--725.

[6]

Y. Gatsoulis, A.A. Dehghani, and G.S. Virk. 2008. The influence of human factors on task performance: A linear approach. Advances in Mobile Robotics-Proceedings of the 11th International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines, Clawar 2008 (2008), 481--488.

[7]

Michael S. A. Graziano and Charles G. Gross. 1998a. Visual responses with and without fixation: Neurons in premotor cortex encode spatial locations independently of eye position. Experimental Brain Research 118, 3 (1998a), 373--380.

[8]

John Paulin Hansen, Alexandre Alapetite, I. Scott MacKenzie, and Emilie Møllenbach. 2014. The Use of Gaze to Control Drones. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 27--34.

Digital Library

[9]

John Paulin Hansen, Anders Sewerin Johansen, Dan Witzner Hansen, Kenji Itoh, and Satoru Mashino. 2003. Command without a click: Dwell time typing by mouse and gaze selections. In Proceedings of Human-Computer Interaction-INTERACT. 121--128.

[10]

P. A. Howarth and P. J. Costello. 1996. The nauseogenicity of using a head mounted display, configured as a personal viewing system, for an hour. In Proceedings of the Second FIVE International Conference.

[11]

P. A. Howarth and M. Finch. 1999. The nauseogenicity of two methods of navigating within a virtual environment. Applied Ergonomics 30 (1999), 39--45.

[12]

Joung-Huem Kwon, Yong-Ho Lee, Young-Uk Kim, Eun-Seok Choi, Hyuk-Min Kwon, Gyeong-Soo Noh, Eun-Mi Lee, Sang-Hun Nam, Joong-Jae Lee, and Bum-Jae You. 2016. Be Closer As You Being There: HMD-based Social Interaction System. In SIGGRAPH ASIA 2016 VR Showcase (SA '16). ACM, New York, NY, USA, Article 2, 2 pages.

Digital Library

[13]

Hemin Omer Latif, Nasser Sherkat, and Ahmad Lotfi. 2009. Teleoperation through eye gaze (TeleGaze): a multimodal approach. In Robotics and Biomimetics (ROBIO), 2009 IEEE International Conference on. IEEE, 711--716.

Digital Library

[14]

C. Lee, S. Bonebrake, D. A. Bowman, and T. Höllerer. 2010. The role of latency in the validity of AR simulation. In 2010 IEEE Virtual Reality Conference (VR). 11--18.

Digital Library

[15]

Veronica Ahumada Newhart and Judith S. Olson. 2017. My Student is a Robot: How Schools Manage Telepresence Experiences for Students. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 342--347.

Digital Library

[16]

D. P. Noonan, G. P. Mylonas, A. Darzi, and Guang-Zhong Yang. 2008. Gaze contingent articulated robot control for robot assisted minimally invasive surgery. IEEE, 1186--1191.

[17]

Fred H. Previc. 1990. Functional specialization in the lower and upper visual fields in humans: Its ecological origins and neurophysiological implications. Behavioral and Brain Sciences 13, 3 (1990), 519--542.

[18]

Yuan Yuan Qian and Robert J Teather. 2017. The eyes don't have it: an empirical comparison of head-based and eye-based selection in virtual reality. In Proceedings of the 5th Symposium on Spatial User Interaction. ACM, 91--98.

Digital Library

[19]

E. Ragan, C. Wilkes, D. A. Bowman, and T. Hollerer. 2009. Simulation of Augmented Reality Systems in Purely Virtual Environments. In 2009 IEEE Virtual Reality Conference. 287--288.

Digital Library

[20]

Thomas B. Sheridan. 1992. Musings on Telepresence and Virtual Presence. Presence: Teleoperators and Virtual Environments 1, 1 (1992), 120--126.

[21]

Lars Yndal Sørensen and John Paulin Hansen. 2017. A Low-cost Virtual Reality Wheelchair Simulator. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '17). ACM, New York, NY, USA, 242--243.

Digital Library

[22]

Sophie Stellmach and Raimund Dachselt. 2012. Look & touch: gaze-supported target acquisition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Austin, Texas, USA, 2981--2990.

Digital Library

[23]

Martin Tall, Alexandre Alapetite, Javier San Agustin, Henrik H T Skovsgaard, John Paulin Hansen, Dan Witzner Hansen, and Emilie Møllenbach. 2009. Gaze-controlled driving. In {CHI}'09 Extended Abstracts on Human Factors in Computing Systems. ACM, 4387--4392. http://dl.acm.org/citation.cfm?id=1520671

Digital Library

[24]

Vildan Tanriverdi and Robert J K Jacob. 2000. Interacting with eye movements in virtual environments. In Proceedings of the {SIGCHI} conference on Human Factors in Computing Systems. ACM, 265--272. http://dl.acm.org/citation.cfm?id=332443

Digital Library

[25]

Rayi Yanu Tara and Wei-Chung Teng. 2017. Improving the visual momentum of tethered viewpoint displays using spatial cue augmentation. Intelligent Service Robotics 10, 4 (2017), 313--322.

Digital Library

[26]

R. M. Taylor. 1990. Development of the Situational Awareness Rating Technique (SART) as a tool for aircrew systems design. In AGARD Conference Proceedings No 478. Seuilly-sur Seine: NATO AGARD, Copenhagen, DK.

[27]

Jan B. F. Van Erp, Maaike Duistermaat, Chris Jansen, Eric Groen, and Marieka Hoedemaeker. 2006. Tele-Presence: Bringing the Operator Back in the Loop. Virtual Media for Military Applications (2006), 9-1-9-18.

[28]

A. M. Wafaa, N. D. Bonnefoy, E. Dubois, P. Torguet, and J. P. Jessel. 2008. Virtual Reality Simulation for Prototyping Augmented Reality. In 2008 International Symposium on Ubiquitous Virtual Reality. 55--58.

Digital Library

[29]

Jingxin Zhang, Eike Langbehn, Dennis Krupke, Nicholas Katzakis, and Frank Steinicke. 2018. Detection Thresholds for Rotation and Translation Gains in 360° Video-Based Telepresence Systems. IEEE Transactions on Visualization and Computer Graphics 24, 4 (2018), 1671--1680.

Digital Library

[30]

Dingyun Zhu, Tom Gedeon, and Ken Taylor. 2010. Head or Gaze?: Controlling Remote Camera for Hands-busy Tasks in Teleoperation: A Comparison. In Proceedings of the 22Nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction (OZCHI '10). ACM, New York, NY, USA, 300--303.

Digital Library

Cited By

Sarsenbayeva ZVan Berkel NVelloso EGoncalves JKostakos V(2022)Methodological Standards in Accessibility Research-PLXBCCR- on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 11-Jun-2022
https://dl.acm.org/doi/10.1145/3543509
Hansen JTrudslev AHarild SAlapetite AMinakata KBrewster SFitzpatrick GCox AKostakos V(2019)Providing Access to VR Through a WheelchairExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3299048(1-8)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290607.3299048
Hansen JAlapetite AThomsen MWang ZMinakata KZhang GSharif BKrejtz K(2018)Head and gaze control of a telepresence robot with an HMDProceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications10.1145/3204493.3208330(1-3)Online publication date: 14-Jun-2018
https://dl.acm.org/doi/10.1145/3204493.3208330

Index Terms

Bicycles and Wheelchairs for Locomotion Control of a Simulated Telerobot Supported by Gaze- and Head-Interaction
1. Human-centered computing
  1. Accessibility
    1. Accessibility technologies

Recommendations

Hand- and gaze-control of telepresence robots
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Mobile robotic telepresence systems are increasingly used to promote social interaction between geographically dispersed people. People with severe motor disabilities may use eye-gaze to control a telepresence robots. However, use of gaze control for ...
Head and gaze control of a telepresence robot with an HMD
ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Gaze interaction with telerobots is a new opportunity for wheelchair users with severe motor disabilities. We present a video showing how head-mounted displays (HMD) with gaze tracking can be used to monitor a robot that carries a 360° video camera and ...
Exploring Eye-Gaze Wheelchair Control
ETRA '20 Adjunct: ACM Symposium on Eye Tracking Research and Applications

Eye-gaze may potentially be used for steering wheelchairs or robots and thereby support independence in choosing where to move. This paper investigates the feasibility of gaze-controlled interfaces. We present an experiment with wheelchair control in a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference

June 2018

591 pages

ISBN:9781450363907

DOI:10.1145/3197768

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

NSF: National Science Foundation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

PETRA '18

PETRA '18: The 11th PErvasive Technologies Related to Assistive Environments Conference

June 26 - 29, 2018

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
210
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)1

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sarsenbayeva ZVan Berkel NVelloso EGoncalves JKostakos V(2022)Methodological Standards in Accessibility Research-PLXBCCR- on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 11-Jun-2022
https://dl.acm.org/doi/10.1145/3543509
Hansen JTrudslev AHarild SAlapetite AMinakata KBrewster SFitzpatrick GCox AKostakos V(2019)Providing Access to VR Through a WheelchairExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3299048(1-8)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290607.3299048
Hansen JAlapetite AThomsen MWang ZMinakata KZhang GSharif BKrejtz K(2018)Head and gaze control of a telepresence robot with an HMDProceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications10.1145/3204493.3208330(1-3)Online publication date: 14-Jun-2018
https://dl.acm.org/doi/10.1145/3204493.3208330

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents