research-article

Tactile Compass: Enabling Visually Impaired People to Follow a Path with Continuous Directional Feedback

Authors:

Yuanchun ShiAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 28, Pages 1 - 13

https://doi.org/10.1145/3411764.3445644

Published: 07 May 2021 Publication History

Abstract

Accurate and effective directional feedback is crucial for an electronic traveling aid device that guides visually impaired people in walking through paths. This paper presents Tactile Compass, a hand-held device that provides continuous directional feedback with a rotatable needle pointing toward the planned direction. We conducted two lab studies to evaluate the effectiveness of the feedback solution. Results showed that, using Tactile Compass, participants could reach the target direction in place with a mean deviation of 3.03° and could smoothly navigate along paths of 60cm width, with a mean deviation from the centerline of 12.1cm. Subjective feedback showed that Tactile Compass was easy to learn and use.

Supplementary Material

MP4 File (3411764.3445644_videofigure.mp4)

Supplemental video

Download
107.81 MB

References

[1]

Dragan Ahmetovic, Cole Gleason, Chengxiong Ruan, Kris Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: a navigational cognitive assistant for the blind. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services. 90–99.

Digital Library

[2]

Tomohiro Amemiya. 2009. Haptic Direction Indicator for Visually Impaired People Based on Pseudo-Attraction Force. e-Minds 1(2009).

[3]

Tomohiro Amemiya and Hisashi Sugiyama. 2008. Design of a Haptic Direction Indicator for Visually Impaired People in Emergency Situations. (2008), 1141–1144.

[4]

T. Ando, R. Tsukahara, M. Seki, and M. G. Fujie. 2012. A Haptic Interface “Force Blinker 2” for Navigation of the Visually Impaired. IEEE Transactions on Industrial Electronics 59, 11 (Nov 2012), 4112–4119. https://doi.org/10.1109/TIE.2011.2173894

[5]

Michele Antolini, Monica Bordegoni, and Umberto Cugini. 2011. A haptic direction indicator using the gyro effect. 2011 IEEE World Haptics Conference(2011), 251–256.

[6]

Shiri Azenkot, Richard E. Ladner, and Jacob O. Wobbrock. 2011. Smartphone Haptic Feedback for Nonvisual Wayfinding. In The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility(Dundee, Scotland, UK) (ASSETS ’11). Association for Computing Machinery, New York, NY, USA, 281–282. https://doi.org/10.1145/2049536.2049607

Digital Library

[7]

Jeffrey R. Blum, Mathieu Bouchard, and Jeremy R. Cooperstock. 2011. What’s around Me? Spatialized Audio Augmented Reality for Blind Users with a Smartphone. (2011).

[8]

M Bouzit, A Chaibi, KJ De Laurentis, and C Mavroidis. 2004. Tactile feedback navigation handle for the visually impaired. In ASME 2004 International Mechanical Engineering Congress and Exposition. American Society of Mechanical Engineers Digital Collection, 1171–1177.

[9]

Carlos Campos, Richard Elvira, Juan J Gómez Rodríguez, José MM Montiel, and Juan D Tardós. 2020. ORB-SLAM3: An accurate open-source library for visual, visual-inertial and multi-map SLAM. arXiv preprint arXiv:2007.11898(2020).

[10]

A. Cassinelli, C. Reynolds, and M. Ishikawa. 2006. Augmenting spatial awareness with Haptic Radar. In 2006 10th IEEE International Symposium on Wearable Computers. 61–64. https://doi.org/10.1109/ISWC.2006.286344

[11]

Jan BF Van Erp, Hendrik AHC Van Veen, Chris Jansen, and Trevor Dobbins. 2005. Waypoint navigation with a vibrotactile waist belt. ACM Transactions on Applied Perception (TAP) 2, 2 (2005), 106–117.

Digital Library

[12]

Hugo Fernandes, Paulo Costa, Vitor Filipe, Hugo Paredes, and João Barroso. 2019. A Review of Assistive Spatial Orientation and Navigation Technologies for the Visually Impaired. Univers. Access Inf. Soc. 18, 1 (March 2019), 155–168. https://doi.org/10.1007/s10209-017-0570-8

Digital Library

[13]

Alexander Fiannaca, Ilias Apostolopoulous, and Eelke Folmer. 2014. Headlock: a wearable navigation aid that helps blind cane users traverse large open spaces. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility. 19–26.

Digital Library

[14]

G. Flores, S. Kurniawan, R. Manduchi, E. Martinson, L. M. Morales, and E. A. Sisbot. 2015. Vibrotactile Guidance for Wayfinding of Blind Walkers. IEEE Transactions on Haptics 8, 3 (2015), 306–317.

Digital Library

[15]

João Guerreiro, Dragan Ahmetovic, Daisuke Sato, Kris Kitani, and Chieko Asakawa. 2019. Airport accessibility and navigation assistance for people with visual impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[16]

João Guerreiro, Daisuke Sato, Saki Asakawa, Huixu Dong, Kris M Kitani, and Chieko Asakawa. 2019. CaBot: Designing and Evaluating an Autonomous Navigation Robot for Blind People. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. 68–82.

Digital Library

[17]

Wilko Heuten, Niels Henze, Susanne Boll, and Martin Pielot. 2008. Tactile Wayfinder: A Non-Visual Support System for Wayfinding. In Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges (Lund, Sweden) (NordiCHI ’08). Association for Computing Machinery, New York, NY, USA, 172–181. https://doi.org/10.1145/1463160.1463179

Digital Library

[18]

Slim Kammoun, Wahiba Bouhani, and Mohamed Jemni. 2015. Sole Based Tactile Information Display for Visually Impaired Pedestrian Navigation. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (Corfu, Greece) (PETRA ’15). Association for Computing Machinery, New York, NY, USA, Article 31, 4 pages. https://doi.org/10.1145/2769493.2769561

Digital Library

[19]

Slim Kammoun, Christophe Jouffrais, Tiago Guerreiro, Hugo Nicolau, and Joaquim Jorge. 2012. Guiding blind people with haptic feedback. Frontiers in Accessibility for Pervasive Computing (Pervasive 2012) 3 (2012).

[20]

Brian F. G. Katz, Slim Kammoun, Gatan Parseihian, Olivier Gutierrez, Adrien Brilhault, Malika Auvray, Philippe Truillet, Michel Denis, Simon Thorpe, and Christophe Jouffrais. 2012. NAVIG: augmented reality guidance system for the visually impaired. Virtual Reality 16, 4 (2012), 253–269.

Digital Library

[21]

L. Kay. 1974. A sonar aid to enhance spatial perception of the blind: engineering design and evaluation. Radio & Electronic Engineer 44, 11 (1974), 605–627.

[22]

Vladimir Kulyukin, Chaitanya Gharpure, John Nicholson, and Sachin Pavithran. 2004. RFID in robot-assisted indoor navigation for the visually impaired. In 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566), Vol. 2. IEEE, 1979–1984.

[23]

Peng Li, Cai-yun Yang, Rui Wang, and Shuo Wang. 2020. A high-efficiency, information-based exploration path planning method for active simultaneous localization and mapping. International Journal of Advanced Robotic Systems 17, 1 (2020), 1729881420903207.

[24]

Ming-Wei Lin, Yun-Maw Cheng, and Wai Yu. 2008. Using Tactons to Provide Navigation Cues in Pedestrian Situations. In Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges (Lund, Sweden) (NordiCHI ’08). Association for Computing Machinery, New York, NY, USA, 507–510. https://doi.org/10.1145/1463160.1463231

Digital Library

[25]

D. Ni, L. Wang, Y. Ding, J. Zhang, A. Song, and J. Wu. 2013. The design and implementation of a walking assistant system with vibrotactile indication and voice prompt for the visually impaired. In 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO). 2721–2726.

[26]

Vanessa Petrausch, Thorsten Schwarz, and Rainer Stiefelhagen. 2018. Prototype Development of a Low-Cost Vibro-Tactile Navigation Aid for the Visually Impaired. (2018), 63–69.

[27]

Martin Pielot, Benjamin Poppinga, Wilko Heuten, and Susanne Boll. 2012. PocketNavigator: studying tactile navigation systems in-situ. (2012), 3131–3140.

[28]

Martin Pielot, Benjamin Poppinga, Wilko Heuten, and Susanne Boll. 2012. PocketNavigator: Studying Tactile Navigation Systems in-Situ. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 3131–3140. https://doi.org/10.1145/2207676.2208728

Digital Library

[29]

Sonja Rümelin, Enrico Rukzio, and Robert Hardy. 2011. NaviRadar: A Novel Tactile Information Display for Pedestrian Navigation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 293–302. https://doi.org/10.1145/2047196.2047234

Digital Library

[30]

Dongseok Ryu, Gi-Hun Yang, and Sungchul Kang. 2012. T-Hive: Bilateral Haptic Interface Using Vibrotactile Cues for Presenting Spatial Information. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 42(2012), 1318–1325.

Digital Library

[31]

Daisuke Sato, Uran Oh, Kakuya Naito, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. NavCog3: An evaluation of a smartphone-based blind indoor navigation assistant with semantic features in a large-scale environment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. 270–279.

Digital Library

[32]

Adam J. Spier and Aaron M. Dollar. 2017. Design and Evaluation of Shape-Changing Haptic Interfaces for Pedestrian Navigation Assistance. IEEE Transactions on Haptics(2017).

[33]

Adam Spiers, Aaron Dollar, Janet Van Der Linden, and Maria Oshodi. 2015. First validation of the haptic sandwich: A shape changing handheld haptic navigation aid. In 2015 International Conference on Advanced Robotics (ICAR). IEEE, 144–151.

[34]

Adam J Spiers and Aaron M Dollar. 2016. Design and evaluation of shape-changing haptic interfaces for pedestrian navigation assistance. IEEE transactions on haptics 10, 1 (2016), 17–28.

[35]

Adam J. Spiers and Aaron M. Dollar. 2016. Outdoor pedestrian navigation assistance with a shape-changing haptic interface and comparison with a vibrotactile device. In 2016 IEEE Haptics Symposium (HAPTICS).

[36]

Adam J. Spiers, Janet Van Der Linden, Maria Oshodi, and Aaron M. Dollar. 2016. Development and Experimental Validation of a Minimalistic Shape Changing Haptic Navigation Device. In 2016 IEEE International Conference on Robotics and Automation (ICRA).

Digital Library

[37]

Adam J. Spiers, Janet van der Linden, Sarah Wiseman, and Maria Oshodi. 2018. Testing a Shape-Changing Haptic Navigation Device With Vision-Impaired and Sighted Audiences in an Immersive Theater Setting. IEEE Transactions on Human-Machine Systems PP, 99 (2018), 1–12.

[38]

Kazuteru Tobita, Katsuyuki Sagayama, and Hironori Ogawa. 2017. Examination of a Guidance Robot for Visually Impaired People. Journal of Robotics and Mechatronics 29, 4 (2017), 720–727.

[39]

Koji Tsukada and Michiaki Yasumura. 2004. ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation. ubiquitous computing(2004), 384–399.

[40]

A. Wachaja, P. Agarwal, M. Zink, M. R. Adame, K. Möller, and W. Burgard. 2015. Navigating blind people with a smart walker. In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 6014–6019.

[41]

Shuchang Xu, Ciyuan Yang, Wenhao Ge, Chun Yu, and Yuanchun Shi. 2020. Virtual Paving: Rendering a Smooth Path for People with Visual Impairment through Vibrotactile and Audio Feedback. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 99 (Sept. 2020), 25 pages. https://doi.org/10.1145/3411814

Digital Library

[42]

Gi-Hun Yang, Dongseok Ryu, and Sungchul Kang. 2009. Vibrotactile display for hand-held input device providing spatial and directional information. World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (2009), 79–84.

Digital Library

[43]

Gi-Hun Yang, Moon sub Jin, Yeonsub Jin, and Sungchul Kang. 2010. T-mobile: Vibrotactile display pad with spatial and directional information for hand-held device. 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (2010), 5245–5250.

[44]

Yuhang Zhao, Cynthia L. Bennett, Hrvoje Benko, Edward Cutrell, Christian Holz, Meredith Ringel Morris, and Mike Sinclair. 2018. Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173690

Digital Library

[45]

Yuhang Zhao, Elizabeth Kupferstein, Hathaitorn Rojnirun, Leah Findlater, and Shiri Azenkot. 2020. The Effectiveness of Visual and Audio Wayfinding Guidance on Smartglasses for People with Low Vision. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376516

Digital Library

Cited By

Zhang XPan ZSong ZZhang YLi WDing S(2024)The Aerial Guide Dog: A Low-Cognitive-Load Indoor Electronic Travel Aid for Visually Impaired IndividualsSensors10.3390/s2401029724:1(297)Online publication date: 4-Jan-2024
https://doi.org/10.3390/s24010297
Elshafei ARomano DFahim I(2024)The Effect of Directional Tactile Memory of the Back of the User on Reaction Time and AccuracyElectronics10.3390/electronics1313248213:13(2482)Online publication date: 25-Jun-2024
https://doi.org/10.3390/electronics13132482
Jing XYu CYue KLu LGao NShi WZhang MWang RShi Y(2024)AngleSizer: Enhancing Spatial Scale Perception for the Visually Impaired with an Interactive Smartphone AssistantProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785258:3(1-31)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678525
Show More Cited By

Index Terms

Tactile Compass: Enabling Visually Impaired People to Follow a Path with Continuous Directional Feedback
1. Social and professional topics
  1. Professional topics

Index terms have been assigned to the content through auto-classification.

Recommendations

Interactive audio-tactile maps for visually impaired people

Visually impaired people face important challenges related to orientation and mobility. Indeed, 56% of visually impaired people in France declared having problems concerning autonomous mobility [10]. These problems often mean that visually impaired ...
What Makes Videos Accessible to Blind and Visually Impaired People?
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

User-generated videos are an increasingly important source of information online, yet most online videos are inaccessible to blind and visually impaired (BVI) people. To find videos that are accessible, or understandable without additional description ...
Game accessibility for visually impaired people: a review
Abstract
Playing games is an important way to promote the integration, inclusion, and socialization of participants. This is especially the case of persons with disabilities, such as visually impaired people. Unfortunately, very few games are accessible to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Key R&D Program of China
National Key Research and Development Plan
Beijing Key Lab of Networked Multimedia, the Institute for Guo Qiang of Tsinghua University, Institute for Artificial Intelligence of Tsinghua University (THUAI), and Beijing Academy of Artificial Intelligence (BAAI).

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
1,121
Total Downloads

Downloads (Last 12 months)194
Downloads (Last 6 weeks)16

Reflects downloads up to 17 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang XPan ZSong ZZhang YLi WDing S(2024)The Aerial Guide Dog: A Low-Cognitive-Load Indoor Electronic Travel Aid for Visually Impaired IndividualsSensors10.3390/s2401029724:1(297)Online publication date: 4-Jan-2024
https://doi.org/10.3390/s24010297
Elshafei ARomano DFahim I(2024)The Effect of Directional Tactile Memory of the Back of the User on Reaction Time and AccuracyElectronics10.3390/electronics1313248213:13(2482)Online publication date: 25-Jun-2024
https://doi.org/10.3390/electronics13132482
Jing XYu CYue KLu LGao NShi WZhang MWang RShi Y(2024)AngleSizer: Enhancing Spatial Scale Perception for the Visually Impaired with an Interactive Smartphone AssistantProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785258:3(1-31)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678525
Kubota MKuribayashi MKayukawa STakagi HAsakawa CMorishima S(2024)Snap&Nav: Smartphone-based Indoor Navigation System For Blind People via Floor Map Analysis and Intersection DetectionProceedings of the ACM on Human-Computer Interaction10.1145/36765228:MHCI(1-22)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676522
Yu TLiu YLiu YLu QHan TMi H(2024)FlexEOP: Flexible Shape-changing Actuator using Embedded Electroosmotic PumpsAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686785(1-5)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686785
Xu SChen CLiu ZJin XYuan LYan YQu H(2024)Memory Reviver: Supporting Photo-Collection Reminiscence for People with Visual Impairment via a Proactive ChatbotProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676336(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676336
Jiang CFan YXie JKuang EZhang KFan M(2024)Designing Unobtrusive Modulated Electrotactile Feedback on Fingertip Edge to Assist Blind and Low Vision (BLV) People in Comprehending ChartsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642546(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642546
Cai SRam AGou ZShaikh MChen YWan YHara KZhao SHsu D(2024)Navigating Real-World Challenges: A Quadruped Robot Guiding System for Visually Impaired People in Diverse EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642227(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642227
Lacôte IPacchierotti CMarie FPasteau FGrzeskowiak FBabel MGueorguiev DMarchal M(2024)Comparing the Haptic Perception of Directional Information Using a Uni-manual or Bi-manual Strategy on a Walker2024 IEEE Haptics Symposium (HAPTICS)10.1109/HAPTICS59260.2024.10520843(98-103)Online publication date: 7-Apr-2024
https://doi.org/10.1109/HAPTICS59260.2024.10520843
Bamdad MScaramuzza DDarvishy A(2024)SLAM for Visually Impaired People: A SurveyIEEE Access10.1109/ACCESS.2024.345457112(130165-130211)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3454571
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents