Article

Auditory and tactile interfaces for representing the visual effects on the web

Authors:

Chieko Asakawa,

Hironobu Takagi,

Tohru IfukubeAuthors Info & Claims

Assets '02: Proceedings of the fifth international ACM conference on Assistive technologies

Pages 65 - 72

https://doi.org/10.1145/638249.638263

Published: 08 July 2002 Publication History

Abstract

In this paper, we describe auditory and tactile interfaces to represent visual effects nonvisually for blind users, allowing intuitive recognition of visual content that appears on the Web. This research examines how visual effects could be recognized by blind subjects using the senses of hearing and touch, aiming at integrating the results into a practical system in the future. As an initial step, two experiments were performed, one for sonification and tactilization of a page overview based on color-based fragmented groupings without speech, and one for sonification and tactilization of emphasized text based on analyzing rich text information with speech. The subjects could recognize visual representations presented by auditory and tactile interfaces throughout the experiment, and were conscious of the importance of the visual structures. We believe this shows our approach may be practical and available in the future.We will summarize our results and discuss what kind of information is suitable for each sense, as well as the next planned experiment and other future work.

References

[1]

Asakawa, C. User Interface of a Home Page Reader, in Proceedings of ASSETS '98 (April 1998), ACM Press, 149--156.

Digital Library

[2]

IBM HomePage Reader, Inc. IBM, http://www-3.ibm.com/able/hprdoc.html

[3]

Freedom Scientific, Inc. Jaws. http://www.freedomsci.com/.

[4]

GW Micro, Inc. Window-Eyes. http://www.gwmicro.com/.

[5]

James, F. AHA: Audio HTML Access. The Sixth International World Wide Web Conference, (Apr. 1997) 129--139.

Digital Library

[6]

Roth, P., Petrucci, L. Auditory browser for blind and visually impaired users, in Proceedings of CHI'99 (May 1999), ACM Press.

Digital Library

[7]

Mynatt, E., Weber, G. Nonvisual Presentation of Graphical User Interfaces: Contrasting Two Approaches, in Proceedings of CHI'94 (May 1994), ACM Press.

Digital Library

[8]

STEPHEN A. BREWSTER Using Nonspeech Sounds to Provide Navigation Cues. ACM Transactions on Computer-Human Interaction, Vol. 5, No. 3 (September 1998), ACM Press.

Digital Library

[9]

Mynatt, E. Mynat Designing with Auditory Icons: How Well Do We Identify Auditory Cues? in Proceedings of CHI'94 (May 1994), ACM Press.

Digital Library

[10]

M. Blattner, D.A. Sumikawa and R.M. Greenberg, "Earcons and icons: Their structure and common design principles," Human-Computer Interaction, Vol.4, No.l, pp.11--44, 1989.

[11]

Asakawa, C, Takagi, H. Annotation-Based Transcoding for Nonvisual Web Access, in Proceedings of ASSETS 2000 (Nov 2000), ACM Press, 172--179.

Digital Library

[12]

Schmidt, F. (eds.). Fundamentals of Sensory Physiology. Springer, New York, 1979.

[13]

Ohyama, T., Imai, S. (eds.). Handbook of Sensory and Cognitive Psychology. Seishinshobo, Tokyo, 1994.

[14]

Ifukube, T. Sound-based Assisitive Technology. Corona Publishing Co, 1997.

[15]

Ifukube, T. A Study of HCI for People in Japan with Communication Disorders, in Proceedings UAHCI2001 (August 2001), Lawrence Erlbaum, 924--928.

Cited By

Kim HChung MKim EYoo Y(2024)Automatic Video-to-Audiotactile Conversion of Golf Broadcasting on A Refreshable Pin ArrayProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682092(1-8)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682092
Ferdous JLee HJayarathna SAshok V(2023)Enabling Efficient Web Data-Record Interaction for People with Visual Impairments via Proxy InterfacesACM Transactions on Interactive Intelligent Systems10.1145/357936413:3(1-27)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.1145/3579364
Kapgate PTidke SFender RRathore SGhodmare SRitla L(2023)Raspberry Pi Based Book Reader For Visual Impaired People2023 11th International Conference on Emerging Trends in Engineering & Technology - Signal and Information Processing (ICETET - SIP)10.1109/ICETET-SIP58143.2023.10151605(1-6)Online publication date: 28-Apr-2023
https://doi.org/10.1109/ICETET-SIP58143.2023.10151605
Show More Cited By

Index Terms

Auditory and tactile interfaces for representing the visual effects on the web
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction techniques
      1. Auditory feedback
2. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Assistive technologies
  2. User characteristics
    1. People with disabilities

Recommendations

A user study of auditory versus visual interfaces for use while driving

This paper describes a user study on interaction with a mobile device installed in a driving simulator. Two new auditory interfaces were proposed and their effectiveness and efficiency were compared to a standard visual interface. Both auditory ...
Lyricon Lyrics + Earcons Improves Identification of Auditory Cues
Proceedings, Part II, of the 4th International Conference on Design, User Experience, and Usability: Users and Interactions - Volume 9187

Auditory researchers have developed various non-speech cues in designing auditory user interfaces. A preliminary study of "lyricons" lyricsï ź+ï źearcons [1] has provided a novel approach to devising auditory cues in electronic products, by combining ...
Overview of auditory representations in human-machine interfaces

In recent years, a large number of research projects have focused on the use of auditory representations in a broadened scope of application scenarios. Results in such projects have shown that auditory elements can effectively complement other ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

Assets '02: Proceedings of the fifth international ACM conference on Assistive technologies

July 2002

238 pages

ISBN:1581134649

DOI:10.1145/638249

Conference Chair:
Vicki L. Hanson
IBM T. J. Watson Research Center
,
Program Chair:
Julie A. Jacko
Georgia Institute of Technology

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 July 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ASSETS02

Sponsor:

SIGACCESS

ASSETS02: The 5th ACM SIGCAPH Conference on Assistive Technologies

July 8 - 10, 2002

Edinburgh, Scotland

Acceptance Rates

Assets '02 Paper Acceptance Rate 31 of 76 submissions, 41%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
1,073
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kim HChung MKim EYoo Y(2024)Automatic Video-to-Audiotactile Conversion of Golf Broadcasting on A Refreshable Pin ArrayProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682092(1-8)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682092
Ferdous JLee HJayarathna SAshok V(2023)Enabling Efficient Web Data-Record Interaction for People with Visual Impairments via Proxy InterfacesACM Transactions on Interactive Intelligent Systems10.1145/357936413:3(1-27)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.1145/3579364
Kapgate PTidke SFender RRathore SGhodmare SRitla L(2023)Raspberry Pi Based Book Reader For Visual Impaired People2023 11th International Conference on Emerging Trends in Engineering & Technology - Signal and Information Processing (ICETET - SIP)10.1109/ICETET-SIP58143.2023.10151605(1-6)Online publication date: 28-Apr-2023
https://doi.org/10.1109/ICETET-SIP58143.2023.10151605
Li ZJiang YLiu XZhao YYu CShi Y(2022)Enhancing Revisitation in Touchscreen Reading for Visually Impaired People with Semantic Navigation DesignProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35502906:3(1-22)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550290
Ferdous JLee HJayarathna SAshok V(2022)InSupport: Proxy Interface for Enabling Efficient Non-Visual Interaction with Web Data RecordsProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511126(49-62)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490099.3511126
مصطفى الخليفة محاج الحسن ع(2021)قياس تجربة المستخدم لمتصفح ويب: مقترح قائم على الإدراك السمعي لذوي الإعاقات البصريةArabian Journal of Scientific Research-المجلة العربية للبحث العلمي10.5339/ajsr.2021.52 (2021):1Online publication date: 10-Jun-2021
https://doi.org/10.5339/ajsr.2021.5
Lieb SRosenmeier BThormählen TBuettner K(2020)Haptic and Auditive Mesh Inspection for Blind 3D ModelersProceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3373625.3417007(1-10)Online publication date: 26-Oct-2020
https://dl.acm.org/doi/10.1145/3373625.3417007
Lee HAshok VSalter ABarber JGadiraju U(2020)Towards Personalized Annotation of Webpages for Efficient Screen-Reader InteractionProceedings of the 31st ACM Conference on Hypertext and Social Media10.1145/3372923.3404815(111-116)Online publication date: 13-Jul-2020
https://dl.acm.org/doi/10.1145/3372923.3404815
Ravi AKhasimbee SAsha TJoshna TJyothirmai P(2020)Raspberry pi based Smart Reader for Blind People2020 International Conference on Electronics and Sustainable Communication Systems (ICESC)10.1109/ICESC48915.2020.9155941(445-450)Online publication date: Jul-2020
https://doi.org/10.1109/ICESC48915.2020.9155941
Borodin ABorodin YSoviak AAshok VDisfani SRamakrishnan I(2019)Feel-ItProceedings of the 16th International Web for All Conference10.1145/3315002.3332441(1-2)Online publication date: 13-May-2019
https://dl.acm.org/doi/10.1145/3315002.3332441
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents