research-article

PocketMenu: non-visual menus for touch screen devices

Authors:

Susanne BollAuthors Info & Claims

MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services

Pages 327 - 330

https://doi.org/10.1145/2371574.2371624

Published: 21 September 2012 Publication History

Get Access

Abstract

We present PocketMenu, a menu optimized for non-visual, in-pocket interaction with menus on handheld devices with touch screens. By laying out menu items along the border of the touch screen its tactile features guide the interaction. Additional vibro-tactile feedback and speech allows identifying the individual menu items non-visually. In an experiment, we compared PocketMenu with iPhone's VoiceOver. Participants had to control an MP3 player while walking down a road with the device in the pocket. The results provide evidence that in the above context the PocketMenu outperforms VoiceOver in terms of completion time, selection errors, usability. Hence, it enables usage of touch screen apps in mobile contexts (e.g. walking, hiking, or skiing) and limited interaction spaces (e.g. device resting in a pocket).

Supplementary Material

suppl.mov (fp0191-file3.m4v)

Supplemental video

Download
16.01 MB

References

[1]

Bonner, M. N., Brudvik, J. T., Abowd, G. D., and Edwards, W. K. No-look notes: Accessible eyes-free multi-touch text entry. In Pervasive (2010).

Digital Library

Google Scholar

[2]

Callahan, J., Hopkins, D., Weiser, M., and Shneiderman, B. An empirical comparison of pie vs. linear menus. In Proc. CHI (1988).

Digital Library

Google Scholar

[3]

Ecker, R., Broy, V., Butz, A., and De Luca, A. pietouch: a direct touch gesture interface for interacting with in-vehicle information systems. In Proc. MobileHCI (2009).

Digital Library

Google Scholar

[4]

Froehlich, J., Wobbrock, J. O., and Kane, S. K. Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens. In Proc. ASSETS (2007).

Digital Library

Google Scholar

[5]

Hall, M., Hoggan, E., and Brewster, S. T-bars: towards tactile user interfaces for mobile touchscreens. In Proc. MobileHCI (2008).

Digital Library

Google Scholar

[6]

Kane, S. K., Bigham, J. P., and Wobbrock, J. O. Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proc. ASSETS (2008).

Digital Library

Google Scholar

[7]

Lederman, S. J., and Klatzky, R. L. Haptic identification of common objects: effects of constraining the manual exploration process. Percept Psychophys. 66, 4 (2004), 618--628.

Crossref

Google Scholar

[8]

McGookin, D., Brewster, S., and Jiang, W. Investigating touchscreen accessibility for people with visual impairments. In Proc. NordiCHI (2008).

Digital Library

Google Scholar

[9]

Wilson, G., Brewster, S. A., Halvey, M., Crossan, A., and Stewart, C. The effects of walking, feedback and control method on pressure-based interaction. In Proc. MobileHCI (2011).

Digital Library

Google Scholar

[10]

Wobbrock, J. O., Myers, B. A., and Kembel, J. A. Edgewrite: a stylus-based text entry method designed for high accuracy and stability of motion. In Proc. UIST (2003).

Digital Library

Google Scholar

[11]

Yatani, K., and Truong, K. N. Semfeel: a user interface with semantic tactile feedback for mobile touch-screen devices. In Proc. UIST (2009).

Digital Library

Google Scholar

Cited By

View all

Quintal FLima M(2022)HapWheel: In-Car Infotainment System Feedback Using Haptic and Hovering TechniquesIEEE Transactions on Haptics10.1109/TOH.2021.309576315:1(121-130)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TOH.2021.3095763
González-Cañete FLópez-Rodríguez JGaldón PDiaz-Estrella A(2021)Improving the Screen Exploration of Smartphones Using Haptic Icons for Visually Impaired UsersSensors10.3390/s2115502421:15(5024)Online publication date: 24-Jul-2021
https://doi.org/10.3390/s21155024
Hyatt EHarvey MPointon MInnocenti P(2021)Whither wilderness? An investigation of technology use by long‐distance backpackersJournal of the Association for Information Science and Technology10.1002/asi.2443772:6(683-698)Online publication date: 14-May-2021
https://dl.acm.org/doi/10.1002/asi.24437
Show More Cited By

Index Terms

PocketMenu: non-visual menus for touch screen devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

New mobile UI with hand-grip recognition
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

Today, mobile phones are no longer devices supporting only voice communications. Many people use their mobile phones as multimedia players, cameras, messaging systems, etc. Therefore, it is required to design a user interface that improves the usability ...
Memory stones: an intuitive copy-and-paste method between multi-touch computers
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

When we use a combination of personal computing devices, such as mobile phones, tablets, notebooks, and desktop PCs, we often want to transfer information from one device to another.Though a copy-and-paste function on the same computing device is easy ...
Mixed interaction space: designing for camera based interaction with mobile devices
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems

In mobile devices, such as mobile phones and PDAs, an integrated camera can be used to interact with the device in new ways. In this paper we introduce the term mixed interaction space and argue that the possibility of using mixed interaction spaces is ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services

September 2012

468 pages

ISBN:9781450311052

DOI:10.1145/2371574

General Chairs:
Elizabeth Churchill
Designing Associates, USA
,
Sriram Subramanian
University of Bristol, UK
,
Program Chairs:
Patrick Baudisch
Hasso Plattner Institute, Germany
,
Kenton O'Hara
Microsoft Research, Cambridge, UK

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '12

Sponsor:

SIGCHI

MobileHCI '12: 14th International Conference on Human Computer Interaction with Mobile Devices and Services

September 21 - 24, 2012

California, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
487
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Quintal FLima M(2022)HapWheel: In-Car Infotainment System Feedback Using Haptic and Hovering TechniquesIEEE Transactions on Haptics10.1109/TOH.2021.309576315:1(121-130)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TOH.2021.3095763
González-Cañete FLópez-Rodríguez JGaldón PDiaz-Estrella A(2021)Improving the Screen Exploration of Smartphones Using Haptic Icons for Visually Impaired UsersSensors10.3390/s2115502421:15(5024)Online publication date: 24-Jul-2021
https://doi.org/10.3390/s21155024
Hyatt EHarvey MPointon MInnocenti P(2021)Whither wilderness? An investigation of technology use by long‐distance backpackersJournal of the Association for Information Science and Technology10.1002/asi.2443772:6(683-698)Online publication date: 14-May-2021
https://dl.acm.org/doi/10.1002/asi.24437
Akpinar EYeşilada YTemizer S(2020)The Effect of Context on Small Screen and Wearable Device Users’ Performance - A Systematic ReviewACM Computing Surveys10.1145/338637053:3(1-44)Online publication date: 28-May-2020
https://dl.acm.org/doi/10.1145/3386370
Khan TYoon DMcGrenere JBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Designing an Eyes-Reduced Document Skimming App for Situational ImpairmentsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376641(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376641
Pollock JTeather R(2020)CountMarks: Multi-finger Marking Menus for Mobile Interaction with Head-Mounted DisplaysHCI International 2020 - Late Breaking Papers: Multimodality and Intelligence10.1007/978-3-030-60117-1_18(241-260)Online publication date: 17-Oct-2020
https://doi.org/10.1007/978-3-030-60117-1_18
Fajardo-Flores SGaytán-Lugo LVillagrana-Larios GSantana-Mancilla PSantana-Mancilla PValderrama E(2019)Electronic bracelet to facilitate navigation in smartphones to people with motor and visual impairmentProceedings of the IX Latin American Conference on Human Computer Interaction10.1145/3358961.3358973(1-4)Online publication date: 30-Sep-2019
https://dl.acm.org/doi/10.1145/3358961.3358973
Groeger DFeick MWithana ASteimle JGuimbretière FBernstein MReinecke K(2019)TactletsProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347937(923-936)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347937
Vanderdonckt JBouzit SCalvary GChêne D(2019)Exploring a Design Space of Graphical Adaptive MenusACM Transactions on Interactive Intelligent Systems10.1145/323719010:1(1-40)Online publication date: 29-Jul-2019
https://dl.acm.org/doi/10.1145/3237190
Maiero JEibich DKruijff EHinkenjann AStuerzlinger WBenko HGhinea G(2019)Back-of-Device Force Feedback Improves Touchscreen Interaction for Mobile DevicesIEEE Transactions on Haptics10.1109/TOH.2019.291151912:4(483-496)Online publication date: 1-Oct-2019
https://doi.org/10.1109/TOH.2019.2911519
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

New mobile UI with hand-grip recognition

Memory stones: an intuitive copy-and-paste method between multi-touch computers

Mixed interaction space: designing for camera based interaction with mobile devices