research-article

SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with motion gesture

Authors:

John CannyAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 15 - 24

https://doi.org/10.1145/1753326.1753330

Published: 10 April 2010 Publication History

Abstract

Dictionary-based disambiguation (DBD) is a very popular solution for text entry on mobile phone keypads but suffers from two problems: 1. the resolution of encoding collision (two or more words sharing the same numeric key sequence) and 2. entering out-of-vocabulary (OOV) words. In this paper, we present SHRIMP, a system and method that addresses these two problems by integrating DBD with camera based motion sensing that enables the user to express preference through a tilting or movement gesture. SHRIMP (Small Handheld Rapid Input with Motion and Prediction) runs on camera phones equipped with a standard 12-key keypad. SHRIMP maintains the speed advantage of DBD driven predictive text input while enabling the user to overcome DBD collision and OOV problems seamlessly without even a mode switch. An initial empirical study demonstrates that SHRIMP can be learned very quickly, performed immediately faster than MultiTap and handled OOV words more efficiently than DBD.

References

[1]

Aho, A., Sethi, R., Ullman, J., Compilers: Principles, Techniques, and Tools, Addison Wesley Publishing, ISBN 0201100886.

Digital Library

[2]

Dunlop, M., and Crossan, A. Predictive Text Entry Methods for Mobile Phones. Personal Technologies, 2000.

[3]

Dunlop, M., Taylor, F., Tactile Feedback for Predictive Text Entry, In Proc. of CHI 2009.

Digital Library

[4]

Gong, J., Tarasewich, P., Alphabetically Constrained Keypad Designs for Text Entry on Mobile Devices, In Proc. of CHI 2005.

Digital Library

[5]

Grover, D.L., King, M.T., and Kushler, C. A. Patent No. US5818437, Reduced keyboard Disambiguating Computer. Tegic Communications, Inc., Seattle (1998).

[6]

How, J., Kan, M.Y., Optimizing Predictive text entry for short message service on mobile phones. In Proc. of HCII 2005.

[7]

Ingmarsson, M., Dinka, D., Zhai, S., TNT: a Numeric Keypad based Text Input Method. In Proc of CHI 2004.

Digital Library

[8]

International Telecommunication Union, Arrangement of Digits, Letters and Symbols on Telephones and Other Devices that can be used for gaining access to a Telephone Network, ITU Recommendation E.161. 1993.

[9]

International Telecommunication Union: Worldwide mobile cellular subscribers to reach 4 billion mark late 2008 http://www.itu.int/newsroom/press_releases/2008/29.html

[10]

James, C.L. and Reischel, K.M., Text input for mobile devices: Comparing model prediction to actual performance. In Proc. of CHI 2001.

Digital Library

[11]

Jansen, B., Zhang, M., el al., Twitter power: Tweets as electronic word of mouth, Journal of the American Society for Information Science and Technology, 2009.

Digital Library

[12]

Jelinek, F., Statistical methods for speech recognition, MIT Press, Cambridge, MA, 1998

Digital Library

[13]

Kucera, H. and Francis, W. N. Computational Analysis of Present-Day American English. Providence, Rhode Island: Brown University Press, 1967.

[14]

MacKenzie, I.S., Kober, H., et al., E. LetterWise: Prefix-based disambiguation for mobile text input. In Proc. of UIST 2001

Digital Library

[15]

Mayzner, M.S., and Tresselt, M.E. Table of single-letter and digram frequency counts for various word-length and letter-position combinations, Psychonomic Monograph Supplements 1 (1965), 13--32.

[16]

Rau, H., Skiena, S., Dialing for Documents: an Experiment in Information Theory, UIST 1994.

Digital Library

[17]

Silfverberg, M., MacKenzie, I.S., Korhonen, P. Predicting Text Entry Speed on Mobile Phones, In Proc. of CHI 2000.

Digital Library

[18]

Smith, S., Goodwin, N., Alphabetic Data Entry Via the Touch-Tone Pad: A Comment, HUMAN FACTORS, The Mitre Corporation, 1971, 13(2) P.p 189--190.

[19]

Wigdor, D., Balakrishnan, R., A Comparison of Consecutive and Concurrent Input Text Entry Techniques for Mobile Phones, in Proc. of CHI 2004.

Digital Library

[20]

Wigdor, D., Balakrishnan, R., TiltText: Using Tilt for Text Input to Mobile Phones. In Proc. of UIST 2003.

Digital Library

[21]

Wang, J, Zhai, S., Canny, J., Camera Phone Based Motion Sensing : Interaction Techniques, Applications and Performance Study. In Proc. of UIST 2006.

Digital Library

[22]

Why Book Means Cool http://www.languagehat.com/archives/002415.php

[23]

Wobbrock, J.O. and Myers, B.A. Analyzing the input stream for Character-level Errors in Unconstrained Text Entry Evaluations. In Proc of ACM ToCHI vol. 13 (4), 2006.

Digital Library

[24]

Wobbrock, J.O., Myers, B.A. and Chau, D.H. In-stroke Word Completion. In Proc. of UIST 2006.

Digital Library

[25]

Wobbrock, J.O., Chau, D.H. and Myers, B.A. An Alternative to Push, Press, and Tap-tap-tap: Gesturing on an Isometric Joystick for Mobile Phone Text Entry. In Proc. of CHI 2007.

Digital Library

[26]

Zhai, S., Hunter, M., Smith, B., The Metropolis Keyboard -- an Exploration of Quantitative Techniques for Virtual Keyboard Design, In Proc. of UIST 2001.

Digital Library

[27]

Zhai, S. and Kristensson, P. Shorthand Writing on Stylus Keyboard. In Proc. of CHI 2003.

Digital Library

Cited By

Shah BAbhyankar M(2024)Touchtalk: Enhancing Messaging in Smartphones for Visually ImpairedProceedings of the 14th Indian Conference on Human-Computer Interaction10.1007/978-981-97-4335-3_7(133-148)Online publication date: 3-Aug-2024
https://doi.org/10.1007/978-981-97-4335-3_7
Wang GRen GHong XPeng XLi WO’Neill E(2022)Freehand Gestural Selection with Haptic Feedback in Wearable Optical See-Through Augmented RealityInformation10.3390/info1312056613:12(566)Online publication date: 2-Dec-2022
https://doi.org/10.3390/info13120566
Lockerman EWu SRao ALin JBantoc NMyers B(2017)Text entry using five to seven physical keys2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VLHCC.2017.8103481(291-295)Online publication date: Oct-2017
https://doi.org/10.1109/VLHCC.2017.8103481
Show More Cited By

Index Terms

SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with motion gesture
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

An alternative to push, press, and tap-tap-tap: gesturing on an isometric joystick for mobile phone text entry
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

A gestural text entry method for mobile is presented. Unlike most mobile phone text entry methods, which rely on repeatedly pressing buttons, our gestural method uses an isometric joystick and the EdgeWrite alphabet to allow users to write by making ...
Camera phone based motion sensing: interaction techniques, applications and performance study
UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

This paper presents TinyMotion, a pure software approach for detecting a mobile phone user's hand movement in real time by analyzing image sequences captured by the built-in camera. We present the design and implementation of TinyMotion and several ...
TinyMotion: camera phone based interaction methods
CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems

This paper presents TinyMotion, a pure software approach that detects the movements of cell phones in real time by analyzing image sequences captured by the built-in camera. Typical movements that TinyMotion detects include - horizontal and vertical ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
1,152
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shah BAbhyankar M(2024)Touchtalk: Enhancing Messaging in Smartphones for Visually ImpairedProceedings of the 14th Indian Conference on Human-Computer Interaction10.1007/978-981-97-4335-3_7(133-148)Online publication date: 3-Aug-2024
https://doi.org/10.1007/978-981-97-4335-3_7
Wang GRen GHong XPeng XLi WO’Neill E(2022)Freehand Gestural Selection with Haptic Feedback in Wearable Optical See-Through Augmented RealityInformation10.3390/info1312056613:12(566)Online publication date: 2-Dec-2022
https://doi.org/10.3390/info13120566
Lockerman EWu SRao ALin JBantoc NMyers B(2017)Text entry using five to seven physical keys2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VLHCC.2017.8103481(291-295)Online publication date: Oct-2017
https://doi.org/10.1109/VLHCC.2017.8103481
Deselaers TKeysers DHosang JRowley H(2015)GyroPen: Gyroscopes for Pen-Input With Mobile PhonesIEEE Transactions on Human-Machine Systems10.1109/THMS.2014.236572345:2(263-271)Online publication date: Apr-2015
https://doi.org/10.1109/THMS.2014.2365723
Walmsley WSnelgrove WTruong K(2014)Disambiguation of imprecise input with one-dimensional rotational text entryACM Transactions on Computer-Human Interaction10.1145/254254421:1(1-40)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1145/2542544
Xiao XHan TWang JEpps JChen FOviatt SMase KSears AJokinen KSchuller B(2013)LensGestureProceedings of the 15th ACM on International conference on multimodal interaction10.1145/2522848.2522850(287-294)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1145/2522848.2522850
Tu HYang XWang FTian FRen XGo KKarashima MFukuzumi SRen X(2012)Mode switching techniques through pen and device profilesProceedings of the 10th asia pacific conference on Computer human interaction10.1145/2350046.2350081(169-176)Online publication date: 28-Aug-2012
https://dl.acm.org/doi/10.1145/2350046.2350081
Chang KFisher DCanny JHartmann BLiu YJafari RLu C(2011)How's my mood and stress?Proceedings of the 6th International Conference on Body Area Networks10.5555/2318776.2318794(71-77)Online publication date: 7-Nov-2011
https://dl.acm.org/doi/10.5555/2318776.2318794
Bailly GVo DLecolinet EGuiard YBourlard HHuang TVidal EGatica-Perez DMorency LSebe N(2011)Gesture-aware remote controlsProceedings of the 13th international conference on multimodal interfaces10.1145/2070481.2070530(263-270)Online publication date: 14-Nov-2011
https://dl.acm.org/doi/10.1145/2070481.2070530
Lee SHan JLee GTan DBegole BKellogg W(2011)MultiPressCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979796(1489-1494)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1979742.1979796

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents