poster

Voice key board: multimodal indic text input

Authors:

Prasenjit Dey,

Ramchandrula Sitaram,

Rahul Ajmera,

Kalika BaliAuthors Info & Claims

ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces

Pages 313 - 318

https://doi.org/10.1145/1647314.1647380

Published: 02 November 2009 Publication History

Get Access

Abstract

Multimodal systems, incorporating more natural input modalities like speech, hand gesture, facial expression etc., can make human-computer-interaction more intuitive by drawing inspiration from spontaneous human-human-interaction. We present here a multimodal input device for Indic scripts called the Voice Key Board (VKB) which offers a simpler and more intuitive method for input of Indic scripts. VKB exploits the syllabic nature of Indic language scripts and exploits the user's mental model of Indic scripts wherein a base consonant character is modified by different vowel ligatures to represent the actual syllabic character. We also present a user evaluation result for VKB comparing it with the most common input method for the Devanagari script, the InScript keyboard. The results indicate a strong user preference for VKB in terms of input speed and learnability. Though VKB starts with a higher user error rate compared to InScript, the error rate drops by 55% by the end of the experiment, and the input speed of VKB is found to be 81% higher than InScript. Our user study results point to interesting research directions for the use of multiple natural modalities for Indic text input.

References

[1]

Oviatt, S. L., "Multimodal interfaces, Handbook of Human-Computer Interaction (revised edition)", (ed. by J. Jacko&A. Sears), Lawrence Erlbaum Assoc.,Mahwah, New Jersey, 2006.

Google Scholar

[2]

Coulmas, Florian, The Encyclopedia of Writing Systems, Blackwell Publishing, 1999.

Google Scholar

[3]

InScript: http://en.wikipedia.org/wiki/InScript_Typing

Google Scholar

[4]

Srinivas N K, Nobby Varghese, RKVS Raman, "Indic-Dasher : A Stroke and Gesture Based Input Mechanism for Indic Scripts", 2008. IUI4DR: intelligent user interfaces for developing regions. In Proceedings of the 13th international Conference on intelligent User interfaces (Gran Canaria, Spain, January 13 -- 16, 2008). IUI '08. ACM, New York, NY, 437--437

Digital Library

Google Scholar

[5]

Dasher: http://www.inference.phy.cam.ac.uk/dasher/

Google Scholar

[6]

R. Balaji, V. Deepu, Sriganesh Madhvanath and Jayasree Prabhakaran. "Handwritten Gesture Recognition for Gesture Keyboard", Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition (IWFHR10), 2006.

Google Scholar

[7]

T9: http://www.t9.com/us/ask.asp

Google Scholar

[8]

Johnston, M. and Bangalore, S. 2005. Finite-state multimodal integration and understanding. Nat. Lang. Eng. 11, 2 (Jun. 2005), 159--187.

Digital Library

Google Scholar

Cited By

View all

Bhikne BJoshi AJoshi MAhire SMaravi N(2018)How Much Faster Can You Type by Speaking in Hindi?Proceedings of the 9th Indian Conference on Human-Computer Interaction10.1145/3297121.3297123(20-28)Online publication date: 16-Dec-2018
https://dl.acm.org/doi/10.1145/3297121.3297123
Karusala NVishwanath AVashistha AKumar SKumar NMandryk RHancock MPerry MCox A(2018)"Only if you use English you will get to more things"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174147(1-14)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174147
Zamora JPapadopoulos GKuflik TChen FDuarte CFu W(2017)Rise of the ChatbotsCompanion Proceedings of the 22nd International Conference on Intelligent User Interfaces10.1145/3030024.3040201(109-112)Online publication date: 7-Mar-2017
https://dl.acm.org/doi/10.1145/3030024.3040201
Show More Cited By

Index Terms

Voice key board: multimodal indic text input
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Designing EdgeWrite Versions for Japanese Text Entry
CW '13: Proceedings of the 2013 International Conference on Cyberworlds

This paper presents our project of designing Edge Write text entry methods for Japanese language. We are developing two versions of Edge Write text entry method for Japanese language: Roman-Kana Edge Write and Katakana Edge Write. Roman-Kana Edge Write ...
In-stroke word completion
UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

We present the design and implementation of a word-level stroking system called Fisch, which is intended to improve the speed of character-level unistrokes. Importantly, Fisch does not alter the way in which character-level unistrokes are made, but ...
From vocal to multimodal dialogue management
ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

Multimodal, speech-enabled systems pose different research problems when compared to unimodal, voice-only dialogue systems. One of the important issues is the question of how a multimodal interface should look like in order to make the multimodal ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces

November 2009

374 pages

ISBN:9781605587721

DOI:10.1145/1647314

General Chairs:
James L. Crowley
INRIA Grenoble Rhône-Alpes Research Centre, France
,
Yuri Ivanov
MERL, USA
,
Christopher Wren
Google, USA
,
Program Chairs:
Daniel Gatica-Perez
Idiap Research Institute, Switzerland
,
Michael Johnston
AT&T Research, USA
,
Rainer Stiefelhagen
University of Karlsruhe, Germany

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

ICMI-MLMI '09

Sponsor:

SIGCHI

ICMI-MLMI '09: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES/WORKSHOP ON MACHINE LEARNING FOR MULTIMODAL INTERFACES

November 2 - 4, 2009

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
222
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bhikne BJoshi AJoshi MAhire SMaravi N(2018)How Much Faster Can You Type by Speaking in Hindi?Proceedings of the 9th Indian Conference on Human-Computer Interaction10.1145/3297121.3297123(20-28)Online publication date: 16-Dec-2018
https://dl.acm.org/doi/10.1145/3297121.3297123
Karusala NVishwanath AVashistha AKumar SKumar NMandryk RHancock MPerry MCox A(2018)"Only if you use English you will get to more things"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174147(1-14)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174147
Zamora JPapadopoulos GKuflik TChen FDuarte CFu W(2017)Rise of the ChatbotsCompanion Proceedings of the 22nd International Conference on Intelligent User Interfaces10.1145/3030024.3040201(109-112)Online publication date: 7-Mar-2017
https://dl.acm.org/doi/10.1145/3030024.3040201
Oviatt SCohen P(2015)The Paradigm Shift to Multimodality in Contemporary Computer InterfacesSynthesis Lectures on Human-Centered Informatics10.2200/S00636ED1V01Y201503HCI0308:3(1-243)Online publication date: 13-Apr-2015
https://doi.org/10.2200/S00636ED1V01Y201503HCI030
Jain MTekchandani KTruong K(2013)Evaluating the Effect of Phrase Set in Hindi Text EntryHuman-Computer Interaction – INTERACT 201310.1007/978-3-642-40498-6_14(195-202)Online publication date: 2013
https://doi.org/10.1007/978-3-642-40498-6_14
Jung YJoshi DNarayanan-Saroja VDesai DBylund MJuhlin OFernaeus Y(2011)Solving the great Indian text input puzzleProceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services10.1145/2037373.2037421(313-322)Online publication date: 30-Aug-2011
https://dl.acm.org/doi/10.1145/2037373.2037421

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Designing EdgeWrite Versions for Japanese Text Entry

In-stroke word completion

From vocal to multimodal dialogue management