Abstract
Physical keyboards persist as one of the most common input devices for personal computers. Low familiarity with the keyboard translates to frustration during text entry, as the user constantly shifts their attention between the keyboard and the screen, in order to locate the next key to press, and to inspect input for errors. To decrease the need for attention shifts, we present physical keyboard typists with visual feedback, within their field of view, using an RGB LED strip to indicate spelling errors in different colours. We conducted a user experiment with 36 participants. Users’ performance was evaluated a) without visual feedback, b) showing feedback with a LED strip on the keyboard, and c) showing feedback with a LED strip at the bottom of the screen. We find that our prototype improves corrective action behaviour for slow typists and reduces screen-glancing behaviour for fast typists.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alharbi, O., Arif, A.S., Stuerzlinger, W., Dunlop, M.D., Komninos, A.: WiseType: a tablet keyboard with color-coded visualization and various editing options for error correction. In: Proceedings of graphics interface 2019. GI 2019, Canadian Information Processing Society, Kingston, Ontario (2019). https://doi.org/10.20380/GI2019.04, iSSN: 0713-5424 Number of pages: 10
Arif, A.S., Mazalek, A.: WebTEM: a web application to record text entry metrics. In: Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces, ISS 2016, pp. 415–420. Association for Computing Machinery, New York, August 2016. https://doi.org/10.1145/2992154.2996791
Banovic, N., Rao, V., Saravanan, A., Dey, A.K., Mankoff, J.: Quantifying aversion to costly typing errors in expert mobile text entry. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI-17, pp. 4229–4241. ACM (2017). https://doi.org/10.1145/3025453.3025695
Cerney, M.M., Mila, B.D., Hill, L.C.: Comparison of mobile text entry methods. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 48, no. 5, pp. 778–782, September 2004. https://doi.org/10.1177/154193120404800508, publisher: SAGE Publications Inc
Dhakal, V., Feit, A.M., Kristensson, P.O., Oulasvirta, A.: Observations on typing from 136 million keystrokes. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, pp. 1–12. Association for Computing Machinery, New York, April 2018. https://doi.org/10.1145/3173574.3174220
Dhakal, V., Feit, A.M., Kristensson, P.O., Oulasvirta, A.: Observations on typing from 136 million keystrokes. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI-18, pp. 1-12. Association for Computing Machinery, New York, April 2018. https://doi.org/10.1145/3173574.3174220
Dietz, P., Eidelson, B., Westhues, J., Bathiche, S.: A practical pressure sensitive computer keyboard, pp. 55–58, January 2009. https://doi.org/10.1145/1622176.1622187
Feit, A.M., Weir, D., Oulasvirta, A.: How we type: movement strategies and performance in everyday typing. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI 16, pp. 4262–4273. Association for Computing Machinery, San Jose, California, USA, May 2016. https://doi.org/10.1145/2858036.2858233
Hart, S., Staveland, L.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research (1988). https://doi.org/10.1016/S0166-4115(08)62386-9
Kato, J., Sakamoto, D., Igarashi, T.: Surfboard: keyboard with microphone as a low-cost interactive surface, October 2010. https://doi.org/10.1145/1866218.1866233
Kim, D., et al.: RetroDepth: 3D silhouette sensing for high-precision input on and above physical surfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014, pp. 1377–1386. Association for Computing Machinery, New York, December 2014. https://doi.org/10.1145/2556288.2557336
Komninos, A., Nicol, E., Dunlop, M.D.: Designed with older adults to SupportBetter error correction in SmartPhone text entry: the MaxieKeyboard. In: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI 2015, pp. 797–802. Association for Computing Machinery, New York, August 2015. https://doi.org/10.1145/2786567.2793703
Kristensson, P.O., Zhai, S.: SHARK\(^{\rm 2}\): a large vocabulary shorthand writing system for pen-based computers. In: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, UIST 2004, pp. 43–52. Association for Computing Machinery, New York, October 2004. https://doi.org/10.1145/1029632.1029640
Kurosawa, T., Shizuki, B., Tanaka, J.: Keyboard clawing: input method by clawing key tops. In: Kurosu, M. (ed.) HCI 2013. LNCS, vol. 8007, pp. 272–280. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39330-3_29
McGill, M., Brewster, S., De Sa Medeiros, D.P., Bovet, S., Gutierrez, M., Kehoe, A.: Creating and augmenting keyboards for extended reality with the keyboard augmentation toolkit. ACM Trans. Comput-Hum. Inter. 29(2), 15:1–15:39 (2022). https://doi.org/10.1145/3490495
Papoutsaki, A., Gokaslan, A., Tompkin, J., He, Y., Huang, J.: The eye of the typer: a benchmark and analysis of gaze behavior during typing. In: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications, ETRA 2018, pp. 1–9. Association for Computing Machinery, Warsaw, Poland, June 2018. https://doi.org/10.1145/3204493.3204552
Ramos, J., Li, Z., Rosas, J., Banovic, N., Mankoff, J., Dey, A.: Keyboard surface interaction: making the keyboard into a pointing device. arXiv:1601.04029 [cs], January 2016
Schneider, D., et al.: ReconViguRation: reconfiguring physical keyboards in virtual reality. IEEE Trans. Vis. Comput. Graph. 25(11), 3190–3201 (2019). https://doi.org/10.1109/TVCG.2019.2932239, https://www.computer.org/csdl/journal/tg/2019/11/08794572/1dXEHv0aKMo
Silfverberg, M., MacKenzie, I.S., Korhonen, P.: Predicting text entry speed on mobile phones. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2000, pp. 9–16. Association for Computing Machinery, New York, April 2000. https://doi.org/10.1145/332040.332044
Soukoreff, R.W., MacKenzie, I.S.: Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2003, pp. 113–120. ACM, New York (2003). https://doi.org/10.1145/642611.642632
Vertanen, K., Kristensson, P.O.: A versatile dataset for text entry evaluations based on genuine mobile emails. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, MobileHCI 2011, pp. 295–298. Association for Computing Machinery, New York, May 2011. https://doi.org/10.1145/2037373.2037418
Yechiam, E., Erev, I., Yehene, V., Gopher, D.: Melioration and the transition from touch-typing training to everyday use. Hum. Factors 45(4), 671–684 (2003). https://doi.org/10.1518/hfes.45.4.671.27085
Zhang, H., Li, Y.: GestKeyboard: enabling gesture-based interaction on ordinary physical keyboard. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014, pp. 1675–1684. Association for Computing Machinery, New York, December 2014. https://doi.org/10.1145/2556288.2557362
Zhu, S., Luo, T., Bi, X., Zhai, S.: Typing on an Invisible Keyboard. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, pp. 1–13. Association for Computing Machinery, Montreal QC, Canada, April 2018. https://doi.org/10.1145/3173574.3174013
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Komninos, A., Kavvathas, V., Simou, I. (2023). LEDBoard: Using Visual Feedback to Support Text Entry with Physical Keyboards. In: Bravo, J., Ochoa, S., Favela, J. (eds) Proceedings of the International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2022). UCAmI 2022. Lecture Notes in Networks and Systems, vol 594. Springer, Cham. https://doi.org/10.1007/978-3-031-21333-5_85
Download citation
DOI: https://doi.org/10.1007/978-3-031-21333-5_85
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-21332-8
Online ISBN: 978-3-031-21333-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)