Abstract
Natural gaze behavior during human-computer interaction provides valuable information about user’s cognitive processes and intentions. Including it as an additional input modality therefore provides great potential to improve human-computer interaction. However, the relation between natural gaze behavior and underlying cognitive processes still is unexplored to a large extend. Additionally, most interaction techniques proposed in recent years which incorporate eye gaze as input modality require the user to consciously diverge from natural gaze behavior in order to trigger certain events. In this paper we present results from two user studies. The first one aims at identifying and characterizing major factors which influence natural gaze behavior during human-computer interaction with a focus on the role of user’s mental model about the interactive system. We investigate how natural gaze behavior can be influenced by interaction design and point out implications for usage of gaze as additional modality in gaze-based interfaces. With the second user study we demonstrate how gaze-based intention estimation based on analysis of natural gaze behavior can be used to improve interaction in multi-display environments.
The research described in this chapter was conducted during the first author’s employment at the Vision and Fusion Laboratory, Institute for Anthropomatics, Karlsruhe Institute of Technology (KIT), Adenauerring 4, 76131 Karlsruhe, Germany.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
References
Bader T (2011) Multimodale Interaktion in Multi-Display-Umgebungen. PhD thesis
Bader T, Vogelgesang M, Klaus E (2009) Multimodal integration of natural gaze behavior for intention recognition during object manipulation. In: Proceedings of the 2009 international conference on multimodal interfaces (ICMI-MLMI). ACM, New York, pp 199–206
Boring S, Baur D, Butz A, Gustafson S, Baudisch P (2010) Touch projector: mobile interaction through video. In: Proceedings of the 28th international conference on human factors in computing systems, pp 2287–2296
Flanagan JR, Johansson RS (2003) Action plans used in action observation. Nature 424(6950):769–771
Gesierich B, Bruzzo A, Ottoboni G, Finos L (2008) Human gaze behaviour during action execution and observation. Acta Psychol 128(2):324–330
Hyrskykari A, Majaranta P, Räihä K (2003) Proactive response to eye movements. In: Rauterberg M (ed) Human computer interaction, INTERACT 2003. IOS Press, Amsterdam, pp 129–136
Jacob RJK (1993) Eye movement-based human-computer interaction techniques: toward non-command interfaces. In: Advances in human-computer interaction. Ablex, Norwood, pp 151–190
Jacob R, Karn K (2003) Eye tracking in human-computer interaction and usability research: ready to deliver the promises. Elsevier, Amsterdam, pp 573–605
Johanson B, Fox A (2002) The Event Heap: a coordination infrastructure for interactive workspaces. In: Proceedings of the fourth IEEE workshop on mobile computing systems and applications, pp 83–93
Johanson B, Fox A, Winograd T (2002) The Interactive Workspaces project: experiences with ubiquitous computing rooms. IEEE Pervasive Comput 1(2):67–74
Johansson RS, Westling G, Bäckström A, Flanagan JR (2001) Eye-hand coordination in object manipulation. J Neurosci 21(17):6917–6932
Land M, Lee D (1994) Where we look when we steer. Nature 369:742–744
Land MF, McLeod P (2000) From eye movements to actions: how batsmen hit the ball. Nat Neurosci 3:1340–1345
Majaranta P, Räihä KJ (2002) Twenty years of eye typing: systems and design issues. In: Proceedings of the 2002 symposium on eye tracking research & applications, ETRA’02. ACM, New York, pp 15–22
Nacenta MA, Sallam S, Champoux B, Subramanian S, Gutwin C (2006) Perspective cursor: perspective-based interaction for multi-display environments. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 289–298
Nickel K, Stiefelhagen R (2003) Pointing gesture recognition based on 3D-tracking of face, hands and head orientation. In: Proceedings of the 5th international conference on multimodal interfaces, pp 140–146
Nielsen J (1993) Noncommand user interfaces. Commun ACM 36(4):83–99
Pelz J, Hayhoe M, Loeber R (2001) The coordination of eye, head, and hand movements in a natural task. Exp Brain Res 139:266–277. doi:10.1007/s002210100745
Rekimoto J, Saitoh M (1999) Augmented surfaces: a spatially continuous work space for hybrid computing environments. In: Proceedings of the SIGCHI conference on human factors in computing systems: the CHI is the limit, pp 378–385
Schick A, van de Camp F, Ijsselmuiden J, Stiefelhagen R (2009) Extending touch: towards interaction with large-scale surfaces. In: Proceedings of the ACM international conference on interactive tabletops and surfaces
Smith BA, Ho J, Ark W, Zhai S (2000) Hand eye coordination patterns in target selection. In: Proceedings of the 2000 symposium on eye tracking research & applications, ETRA’00. ACM, New York, pp 117–122
Streitz NA, Geißler J, Holmer T, Konomi S, Müller-Tomfelde C, Reischl W, Rexroth P, Seitz P, Steinmetz R (1999) i-LAND: an interactive landscape for creativity and innovation. In: Proceedings of the SIGCHI conference on human factors in computing systems: the CHI is the limit, pp 120–127
Zhai S, Morimoto C, Ihde S (1999) Manual and gaze input cascaded (magic) pointing. In: CHI99. ACM, New York, pp 246–253
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Bader, T., Beyerer, J. (2013). Natural Gaze Behavior as Input Modality for Human-Computer Interaction. In: Nakano, Y., Conati, C., Bader, T. (eds) Eye Gaze in Intelligent User Interfaces. Springer, London. https://doi.org/10.1007/978-1-4471-4784-8_9
Download citation
DOI: https://doi.org/10.1007/978-1-4471-4784-8_9
Publisher Name: Springer, London
Print ISBN: 978-1-4471-4783-1
Online ISBN: 978-1-4471-4784-8
eBook Packages: Computer ScienceComputer Science (R0)