Abstract
While mobile devices have allowed people to carry out various computing and communication tasks everywhere, it has generally lacked the support for task execution while the user is in motion. This is because the interaction schemes of most mobile applications are centered around the device visual display and when in motion (with the important body parts, such as the head and hands, moving), it is difficult for the user to recognize the visual output on the small hand-carried device display and respond to make the timely and proper input. In this paper, we propose an interface which allows the user to interact with the mobile devices during motion without having to look at it or use one’s hands. More specifically, the user interacts, by gaze and head motion gestures, with an invisible virtual interface panel with the help of a head-worn gyro sensor and aural feedback. Since the menu is one of the most prevailing methods of interaction, we investigate and focus on the various forms of menu presentation such as the layout and the number of comfortably selectable menu items. With head motion, it turns out 4×2 or 3×3 grid menu is more effective. The results of this study can be further extended for developing a more sophisticated non-visual oriented mobile interface.
Chapter PDF
Similar content being viewed by others
References
Berard, F.: The Perceptual Window: Head Motion as a new Input Stream. In: IFIP Conference on Human-Computer Interaction, pp. 238–244 (1999)
Brewster, S., Lumsden, J., Bell, M., Hall, M., Tasker, S.: Multimodal ’Eyes-Free’ Interaction Techniques for Wearable Devices. In: Proc. of ACM CHI, Florida, pp. 463–480 (2003)
Crossan, A., McGill, M., Brewster, S., Murray-Smith, R.: Head Tilting for Interaction in Mobile Contexts. In: Proc. of the 11th Intl. Conf. on Human-Computer Interaction with Mobile Devices and Services, Mobile HCI, Bonn, Germany (2008)
Crossan, A., Williamson, J., Brewster, S., Murray-Smith, R.: Wrist Rotation for Interaction in Mobile Contexts. In: Proc. of Mobile HCI, Amsterdam, Netherlands (2008)
Eslambolchilar, P., Murray-Smith, R.: Control Centric Approach in Designing Scrolling and Zooming User Interfaces. International Journal of Human-Computer Studies 66(12), 838–856 (2008)
Fitts, P.: The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Psychology 47, 381–391 (1954)
Foxlin, E.: Inertial Head-Tracker Sensor Fusion by a Complementary Separate-Bias Kalman Filter. In: Proc. of IEEE Virtual Reality Annual International Symposium, pp. 184–196 (1996)
Hinckley, K., Pierce, J., Horvitz, E.: Sensing Techniques for Mobile Interaction. In: Proc. of UIST, pp. 91–100 (2000)
LoPresti, E., Brienza, D., Angelo, J., Gilbertson, L., Sakai, J.: Neck Range of Motion and Use of Computer Head Controls. In: Proc. Intl. ACM Conference on Assistive Technologies, Arlington, Virginia, pp. 121–128 (2000)
MacKenzie, I.: A Note on the Information-Theoretic Basis for Fitts’ Law. Journal of Motor Behavior 21, 323–330 (1989)
Miller, G.: The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review 63(2), 343–355 (1956)
Oakley, I., O’Modhrain, M.: Tilt to Scroll: Evaluating a Motion based Vibrotactile Mobile Interface. In: Proc. of World Haptics, pp. 40–49 (2005)
Oakley, I., Park, J.: A Motion-based Marking Menu System. In: Extended Abstracts of ACM CHI, San Jose (2007)
Rekimoto, J.: Tilting Operations for Small Screen Interfaces. In: Proc. of UIST, pp. 167–168 (1996)
Robert, G., Gregg, C.: A Method for Evaluating Head-Controlled Computer Input Devices Using Fitts’ Law. Human Factors 32(4), 423–438 (1990)
Welford, A.: Fundamentals of Skill. Methuen, London (1968)
Williamson, J., Murray-Smith, R., Hughes, S.: Shoogle: Multimodal Excitatory Interaction on Mobile Devices. In: Proc. of ACM CHI, San Jose (2007)
You, S., Neumann, U.: Fusion of Vision and Gyro Tracking for Robust Augmented Reality Registration. In: Proc. of IEEE Conference on Virtual Reality, Japan, pp. 71–78 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, Gs., Ahn, Jg., Kim, G.J. (2011). Gaze-Directed Hands-Free Interface for Mobile Interaction. In: Jacko, J.A. (eds) Human-Computer Interaction. Interaction Techniques and Environments. HCI 2011. Lecture Notes in Computer Science, vol 6762. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21605-3_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-21605-3_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21604-6
Online ISBN: 978-3-642-21605-3
eBook Packages: Computer ScienceComputer Science (R0)