Crossmodal congruence: the look, feel and sound of touchscreen widgets
E Hoggan, T Kaaresoja, P Laitinen… - Proceedings of the 10th …, 2008 - dl.acm.org
E Hoggan, T Kaaresoja, P Laitinen, S Brewster
Proceedings of the 10th international conference on Multimodal interfaces, 2008•dl.acm.orgOur research considers the following question: how can visual, audio and tactile feedback
be combined in a congruent manner for use with touchscreen graphical widgets? For
example, if a touchscreen display presents different styles of visual buttons, what should
each of those buttons feel and sound like? This paper presents the results of an experiment
conducted to investigate methods of congruently combining visual and combined
audio/tactile feedback by manipulating the different parameters of each modality. The results …
be combined in a congruent manner for use with touchscreen graphical widgets? For
example, if a touchscreen display presents different styles of visual buttons, what should
each of those buttons feel and sound like? This paper presents the results of an experiment
conducted to investigate methods of congruently combining visual and combined
audio/tactile feedback by manipulating the different parameters of each modality. The results …
Our research considers the following question: how can visual, audio and tactile feedback be combined in a congruent manner for use with touchscreen graphical widgets? For example, if a touchscreen display presents different styles of visual buttons, what should each of those buttons feel and sound like? This paper presents the results of an experiment conducted to investigate methods of congruently combining visual and combined audio/tactile feedback by manipulating the different parameters of each modality. The results indicate trends with individual visual parameters such as shape, size and height being combined congruently with audio/tactile parameters such as texture, duration and different actuator technologies. We draw further on the experiment results using individual quality ratings to evaluate the perceived quality of our touchscreen buttons then reveal a correlation between perceived quality and crossmodal congruence. The results of this research will enable mobile touchscreen UI designers to create realistic, congruent buttons by selecting the most appropriate audio and tactile counterparts of visual button styles.
ACM Digital Library