Abstract
The goal of the present research was to study the relative role of facial and acoustic cues in the formation of trustworthiness impressions. Furthermore, we investigated the relationship between perceived trustworthiness and perceivers’ confidence in their judgments. 25 young adults watched a number of short clips in which the video and audio channel were digitally aligned to form five different combinations of actors’ face and voice trustworthiness levels (neutral face + neutral voice, neutral face + trustworthy voice, neutral face + non-trustworthy voice, trustworthy face + neutral voice, and non-trustworthy face + neutral voice). Participants provided subjective ratings of the trustworthiness of the actor in each video, and indicated their level of confidence in each of those ratings. Results revealed a main effect of face-voice channel combination on trustworthiness ratings, and no significant effect of channel combination on confidence ratings. We conclude that there is a clear superiority effect of facial over acoustic cues in the formation of trustworthiness impressions, propose a method for future investigation of the judgmentconfidence link, and outline the practical implications of the experiment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Willis, J., Todorov, A.: First Impressions: Making up Your Mind after 100ms Exposure to a Face. Psychol. Sci., 592–598 (2006)
Ballew, C.C., Todorov, A.: Predicting Political Elections from Rapid and Unreflective Face Judgments. Proceedings of the National Academy of Sciences of the United States of America 104, 17948–17953 (2007)
Surawski, M., Ossoff, E.: The Effects of Physical and Vocal Attractiveness on Impression Formation of Politicians. Current Psychology 25, 15–27 (2006)
Giddens, A.: The Consequences of Modernity. Stanford University Press, Stanford (1990)
Giddens, A.: Modernity and Self-Identity. Polity Press, Cambridge (1991)
Möllering, G.: The Nature of Trust: From Georg Simmel to a Theory of Expectation, Interpretation and Suspension. Sociology 35, 403–420 (2001)
Möllering, G.: Trust: Reason, Routine, Reflexivity. Elsevier, Oxford (2006)
Luhmann, N.: Trust and Power. Two Works by Niklas Luhmann. Wiley, Chichester (1979)
Lewis, J.D., Weigert, A.: Trust as a Social Reality. Social Forces 63, 967–985 (1985)
Krumhuber, E., Manstead, A.S.R., Cosker, D., Marshall, D., Rosin, P., Kappas, A.: Facial Dynamics as Indicators of Trustworthiness and Cooperative Behavior. Emotion 7, 730–735 (2007)
Kamachi, M., Hill, H., Lander, K., Vatikiotis-Bateson, E.: ‘Putting the Face to the Voice’: Matching Identity Across Modality. Current Biology 13, 1709–1714 (2003)
Lachs, L., Pisoni, D.: Crossmodal Source Identification in Speech Perception. Ecological Psychology 16, 159–187 (2004)
Oosterhof, N.N., Todorov, A.: The Functional Basis of Face Evaluation. Proceedings of the National Academy of Sciences of the United States of America 105, 11087–11092 (2008)
Hess, U., Kappas, A., Scherer, K.R.: Multichannel Communication of Emotion: Synthetic Signal Production. In: Scherer, K.R. (ed.) Facets of Emotion: Recent Research, pp. 161–182. Erlbaum, Hillsdale (1988)
Aubrey, A., Kajic, V., Cingovska, I., Rosin, P., Marshall, D.: Mapping and Manipulating Facial Dynamics. In: Proc. IEEE Conf. Automatic Face and Gesture Recognition, pp. 639–645 (2011)
Jarvis, B.: MediaLab (Version 2008.1.33). Empirisoft Corporation, New York (2008)
Kappas, A., Hess, U., Scherer, K.R.: Voice and Emotion. In: Feldman, R.S., Rimé, B. (eds.) Fundamentals of Nonverbal Behavior, pp. 200–238. Cambridge University Press, Cambridge (1991)
Burns, C., Conchie, S.: Measuring Implicit Trust and Automatic Attitude Activation. In: Lyon, F., Möllering, G., Sanders, M. (eds.) Handbook of Research Methods on Trust, pp. 239–248. Edward Elgar, Cheltenham (2011)
Van Mulken, S., André, E., Muller, J.: An Empirical Study on the Trustworthiness of Life-Like Interface Agents. In: Bullinger, H., Ziegler, J. (eds.) Human Computer Interaction, pp. 152–156. Erlbaum, Mahwah (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tsankova, E. et al. (2013). Facial and Vocal Cues in Perceptions of Trustworthiness. In: Park, JI., Kim, J. (eds) Computer Vision - ACCV 2012 Workshops. ACCV 2012. Lecture Notes in Computer Science, vol 7729. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37484-5_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-37484-5_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37483-8
Online ISBN: 978-3-642-37484-5
eBook Packages: Computer ScienceComputer Science (R0)