poster

From speech to personality: mapping voice quality and intonation into personality differences

Authors:

Gelareh Mohammadi,

Antonio Origlia,

Maurizio Filippone,

Alessandro VinciarelliAuthors Info & Claims

MM '12: Proceedings of the 20th ACM international conference on Multimedia

Pages 789 - 792

https://doi.org/10.1145/2393347.2396313

Published: 29 October 2012 Publication History

Abstract

From a cognitive point of view, personality perception corresponds to capturing individual differences and can be thought of as positioning the people around us in an ideal personality space. The more similar the personality of two individuals, the closer their position in the space. This work shows that the mutual position of two individuals in the personality space can be inferred from prosodic features. The experiments, based on ordinal regression techniques, have been performed over a corpus of 640 speech samples comprising 322 individuals assessed in terms of personality traits by 11 human judges, which is the largest database of this type in the literature. The results show that the mutual position of two individuals can be predicted with up to 80% accuracy.

References

[1]

C. M. Bishop. Pattern Recognition and Machine Learning. Springer Verlag, 2007.

[2]

P. Boersma. Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound. In Proc. of the Institute of Phonetic Sciences, volume 17, pages 97--110, 1993.

[3]

S. Dumais, E. Cutrell, J. J. Cadiz, G. Jancke, R. Sarin, and D. C. Robbins. Stuff i've seen: a system for personal information retrieval and re-use. In Proc. of ACM Intl. Conf. on Research and Development in Information Retrieval, pages 72--79, 2003.

Digital Library

[4]

D.C. Funder. Personality. Annual Reviews of Psychology, 52:197--221, 2001.

[5]

F. Mairesse, M. A. Walker, M. R. Mehl, and R. K. Moore. Using linguistic cues for the automatic recognition of personality in conversation and text. Journal of Artificial Intelligence Research, 30:457--500, 2007.

Digital Library

[6]

P. McCullagh. Regression models for ordinal data. Journal Royal Statistical Society B, 42:109--142, 1980.

[7]

P. Mertens. The prosogram: Semi-automatic transcription of prosody based on a tonal perception model. In Proc. of Speech Prosody, 2004.

[8]

G. Mohammadi and A. Vinciarelli. Automatic personality perception: Prediction of trait attribution based on prosodic features. IEEE Transactions on Affective Computing (to appear), 2012.

Digital Library

[9]

M. Petrillo and F. Cutugno. A syllable segmentation algorithm for english and italian. In Proc. of Eurospeech, pages 2913--2916, 2003.

[10]

F. Pianesi, N. Mana, and A. Cappelletti. Multimodal recognition of personality traits in social interactions. In In Proc. of the Intl. Conf. on Multimodal Interfaces, pages 53--60, 2008.

Digital Library

[11]

T. Polzehl, S. Moller, and F. Metze. Automatically assessing personality from speech. In Proc. of IEEE Intl. Conf. on Semantic Computing, pages 134--140, 2010.

Digital Library

[12]

B. Rammstedt and O. P. John. Measuring personality in one minute or less: A 10-item short version of the big five inventory in english and german. Journal of Research in Personality, 41(1):203--212, 2007.

[13]

G. B. Ray. Vocally cued personality prototypes: An implicit personality theory approach. Journal of Communication Monographs, 53(3):266--276, 1986.

[14]

B. Reeves and C. Nass. The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press, 1996.

Digital Library

[15]

K. R. Scherer. Effect of stress on fundamental frequency of the voice. in Journal of Acoustical Society of America, 62(S1):25--26, 1977.

[16]

J. S. Uleman, S. A. Saribay, and C. M. Gonzalez. Spontaneous inferences, implicit impressions, and implicit theories. Annual Reviews of Psychology, 59:329--360, 2008.

[17]

A. Vinciarelli, M. Pantic, and H. Bourlard. Social signal processing: Survey of an emerging domain. Image and Vision Computing Journal, 27(12):1743--1759, 2009.

Digital Library

[18]

J.S. Wiggins, editor. The Five-Factor Model of Personality. Guildfor Press, 1996.

Cited By

Bhin HLim YChoi J(2024)Multimodal Personality Prediction: A Real-Time Recognition System for Social Robots with Data Acquisition2024 21st International Conference on Ubiquitous Robots (UR)10.1109/UR61395.2024.10597440(673-676)Online publication date: 24-Jun-2024
https://doi.org/10.1109/UR61395.2024.10597440
Maxfield LLowe DCantor-Cutiva LHunter E(2024)Personality Traits and Self-Reported Vocal Fatigue and Other Voice Measures Among TeachersJournal of Voice10.1016/j.jvoice.2024.09.023Online publication date: Oct-2024
https://doi.org/10.1016/j.jvoice.2024.09.023
Kumar DSingh PRaman B(2024)All signals point to personality: A dual-pipeline LSTM-attention and symbolic dynamics framework for predicting personality traits from Bio-Electrical signalsBiomedical Signal Processing and Control10.1016/j.bspc.2024.10660996(106609)Online publication date: Oct-2024
https://doi.org/10.1016/j.bspc.2024.106609
Show More Cited By

Index Terms

From speech to personality: mapping voice quality and intonation into personality differences
1. Information systems
  1. Information retrieval
    1. Document representation

Recommendations

The voice of personality: mapping nonverbal vocal behavior into trait attributions
SSPW '10: Proceedings of the 2nd international workshop on Social signal processing

This paper reports preliminary experiments on automatic attribution of personality traits based on nonverbal vocal behavioral cues. In particular, the work shows how prosodic features can be used to predict, with an accuracy up to 75% depending on the ...
Personality and patterns of Facebook usage
WebSci '12: Proceedings of the 4th Annual ACM Web Science Conference

We show how users' activity on Facebook relates to their personality, as measured by the standard Five Factor Model. Our dataset consists of the personality profiles and Facebook profile data of 180,000 users. We examine correlations between users' ...
A Multivariate Regression Approach to Personality Impression Recognition of Vloggers
WCPR '14: Proceedings of the 2014 ACM Multi Media on Workshop on Computational Personality Recognition

Research in psychology has suggested that behavior of individuals can be explained to a great extent by their underlying personality traits. In this paper, we focus on predicting how the personality of YouTube video bloggers is perceived by their ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '12: Proceedings of the 20th ACM international conference on Multimedia

October 2012

1584 pages

ISBN:9781450310895

DOI:10.1145/2393347

General Chairs:
Noboru Babaguchi
Osaka University, Japan
,
Kiyoharu Aizawa
The University of Tokyo, Japan
,
John Smith
IBM, USA
,
Program Chairs:
Shin'ichi Satoh
National Institute of Informatics, Japan
,
Thomas Plagemann
University of Oslo, Norway
,
Xian-Sheng Hua
Microsoft, USA
,
Rong Yan
Facebook, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

MM '12

Sponsor:

SIGMM

MM '12: ACM Multimedia Conference

October 29 - November 2, 2012

Nara, Japan

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
435
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)8

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bhin HLim YChoi J(2024)Multimodal Personality Prediction: A Real-Time Recognition System for Social Robots with Data Acquisition2024 21st International Conference on Ubiquitous Robots (UR)10.1109/UR61395.2024.10597440(673-676)Online publication date: 24-Jun-2024
https://doi.org/10.1109/UR61395.2024.10597440
Maxfield LLowe DCantor-Cutiva LHunter E(2024)Personality Traits and Self-Reported Vocal Fatigue and Other Voice Measures Among TeachersJournal of Voice10.1016/j.jvoice.2024.09.023Online publication date: Oct-2024
https://doi.org/10.1016/j.jvoice.2024.09.023
Kumar DSingh PRaman B(2024)All signals point to personality: A dual-pipeline LSTM-attention and symbolic dynamics framework for predicting personality traits from Bio-Electrical signalsBiomedical Signal Processing and Control10.1016/j.bspc.2024.10660996(106609)Online publication date: Oct-2024
https://doi.org/10.1016/j.bspc.2024.106609
Tayarani MEsposito AVinciarelli A(2022)What an “Ehm” Leaks About You: Mapping Fillers into Personality Traits with Quantum Evolutionary Feature Selection AlgorithmsIEEE Transactions on Affective Computing10.1109/TAFFC.2019.293069513:1(108-121)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TAFFC.2019.2930695
Leutner FAkhtar RChamorro-Premuzic TLeutner FAkhtar RChamorro-Premuzic T(2022)Digital InterviewsThe Future of Recruitment10.1108/978-1-83867-559-220221003(51-87)Online publication date: 11-Mar-2022
https://doi.org/10.1108/978-1-83867-559-220221003
Phan LRauthmann J(2021)Personality computing: New frontiers in personality assessmentSocial and Personality Psychology Compass10.1111/spc3.1262415:7Online publication date: 2-Jun-2021
https://doi.org/10.1111/spc3.12624
Beyan CZunino AShahid MMurino V(2021)Personality Traits Classification Using Deep Visual Activity-Based Nonverbal Features of Key-Dynamic ImagesIEEE Transactions on Affective Computing10.1109/TAFFC.2019.294461412:4(1084-1099)Online publication date: 1-Oct-2021
https://doi.org/10.1109/TAFFC.2019.2944614
Al-Hammadi DMoore R(2021)Using Sampling Techniques and Machine Learning Algorithms to Improve Big Five Personality Traits Recognition from Non-verbal Cues2021 National Computing Colleges Conference (NCCC)10.1109/NCCC49330.2021.9428804(1-6)Online publication date: 27-Mar-2021
https://doi.org/10.1109/NCCC49330.2021.9428804
Zaferani ETeshnehlab MVali M(2021)Automatic Personality Perception Using Autoencoder And Hierarchical Fuzzy Classification2021 26th International Computer Conference, Computer Society of Iran (CSICC)10.1109/CSICC52343.2021.9420627(1-7)Online publication date: 3-Mar-2021
https://doi.org/10.1109/CSICC52343.2021.9420627
Zaferani ETeshnehlab MVali M(2021)Automatic Personality Traits Perception Using Asymmetric Auto-EncoderIEEE Access10.1109/ACCESS.2021.30768209(68595-68608)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3076820
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents