short-paper

Automatic role recognition in multiparty recordings using social networks and probabilistic sequential models

Authors:

Sarah Favre,

Alfred Dielmann,

Alessandro VinciarelliAuthors Info & Claims

MM '09: Proceedings of the 17th ACM international conference on Multimedia

Pages 585 - 588

https://doi.org/10.1145/1631272.1631362

Published: 19 October 2009 Publication History

Get Access

Abstract

The automatic analysis of social interactions is attracting significant interest in the multimedia community. This work addresses one of the most important aspects of the problem, namely the recognition of roles in social exchanges. The proposed approach is based on Social Network Analysis, for the representation of individuals in terms of their interactions with others, and probabilistic sequential models, for the recognition of role sequences underlying the sequence of speakers in conversations. The experiments are performed over different kinds of data (around 90 hours of broadcast data and meetings), and show that the performance depends on how formal the roles are, i.e. on how much they constrain people behavior.

References

[1]

J. Ajmera and C. Wooters. A robust speaker clustering algorithm. In Proc. of IEEE Workshop on Automatic Speech Recognition Understanding, pages 411--416, 2003.

Crossref

Google Scholar

[2]

C. Bishop. Pattern Recognition and Machine Learning. Springer Verlag, 2006.

Digital Library

Google Scholar

[3]

J. Dines, J. Vepa, and T. Hain. The segmentation of multi-channel meeting recordings for automatic speech recognition. In Proc. of Interspeech, pages 1213--1216, 2006.

Google Scholar

[4]

S. Favre, H. Salamin, J. Dines, and A. Vinciarelli. Role recognition in multiparty recordings using social affiliation networks and discrete distributions. In Proc. of International Conference on Multimodal Interfaces, pages 61--68, 2008.

Digital Library

Google Scholar

[5]

J. Levine and R. Moreland. Small groups. In D. Gilbert and G. Lindzey, editors, The handbook of social psychology, volume 2, pages 415--469. Oxford University Press, 1998.

Google Scholar

[6]

Y. Liu. Initial studay on automatic identification of speaker role in broadcast news speech. In Proc. of the Human Language Technology Conference of the North American Chapter of the ACL, pages 81--84, 2006.

Digital Library

Google Scholar

[7]

F. Massey Jr. The Kolmogorov-Smirnov test for goodness of fit. Journal of the American Statistical Association, pages 68--78, 1951.

Crossref

Google Scholar

[8]

L. R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. In Proc. of the IEEE, volume 77, pages 257--286, 1989.

Crossref

Google Scholar

[9]

R. Rosenfeld. Two decades of statistical language modeling: Where do we go from here. In Proceedings of the IEEE, volume 88, pages 1270--1278, 2000.

Crossref

Google Scholar

[10]

H. Tischler. Introduction to Sociology. Harcourt Brace College Publishers, 1990.

Google Scholar

[11]

A. Vinciarelli, M. Pantic, and H. Bourlard. Social Signal Processing: Survey of an emerging domain. Image and Vision Computing Journal, 27(12), 2009.

Digital Library

Google Scholar

[12]

S. Wasserman and K. Faust. Social Network Analysis: Methods and Applications. Cambridge University Press, 1994.

Crossref

Google Scholar

Cited By

View all

Beyan CZunino AShahid MMurino V(2021)Personality Traits Classification Using Deep Visual Activity-Based Nonverbal Features of Key-Dynamic ImagesIEEE Transactions on Affective Computing10.1109/TAFFC.2019.294461412:4(1084-1099)Online publication date: 1-Oct-2021
https://doi.org/10.1109/TAFFC.2019.2944614
Beyan CKatsageorgiou VMurino V(2019)A Sequential Data Analysis Approach to Detect Emergent Leaders in Small GroupsIEEE Transactions on Multimedia10.1109/TMM.2019.289550521:8(2107-2116)Online publication date: Aug-2019
https://doi.org/10.1109/TMM.2019.2895505
Beyan CShahid MMurino VBoll SMu Lee KLuo JZhu WByun HWen Chen CLienhart RMei T(2018)Investigation of Small Group Social Interactions Using Deep Visual Activity-Based Nonverbal FeaturesProceedings of the 26th ACM international conference on Multimedia10.1145/3240508.3240685(311-319)Online publication date: 15-Oct-2018
https://dl.acm.org/doi/10.1145/3240508.3240685
Show More Cited By

Index Terms

Automatic role recognition in multiparty recordings using social networks and probabilistic sequential models
1. Information systems
  1. Information retrieval
    1. Document representation

Recommendations

Role recognition for meeting participants: an approach based on lexical information and social network analysis
MM '08: Proceedings of the 16th ACM international conference on Multimedia

This paper presents experiments on the automatic recognition of roles in meetings. The proposed approach combines two sources of information: the lexical choices made by people playing different roles on one hand, and the Social Networks describing the ...
Automatic role recognition in multiparty recordings: using social affiliation networks for feature extraction

Automatic analysis of social interactions attracts increasing attention in the multimedia community. This letter considers one of the most important aspects of the problem, namely the roles played by individuals interacting in different settings. In ...
Role recognition in multiparty recordings using social affiliation networks and discrete distributions
ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces

This paper presents an approach for the recognition of roles in multiparty recordings. The approach includes two major stages: extraction of Social Affiliation Networks (speaker diarization and representation of people in terms of their social ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MM '09: Proceedings of the 17th ACM international conference on Multimedia

October 2009

1202 pages

ISBN:9781605586083

DOI:10.1145/1631272

General Chairs:
Wen Gao
Peking University, China
,
Yong Rui
Microsoft, China
,
Alan Hanjalic
Delft University of Technology, The Netherlands
,
Program Chairs:
Changsheng Xu
Institute of Automation, Chinese Academy of Sciences, China
,
Eckehard Steinbach
Technical University of Munich, Germany
,
Abdulmotaleb El Saddik
University of Ottawa, Canada
,
Michelle Zhou
IBM T. J. Watson Research Center, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM09

Sponsor:

SIGMM

MM09: ACM Multimedia Conference

October 19 - 24, 2009

Beijing, China

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
154
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Beyan CZunino AShahid MMurino V(2021)Personality Traits Classification Using Deep Visual Activity-Based Nonverbal Features of Key-Dynamic ImagesIEEE Transactions on Affective Computing10.1109/TAFFC.2019.294461412:4(1084-1099)Online publication date: 1-Oct-2021
https://doi.org/10.1109/TAFFC.2019.2944614
Beyan CKatsageorgiou VMurino V(2019)A Sequential Data Analysis Approach to Detect Emergent Leaders in Small GroupsIEEE Transactions on Multimedia10.1109/TMM.2019.289550521:8(2107-2116)Online publication date: Aug-2019
https://doi.org/10.1109/TMM.2019.2895505
Beyan CShahid MMurino VBoll SMu Lee KLuo JZhu WByun HWen Chen CLienhart RMei T(2018)Investigation of Small Group Social Interactions Using Deep Visual Activity-Based Nonverbal FeaturesProceedings of the 26th ACM international conference on Multimedia10.1145/3240508.3240685(311-319)Online publication date: 15-Oct-2018
https://dl.acm.org/doi/10.1145/3240508.3240685
Bigot BFerrané IPinquier JAndré-Obrecht R(2018)Detecting individual role using features extracted from speaker diarization resultsMultimedia Tools and Applications10.1007/s11042-010-0609-960:2(347-369)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-010-0609-9
Gatica-Perez DAran OJayagopi D(2017)Analysis of Small GroupsSocial Signal Processing10.1017/9781316676202.025(349-367)Online publication date: 13-Jul-2017
https://doi.org/10.1017/9781316676202.025
Sapru ABourlard H(2015)Automatic Recognition of Emergent Social Roles in Small Group InteractionsIEEE Transactions on Multimedia10.1109/TMM.2015.240843717:5(746-760)Online publication date: May-2015
https://doi.org/10.1109/TMM.2015.2408437
Favre S(2014)Turns Analysis for Automatic Role RecognitionMobile Social Signal Processing10.1007/978-3-642-54325-8_2(9-21)Online publication date: 2014
https://doi.org/10.1007/978-3-642-54325-8_2
Dong WLepri BPianesi FPentland A(2013)Modeling Functional Roles Dynamics in Small Group InteractionsIEEE Transactions on Multimedia10.1109/TMM.2012.222503915:1(83-95)Online publication date: Jan-2013
https://doi.org/10.1109/TMM.2012.2225039
Vinciarelli APantic MHeylen DPelachaud CPoggi ID'Errico FSchroeder M(2012)Bridging the Gap between Social Animal and Unsocial MachineIEEE Transactions on Affective Computing10.1109/T-AFFC.2011.273:1(69-87)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.1109/T-AFFC.2011.27
Vinciarelli AMohammadi G(2011)Towards a Technology of Nonverbal CommunicationAffective Computing and Interaction10.4018/978-1-61692-892-6.ch007(133-156)Online publication date: 2011
https://doi.org/10.4018/978-1-61692-892-6.ch007
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Role recognition for meeting participants: an approach based on lexical information and social network analysis

Automatic role recognition in multiparty recordings: using social affiliation networks for feature extraction

Role recognition in multiparty recordings using social affiliation networks and discrete distributions