research-article

Clustering of Physiological Signals by Emotional State, Race, and Sex

Authors:

Shaun CanavanAuthors Info & Claims

ICMI '21 Companion: Companion Publication of the 2021 International Conference on Multimodal Interaction

Pages 312 - 316

https://doi.org/10.1145/3461615.3486567

Published: 17 December 2021 Publication History

Abstract

In this work, we explore the emotional responses to ten stimuli reflecting real-world experiences captured via physiological signals from 140 individuals. We employ the DBSCAN clustering algorithm to these data, and show that blood pressure and electrodermal activity may be indicative of race, and blood pressure of sex and emotional state. These findings could lead to important innovations, particularly those valuable for certain demographic groups, including, for example, culturally relevant robotics and cultural awareness in education by improving real-time measurements of stress and cognitive load.

References

[1]

Peerzada Hamid Ahmad and Shilpa Dang. 2015. Performance evaluation of clustering algorithm using different datasets. International Journal of Advance Research in Computer Science and Management Studies 3(2015), 167–173.

[2]

Arline D. Bohannon, Gerda G. Fillenbaum, Carl F. Pieper, Joseph T. Hanlon, and Dan G. Blazer. 2002. Relationship of Race/Ethnicity and Blood Pressure to Change in Cognitive Function. Journal of the American Geriatrics Society 50, 3 (2002), 424–429. https://doi.org/10.1046/j.1532-5415.2002.50104.x arXiv:https://agsjournals.onlinelibrary.wiley.com/doi/pdf/10.1046/j.1532-5415.2002.50104.x

[3]

Joshua M Dudik, Atsuko Kurosu, James L Coyle, and Ervin Sejdić. 2015. A comparative analysis of DBSCAN, K-means, and quadratic variation algorithms for automatic identification of swallows from swallowing accelerometry signals. Computers in biology and medicine 59 (2015), 10–18.

[4]

Paul Ekman, Wallace V Friesen, Maureen O’sullivan, Anthony Chan, Irene Diacoyanni-Tarlatzis, Karl Heider, Rainer Krause, William Ayhan LeCompte, Tom Pitcairn, Pio E Ricci-Bitti, 1987. Universals and cultural differences in the judgments of facial expressions of emotion.Journal of personality and social psychology 53, 4(1987), 712.

[5]

Hillary Anger Elfenbein and Nalini Ambady. 2003. When familiarity breeds accuracy: cultural exposure and facial emotion recognition.Journal of personality and social psychology 85, 2(2003), 276.

[6]

Hillary Anger Elfenbein, Martin Beaupré, Manon Lévesque, and Ursula Hess. 2007. Toward a dialect theory: cultural differences in the expression and recognition of posed facial expressions.Emotion 7, 1 (2007), 131.

[7]

Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd, Vol. 96. 226–231.

[8]

Keith C Ferdinand and Annemarie M Armani. 2007. The management of hypertension in African Americans. Critical pathways in cardiology 6, 2 (2007), 67–71.

[9]

John M Flack, Brian A Ference, and Phillip Levy. 2014. Should African Americans with hypertension be treated differently than non-African Americans?Current hypertension reports 16, 1 (2014), 409.

[10]

John M Flack, Samar A Nasser, and Phillip D Levy. 2011. Therapy of hypertension in African Americans. American Journal of Cardiovascular Drugs 11, 2 (2011), 83–92.

[11]

Manisha Naik Gaonkar and Kedar Sawant. 2013. AutoEpsDBSCAN: DBSCAN with Eps automatic for large dataset. International Journal on Advanced Computer Theory and Engineering 2, 2(2013), 11–16.

[12]

James J Gross and Oliver P John. 1995. Facets of emotional expressivity: Three self-report factors and their correlates. Personality and individual differences 19, 4 (1995), 555–568.

[13]

Natasha Jaques, Sara Taylor, Asaph Azaria, Asma Ghandeharioun, Akane Sano, and Rosalind Picard. 2015. Predicting students’ happiness from physiology, phone, mobility, and behavioral data. In 2015 International Conference on Affective Computing and Intelligent Interaction (ACII). 222–228. https://doi.org/10.1109/ACII.2015.7344575

Digital Library

[14]

Yuhao Kang, Qingyuan Jia, Song Gao, Xiaohuan Zeng, Yueyao Wang, Stephan Angsuesser, Yu Liu, Xinyue Ye, and Teng Fei. 2019. Extracting human emotions at different places based on facial expressions and spatial clustering analysis. Transactions in GIS 23, 3 (2019), 450–480. https://doi.org/10.1111/tgis.12552 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/tgis.12552

[15]

Ali Abdul Khaliq, Uwe Köckemann, Federico Pecora, Alessandro Saffiotti, Barbara Bruno, Carmine Tommaso Recchiuto, Antonio Sgorbissa, Ha-Duong Bui, and Nak Young Chong. 2018. Culturally aware Planning and Execution of Robot Actions. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 326–332. https://doi.org/10.1109/IROS.2018.8593570

Digital Library

[16]

DA Lane and P Gill. 2004. Ethnicity and tracking blood pressure in children. Journal of human hypertension 18, 4 (2004), 223–228.

[17]

Kim Hyeon Chang Ahn Song Vogue Khaw Kay-Tee Suh Il Lee Myung Ha, Kang Dae Ryong. 2014. A 24-Year Follow-Up Study of Blood Pressure Tracking from Childhood to Adulthood in Korea: The Kangwha Study. ymj 55, 2 (2014), 360–366. https://doi.org/10.3349/ymj.2014.55.2.360 arXiv:http://www.e-sciencecentral.org/articles/?scid=1031468

[18]

Supawit Marerngsit and Sotarat Thammaboosadee. 2020. A Two-Stage Text-to-Emotion Depressive Disorder Screening Assistance based on Contents from Online Community. In 2020 8th International Electrical Engineering Congress (iEECON). 1–4. https://doi.org/10.1109/iEECON48109.2020.229524

[19]

David Matsumoto. 1993. Ethnic differences in affect intensity, emotion judgments, display rule attitudes, and self-reported emotional expression in an American sample. Motivation and emotion 17, 2 (1993), 107–123.

[20]

Sumie Okazaki. 1997. Sources of ethnic differences between Asian American and White American college students on measures of depression and social anxiety.Journal of Abnormal Psychology 106, 1 (1997), 52.

[21]

Ellen E Pinderhughes, Kenneth A Dodge, John E Bates, Gregory S Pettit, and Arnaldo Zelli. 2000. Discipline responses: influences of parents’ socioeconomic status, ethnicity, beliefs about parenting, stress, and cognitive-emotional processes.Journal of family psychology 14, 3 (2000), 380.

[22]

Kenneth M Prkachin, Rhonda M Williams-Avery, Caroline Zwaal, and David E Mills. 1999. Cardiovascular changes during induced emotion: An application of Lang’s theory of emotional imagery. Journal of psychosomatic research 47, 3 (1999), 255–267.

[23]

Andrés Ovidio Restrepo Rodríguez, Maddyzeth Ariza Riaño, Paulo Alonso Gaona García, Carlos Enrique Montenegro Marín, Rubén González Crespo, and Xing Wu. 2020. Emotional characterization of children through a learning environment using learning analytics and AR-Sandbox. Journal of Ambient Intelligence and Humanized Computing 11, 11(2020), 5353–5367.

[24]

Øyvind Sandbakk, Gertjan Ettema, Stig Leirdal, and Hans-Christer Holmberg. 2012. Gender differences in the physiological responses and kinematic behaviour of elite sprint cross-country skiers. European journal of applied physiology 112, 3 (2012), 1087–1094.

[25]

Akane Sano, Andrew J. Phillips, Amy Z. Yu, Andrew W. McHill, Sara Taylor, Natasha Jaques, Charles A. Czeisler, Elizabeth B. Klerman, and Rosalind W. Picard. 2015. Recognizing academic performance, sleep quality, stress level, and mental health using personality traits, wearable sensors and mobile phones. In 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN). 1–6. https://doi.org/10.1109/BSN.2015.7299420

[26]

Klaus R Scherer, Rainer Banse, and Harald G Wallbott. 2001. Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-cultural psychology 32, 1 (2001), 76–92.

[27]

Jose Angel Soto and Robert W Levenson. 2009. Emotion recognition across cultures: the influence of ethnicity on empathic accuracy and physiological linkage.Emotion 9, 6 (2009), 874.

[28]

Feng-Tso Sun, Cynthia Kuo, Heng-Tze Cheng, Senaka Buthpitiya, Patricia Collins, and Martin Griss. 2012. Activity-Aware Mental Stress Detection Using Physiological Sensors. In Mobile Computing, Applications, and Services, Martin Grisand Guang Yang (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 282–301.

[29]

Veronica Y. Womack, Christine V. Wood, Stephanie C. House, Sandra C. Quinn, Stephen B. Thomas, Richard McGee, and Angela Byars-Winston. 2020. Culturally aware mentorship: Lasting impacts of a novel intervention on academic administrators and faculty. PLOS ONE 15, 8 (08 2020), 1–17. https://doi.org/10.1371/journal.pone.0236983

[30]

Z. Zhang, J. M. Girard, Y. Wu, X. Zhang, P. Liu, U. Ciftci, S. Canavan, M. Reale, A. Horowitz, H. Yang, J. F. Cohn, Q. Ji, and L. Yin. 2016. Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3438–3446. https://doi.org/10.1109/CVPR.2016.374

Cited By

Zohdi HNatale LScholkmann FWolf U(2022)Intersubject Variability in Cerebrovascular Hemodynamics and Systemic Physiology during a Verbal Fluency Task under Colored Light Exposure: Clustering of Subjects by Unsupervised Machine LearningBrain Sciences10.3390/brainsci1211144912:11(1449)Online publication date: 27-Oct-2022
https://doi.org/10.3390/brainsci12111449
Kunc D(2022)Unsupervised learning for physiological signals in real-life emotion recognition using wearables2022 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)10.1109/ACIIW57231.2022.10086004(1-5)Online publication date: 18-Oct-2022
https://doi.org/10.1109/ACIIW57231.2022.10086004
Zanna KSridhar KYu HSano A(2022)Bias Reducing Multitask Learning on Mental Health Prediction2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII55700.2022.9953850(1-8)Online publication date: 18-Oct-2022
https://doi.org/10.1109/ACII55700.2022.9953850

Index Terms

Clustering of Physiological Signals by Emotional State, Race, and Sex
1. Applied computing
2. Computing methodologies
  1. Machine learning
    1. Learning paradigms
      1. Unsupervised learning

Index terms have been assigned to the content through auto-classification.

Recommendations

Emotion Recognition Using Physiological Signals
MIDI '15: Proceedings of the Mulitimedia, Interaction, Design and Innnovation

In this paper the problem of emotion recognition using physiological signals is presented. Firstly the problems with acquisition of physiological signals related to specific human emotions are described. It is not a trivial problem to elicit real ...
Do Emotional States Influence Physiological Pain Responses?
Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
Abstract
Pain is a highly subjective and complex phenomenon. Current methods used to measure pain mostly rely on the patient’s description, which may not always be possible. This way, pain recognition systems based on body language and physiological ...
Analysis of the Sex Difference on Negative Emotions among Adolescents
IC4E '21: Proceedings of the 2021 12th International Conference on E-Education, E-Business, E-Management, and E-Learning

Numerous previous studies, either neural based or behavioral based, focused on the sex difference on responses to negative emotions, and received prominent results. However, literature particularly focusing on adolescents’ emotional situation is nearly ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '21 Companion: Companion Publication of the 2021 International Conference on Multimodal Interaction

October 2021

418 pages

ISBN:9781450384711

DOI:10.1145/3461615

Editors:
Zakia Hammal
Carnegie Mellon University
,
Carlos Busso
University of Texas at Dallas
,
Catherine Pelachaud
CNRS - ISIR, Sorbonne University
,
Sharon Oviatt
Monash University
,
Albert Ali Salah
Utrecht University and Boğaziçi University
,
Guoying Zhao
University of Oulu

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 December 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICMI '21

Sponsor:

SIGCHI

ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 18 - 22, 2021

QC, Montreal, Canada

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
78
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)1

Reflects downloads up to 20 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zohdi HNatale LScholkmann FWolf U(2022)Intersubject Variability in Cerebrovascular Hemodynamics and Systemic Physiology during a Verbal Fluency Task under Colored Light Exposure: Clustering of Subjects by Unsupervised Machine LearningBrain Sciences10.3390/brainsci1211144912:11(1449)Online publication date: 27-Oct-2022
https://doi.org/10.3390/brainsci12111449
Kunc D(2022)Unsupervised learning for physiological signals in real-life emotion recognition using wearables2022 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)10.1109/ACIIW57231.2022.10086004(1-5)Online publication date: 18-Oct-2022
https://doi.org/10.1109/ACIIW57231.2022.10086004
Zanna KSridhar KYu HSano A(2022)Bias Reducing Multitask Learning on Mental Health Prediction2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII55700.2022.9953850(1-8)Online publication date: 18-Oct-2022
https://doi.org/10.1109/ACII55700.2022.9953850

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents