tutorial

Emotion Recognition for Exergames using Laban Movement Analysis

Authors:

Haris Zacharatos,

Christos Gatzoulis,

Yiorgos Chrysanthou,

Andreas AristidouAuthors Info & Claims

MIG '13: Proceedings of Motion on Games

Pages 61 - 66

https://doi.org/10.1145/2522628.2522651

Published: 06 November 2013 Publication History

Abstract

Exergames do not have the capacity to detect whether the players are really enjoying the game-play. The games are not intelligent enough to detect significant emotional states and adapt accordingly in order to offer a better user experience for the players. We propose a set of body motion features, based on the Effort component of Laban Movement Analysis (LMA), that are used to provide sets of classifiers for emotion recognition in a game scenario for four emotional states:concentration, meditation, excitement and frustration. Experimental results show that, the system is capable of successfully recognizing the four different emotional states at a very high rate.

References

[1]

Badler, N., Webber, B., and Phillips, C. 1993. Simulating humans. Computer Graphics, Animation and Control, Oxford Univ Press.

Digital Library

[2]

Busso, C., Deng, Z., Yildirim, S., and Bulut, M. 2004. Analysis of emotion recognition using facial expressions, speech and multimodal information. 6th international conference on Multimodal interfaces (ICMI '04).ACM, New York, NY, USA, 205--211.

Digital Library

[3]

Camurri, A., Mazzarino, B., Ricchetti, M., Timmers, R., and Volpe, G. 2004. Multimodal analysis of expressive gesture in music and dance performances. Gesture-Based Communication Human-Computer Interactions, 59--70.

[4]

Castellano, G., Villalba, S., and Camurri, A. 2007. Recognising human emotions from body movement and gesture dynamics. Affective Computing and Intelligence Interaction, LNCS 4738, 71--82.

Digital Library

[5]

Chen, J., Lin, W., Tsai, K., and Dai, S. 2011. Analysis and evaluation of human movement based on laban movement analysis. Tamkang Journal of Science and Engineering 13, 3, 255--264.

[6]

Fasela, B., and Luettin, J. 2003. Automatic facial expression analysis: a survey. 259--275.

[7]

Gao, Y., and Mandryk, R. 2012. The acute cognitive benefits of casual exergame play. In CHI '12: Proceedings of the 30th international conference on Human factors in computing systems., Austin, Texas, USA., 1863--1872.

Digital Library

[8]

Gerling, K., Schild, J., and Masuch, M. 2010. Exergame design for elderly users: the case study of silverbalance. 7th International Conference on Advances in Computer Entertainment Technology (ACE '10). ACM, New York, NY, USA, 66--69.

Digital Library

[9]

Goldman, A., and Sripada, C. 2005. Simulationist models of face-based emotion recognition. Cognition 94, 3, 193--213.

[10]

Hall, M., Frank, E., and Holmes, G. 2009. The weka data mining software an update. SIGKDD Explorations 11, 1.

Digital Library

[11]

Isbister, K., Rao, R., Schwekendiek, U., Hayward, E., and Lidasan, J. 2011. Is more movement better?: a controlled comparison of movement-based games. 6th International Conference on Foundations of Digital Games ACM, New York, NY, USA, 331--333.

Digital Library

[12]

Isbister, K., Karlesky, M., Frye, J., and Rao, R. 2012. Scoop!: using movement to reduce math anxiety and affect confidence. the International Conference on the Foundations of Digital Games ACM, New York, NY, USA, 228--230.

Digital Library

[13]

Kiili, K., and Merilampi, S. 2010. Developing engaging exergames with simple motion detection. 14th International Academic MindTrek Conference: Envisioning Future Media Environments ACM, New York, NY, USA, 103--110.

Digital Library

[14]

Laban, R. 1974. The Language of Movement: A Guidebook to Choreutics. Plays, Boston, Mass, USA.

[15]

Lourens, T., Berkel, R., and Barakova, E. 2010. Communicating emotions and mental states to robots in a real time parallel framework using laban movement analysis. Robot. Autonomus Systems 58, 12, 1256--1265.

Digital Library

[16]

Maletic, V. 2005. Dance dynamics: Effort and phrasing.

[17]

Masuda, M., Kato, S., and Itoh, H. 2009. Emotion detection from body motion of human form robot based on laban movement analysis. Principles of Practice in Multi-Agent Systems, 12th International Conference, Nagoya, Japan.

Digital Library

[18]

Masuda, M., Kato, S., and Itoh, H. 2010. Laban-based motion rendering for emotional expression of human form robots. PKAW, LNAI, 6232, 49--60.

Digital Library

[19]

MICROSOFT. Kinect controller for xbox360: http://www.xbox.com/en-us/kinect.

[20]

Nakata, T., Mori, T., and Sato, T. 2002. Analysis of impression of robot bodily expression. Journal of Robotics and Mechatronics, 14, 27--36.

[21]

Okajima, S., Wakayama, Y., and Okada, Y. 2012. Human motion retrieval system based on lma features using interactive evolutionary computation method. Innovations in Intelligent Machines SCI, 376, 117--130.

[22]

Papastergiou, M. 2009. Exploring the potential of computer and video games for health and physical education: A literature review. Computers and Education, 53, 603--622.

Digital Library

[23]

Santos, L., Prado, J., and Dias, J. 2009. Human robot interaction studies on laban human movement analysis and dynamic background segmentation. IEEE international conference on robots and systems.

Digital Library

[24]

Savva, N., Scarinzi, A., and Bianchi-Berthouze, N. 2012. Continuous recognition of player's affective body expression as dynamic quality of aesthetic experience. IEEE Transactions on Computational Intelligence and AI in Games 4, 3.

[25]

Ververidis, D., and Kotropoulos, C. 2006. Emotional speech recognition: Resources, features, and methods. 1162--1181.

[26]

Zhao, L., and Badler, N. 2005. Acquiring and validating motion qualities from live limb gestures. Graphical Models 67, 1, 1--16.

Digital Library

[27]

Zhao, L. 2002. Synthesis and acquisition of laban movement analysis qualitive parameters for communicative gestures. PhD thesis, University of Pennsylvania.

Digital Library

Cited By

Sarupuri BKulpa RAristidou AMulton F(2024)Dancing in virtual reality as an inclusive platform for social and physical fitness activities: a surveyThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-03068-640:6(4055-4070)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1007/s00371-023-03068-6
Mahfoudi MMeyer AGaudin TBuendia ABouakaz S(2023)Emotion Expression in Human Body Posture and Movement: A Survey on Intelligible Motion Factors, Quantification and ValidationIEEE Transactions on Affective Computing10.1109/TAFFC.2022.322625214:4(2697-2721)Online publication date: 1-Oct-2023
https://doi.org/10.1109/TAFFC.2022.3226252
Shafir T(2023)Modeling Emotion Perception from Body Movements for Human-Machine Interactions Using Laban Movement AnalysisModeling Visual Aesthetics, Emotion, and Artistic Style10.1007/978-3-031-50269-9_18(313-330)Online publication date: 25-Nov-2023
https://doi.org/10.1007/978-3-031-50269-9_18
Show More Cited By

Index Terms

Emotion Recognition for Exergames using Laban Movement Analysis
1. Applied computing
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
    1. Image manipulation

Recommendations

Seeing, Sensing and Recognizing Laban Movement Qualities
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Human movement has historically been approached as a functional component of interaction within human computer interaction. Yet movement is not only functional, it is also highly expressive. In our research, we explore how movement expertise as ...
Multitask learning for Laban movement analysis
MOCO '15: Proceedings of the 2nd International Workshop on Movement and Computing

This paper presents the results of a multitask learning method for recognition of Laban Movement Analysis (LMA) qualities from a markerless motion capture camera. LMA is a well-accepted method for describing, interpreting and documenting human movement ...
Communicating emotions and mental states to robots in a real time parallel framework using Laban movement analysis

This paper presents a parallel real time framework for emotions and mental states extraction and recognition from video fragments of human movements. In the experimental setup human hands are tracked by evaluation of moving skin-colored objects. The ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MIG '13: Proceedings of Motion on Games

November 2013

30 pages

ISBN:9781450325462

DOI:10.1145/2522628

Conference Chair:
Rachel McDonnell
Trinity College Dublin, Ireland
,
Program Chairs:
Nathan Sturtevant
University of Denver
,
Victor Zordan
University of California Riverside

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Tutorial
Research
Refereed limited

Conference

MIG '13

Sponsor:

SIGGRAPH

MIG '13: Motion in Games

November 6 - 8, 2013

Dublin 2, Ireland

Acceptance Rates

MIG '13 Paper Acceptance Rate -9 of -9 submissions, 100%;

Overall Acceptance Rate -9 of -9 submissions, 100%

Upcoming Conference

MIG '24

Sponsor:
siggraph

The 17th ACM SIGGRAPH Conference on Motion, Interaction, and Games

November 21 - 23, 2024

Arlington , VA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
590
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)1

Reflects downloads up to 30 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sarupuri BKulpa RAristidou AMulton F(2024)Dancing in virtual reality as an inclusive platform for social and physical fitness activities: a surveyThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-03068-640:6(4055-4070)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1007/s00371-023-03068-6
Mahfoudi MMeyer AGaudin TBuendia ABouakaz S(2023)Emotion Expression in Human Body Posture and Movement: A Survey on Intelligible Motion Factors, Quantification and ValidationIEEE Transactions on Affective Computing10.1109/TAFFC.2022.322625214:4(2697-2721)Online publication date: 1-Oct-2023
https://doi.org/10.1109/TAFFC.2022.3226252
Shafir T(2023)Modeling Emotion Perception from Body Movements for Human-Machine Interactions Using Laban Movement AnalysisModeling Visual Aesthetics, Emotion, and Artistic Style10.1007/978-3-031-50269-9_18(313-330)Online publication date: 25-Nov-2023
https://doi.org/10.1007/978-3-031-50269-9_18
Papillon MPettee MMiolane N(2023)PirouNet: Creating Dance Through Artist-Centric Deep LearningArtsIT, Interactivity and Game Creation10.1007/978-3-031-28993-4_31(447-465)Online publication date: 2-Apr-2023
https://doi.org/10.1007/978-3-031-28993-4_31
Lee KPark YHuh JKang JLee S(2022)Self-Updatable Database System Based on Human Motion Assessment FrameworkIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2022.317843032:10(7160-7176)Online publication date: Oct-2022
https://doi.org/10.1109/TCSVT.2022.3178430
Javeed MChelloug S(2022)Automated Gestures Recognition in Exergaming2022 International Conference on Electrical Engineering and Sustainable Technologies (ICEEST)10.1109/ICEEST56292.2022.10077853(1-6)Online publication date: 14-Dec-2022
https://doi.org/10.1109/ICEEST56292.2022.10077853
Raimbaud PJovane AZibrek KPacchierotti CChristie MHoyet LPettré JOlivier A(2021)Reactive Virtual AgentsProceedings of the 21st ACM International Conference on Intelligent Virtual Agents10.1145/3472306.3478351(164-166)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3472306.3478351
Zacharatos HGatzoulis CCharalambous PChrysanthou Y(2021)Emotion Recognition from 3D Motion Capture Data using Deep CNNs2021 IEEE Conference on Games (CoG)10.1109/CoG52621.2021.9619065(1-5)Online publication date: 17-Aug-2021
https://doi.org/10.1109/CoG52621.2021.9619065
Barathi SProulx MO'Neill ELutteroth CBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Affect Recognition using Psychophysiological Correlates in High Intensity VR ExergamingProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376596(1-15)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376596
Albuainain AGatzoulis C(2020)Reinforcement Learning for Physics-Based Competitive Games2020 International Conference on Innovation and Intelligence for Informatics, Computing and Technologies (3ICT)10.1109/3ICT51146.2020.9311997(1-6)Online publication date: 20-Dec-2020
https://doi.org/10.1109/3ICT51146.2020.9311997
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents