short-paper

A serious games platform for validating sonification of human full-body movement qualities

Authors:

Ksenia Kolykhalova,

Paolo Alborno,

Antonio Camurri,

Gualtiero VolpeAuthors Info & Claims

MOCO '16: Proceedings of the 3rd International Symposium on Movement and Computing

Article No.: 39, Pages 1 - 5

https://doi.org/10.1145/2948910.2948962

Published: 05 July 2016 Publication History

Get Access

Abstract

In this paper we describe a serious games platfrom for validating sonification of human full-body movement qualities. This platform supports the design and development of serious games aiming at validating (i) our techniques to measure expressive movement qualities, and (ii) the mapping strategies to translate such qualities in the auditory domain, by means of interactive sonification and active music experience. The platform is a part of a more general framework developed in the context of the EU ICT H2020 DANCE "Dancing in the dark" Project n.645553 that aims at enabling the perception of nonverbal artistic whole-body experiences to visual impaired people.

References

[1]

K. Bousmalis, L. Morency, and M. Pantic. Modeling hidden dynamics of multimodal cues for spontaneous agreement and disagreement recognition. In Automatic Face Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, pages 746--752, 2011.

Crossref

Google Scholar

[2]

K. L. C. G. Castellano, G. Multimodal emotion recognition from expressive faces, body gestures and speech. In Doctoral Consortium of ACII, Lisbon, 2007.

Google Scholar

[3]

B. R. Dubus, G. A systematic review of mapping strategies for the sonification of physical quantities. Plos One, 8(12), 2013.

Google Scholar

[4]

K. Felix Navarro, E. Lawrence, J. Garcia Marin, and C. Sax. A dynamic and customisable layered serious game design framework for improving the physical and mental health of the aged and the infirm. In Conference on eHealth, Telemedicine, and Social Medicine. IARIA Conference, 2011.

Google Scholar

[5]

T. Hermann. Taxonomy and Definitions for Sonification and Auditory Display. In P. Susini and O. Warusfel, editors, Proceedings of the 14th International Conference on Auditory Display (ICAD 2008). IRCAM, 2008.

Google Scholar

[6]

H. Hung and D. Gatica-Perez. Estimating cohesion in small groups using audio-visual nonverbal behavior. Multimedia, IEEE Transactions on, 12(6):563--575, 2010.

Digital Library

Google Scholar

[7]

G. Kramer. Auditory Display: Sonification, Audification, and Auditory Interfaces. Perseus Publishing, 1993.

Digital Library

Google Scholar

[8]

D. Lakens and M. Stel. If they move in sync, they must feel in sync: Movement synchrony leads to attribution of rapport and entitativity. Social Congnition, 29 (1):1--14, 2011.

Crossref

Google Scholar

[9]

B. Mazzarino and M. Mancini. The need for impulsivity and smoothness improving hci by qualitatively measuring new high-level human motion features. International Conference on Signal Processing and Multimedia Applications, pages 62--67, 2009.

Google Scholar

[10]

R. Niewiadomski, M. Mancini, G. Volpe, and A. Camurri. Automated detection of impulsive movements in hci. In Proceedings of the 11th Biannual Conference on Italian SIGCHI Chapter, CHItaly 2015, pages 166--169, New York, NY, USA, 2015. ACM.

Digital Library

Google Scholar

[11]

S. A. C. A. O. F. H. J. Piana, S. Adaptive body gesture representation for automatic emotion recognition. In Transactions on Interactive Intelligent System, 2015.

Digital Library

Google Scholar

[12]

M. Rehm. Non-symbolic gestural interaction for aml. In D. R.-C. A. J. Aghajan, H., editor, Human-Centric: Interface for Ambient Intelligence, pages 327--345. ACM Press, Amsterdam, The Netherlands, 2010.

Google Scholar

[13]

G. Varni, A. Camurri, P. Coletta, and G. Volpe. Toward a real-time automated measure of empathy and dominance. In Computational Science and Engineering, 2009. CSE '09. International Conference on, volume 4, pages 843--848, 2009.

Digital Library

Google Scholar

Cited By

View all

Bisig DPalacio PRomero M(2024)Translating Dance Principles Into Other ModalitiesProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678346(457-467)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678346
Luo SLiu JHu B(2024)Hearing the Bullseye: An Auditory-Cued Archery Exergame for the Visually Impaired and Their Sighted Family and FriendsCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678829(384-391)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678829
Duarte EMendoza Yde Queiroz MBaranauskas MSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)Embodiment in interactive installationsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559118(1-13)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559118
Show More Cited By

Index Terms

A serious games platform for validating sonification of human full-body movement qualities
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Seeing, Sensing and Recognizing Laban Movement Qualities
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Human movement has historically been approached as a functional component of interaction within human computer interaction. Yet movement is not only functional, it is also highly expressive. In our research, we explore how movement expertise as ...
Seeing movement qualities
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

With the increased availability of movement based interactive devices there is a growing interest in exploring the potential design space for engaging movement-based interactions. This has led to the exploration of different ways to sense and model ...
Vocalizing dance movement for interactive sonification of laban effort factors
DIS '14: Proceedings of the 2014 conference on Designing interactive systems

We investigate the use of interactive sound feedback for dance pedagogy based on the practice of vocalizing while moving. Our goal is to allow dancers to access a greater range of expressive movement qualities through vocalization. We propose a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MOCO '16: Proceedings of the 3rd International Symposium on Movement and Computing

July 2016

300 pages

ISBN:9781450343077

DOI:10.1145/2948910

Conference Chair:
Sotiris Manitsaris

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

University of Macedonia
Aristotle University of Thessaloniki
Université Paris 8: Université Paris 8

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 July 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

European Union's Horizon 2020

Conference

MOCO'16

MOCO'16: 3rd International Symposium on Movement and Computing

July 5 - 6, 2016

GA, Thessaloniki, Greece

Acceptance Rates

Overall Acceptance Rate 85 of 185 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
238
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bisig DPalacio PRomero M(2024)Translating Dance Principles Into Other ModalitiesProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678346(457-467)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678346
Luo SLiu JHu B(2024)Hearing the Bullseye: An Auditory-Cued Archery Exergame for the Visually Impaired and Their Sighted Family and FriendsCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678829(384-391)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678829
Duarte EMendoza Yde Queiroz MBaranauskas MSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)Embodiment in interactive installationsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559118(1-13)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559118
Hohagen JWöllner C(2019)Bewegungssonifikation: Psychologische Grundlagen und Auswirkungen der Verklanglichung menschlicher Handlungen in der Rehabilitation, im Sport und bei MusikaufführungenJahrbuch Musikpsychologie10.5964/jbdgm.2018v28.3628Online publication date: 28-May-2019
https://doi.org/10.5964/jbdgm.2018v28.36
Niewiadomski RMancini MCera APiana SCanepa CCamurri A(2018)Does embodied training improve the recognition of mid-level expressive movement qualities sonification?Journal on Multimodal User Interfaces10.1007/s12193-018-0284-013:3(191-203)Online publication date: 4-Dec-2018
https://doi.org/10.1007/s12193-018-0284-0
Dahl LBellona JBai LLaViers AGillies M(2017)Data-Driven Design of Sound for Enhancing the Perception of Expressive Robotic MovementProceedings of the 4th International Conference on Movement Computing10.1145/3077981.3078047(1-8)Online publication date: 28-Jun-2017
https://dl.acm.org/doi/10.1145/3077981.3078047

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Seeing, Sensing and Recognizing Laban Movement Qualities

Seeing movement qualities

Vocalizing dance movement for interactive sonification of laban effort factors