The Motion Augmented Acoustic Skate (MAAS) System: A Device for Real-Time Figure Skating Sonification
Article No.: 23, Pages 1 - 6
Abstract
This paper presents a device that transforms a skate’s sound and motion into a real-time auditory tool for figure skaters. Inspired by the skating tradition of “figures,” the Motion Augmented Acoustic Skate system enhances a skate’s existing acoustic feedback for non-jumping implementations. Using a contact microphone, an Inertial Measurement Unit (IMU), a radio transmitter, and a Wi-Fi microcontroller, the system wirelessly transmits sound and motion to an off-ice computer for signal processing. The resulting sonification output, altered through physical modeling and motion mappings, transmits back to the skater in real-time. The design and implementation of the Motion Augmented Acoustic Skate (MAAS) prototype is discussed as a future artistic, athletic, and somatic tool.
Supplemental Material
MP4 File
Video 1 Video 2 Video 3
- Download
- 203.70 MB
MP4 File
Video 1 Video 2 Video 3
- Download
- 139.20 MB
MP4 File
Video 1 Video 2 Video 3
- Download
- 729.72 MB
References
[1]
Samuel Acuña, D Smith, J Robinson, J Hawks, Philip Starbuck, Deborah King, Sarah Ridge, and S Charles. 2014. Instrumented figure skating blade for measuring on-ice skating forces. Measurement Science and Technology 25 (10 2014), 125901. https://doi.org/10.1088/0957-0233/25/12/125901
[2]
Tiziano Agostini, Giovanni Righi, Alessandra Galmonte, and Paolo Bruno. 2004. The relevance of auditory information in optimizing hammer throwers performance. In Biomechanics and sports: Proceedings of the XI Winter Universiads 2003. Springer, 67–74.
[3]
Adobe Audition. 2020. Sound Effects. https://www.adobe.com/products/audition/offers/AdobeAuditionDLCSFX.html
[4]
Dustin A. Bruening, Riley Reynolds, Chris Adair, Peter Zapalo, and Sarah T Ridge. 2018. A sport-specific wearable jump monitor for figure skating. PLoS ONE 13 (2018). https://api.semanticscholar.org/CorpusID:53718770
[5]
Paola Cesari, Ivan Camponogara, Stefano Papetti, Davide Rocchesso, and Federico Fontana. 2014. Might as well jump: sound affects muscle activation in skateboarding. PLoS One 9, 3 (2014), e90156.
[6]
Andrea Giomi. 2020. Somatic Sonification in Dance Performances. From the Artistic to the Perceptual and Back. In Proceedings of the 7th International Conference on Movement and Computing (Jersey City/Virtual, NJ, USA) (MOCO ’20). Association for Computing Machinery, New York, NY, USA, Article 7, 8 pages. https://doi.org/10.1145/3401956.3404226
[7]
J.R. Hines, World Figure Skating Museum, and Hall of Fame. 2006. Figure Skating: A History. University of Illinois Press. https://books.google.com/books?id=7QeCAAAAMAAJ
[8]
Andy Hunt and Thomas Hermann. 2011. Interactive Sonification. In The Sonification Handbook, Thomas Hermann, Andy Hunt, and John Neuhoff (Eds.). Chapter 11, 273–298.
[9]
IRCAM. 2023. Modalys 3.8.1. https://forum.ircam.fr/projects/detail/modalys/
[10]
C. Justen, C. Herbert, K. Werner, and M. Raab. 2014. Self vs. other: Neural correlates underlying agent identification based on unimodal auditory information as revealed by electrotomography (sLORETA). Neuroscience 259 (2014), 25–34. https://doi.org/10.1016/j.neuroscience.2013.11.042
[11]
Christian Kennel, Tanja Hohmann, and Markus Raab. 2014. Action perception via auditory information: Agent identification and discrimination with complex movement sounds. Journal of Cognitive Psychology 26 (02 2014), 157–165. https://doi.org/10.1080/20445911.2013.869226
[12]
Christian Kennel, Alexandra Pizzera, Tanja Hohmann, Ricarda Ines Schubotz, Mauro Murgia, Tiziano Agostini, and Markus Raab. 2014. The Perception of Natural and Modulated Movement Sounds. Perception 43, 8 (2014), 796–804. https://doi.org/10.1068/p7643 arXiv:https://doi.org/10.1068/p7643PMID: 25549509.
[13]
Christian Kennel, Lukas Streese, Alexandra Pizzera, Christoph Justen, Tanja Hohmann, and Markus Raab. 2015. Auditory reafferences: the influence of real-time feedback on movement control. Frontiers in Psychology 6 (2015). https://doi.org/10.3389/fpsyg.2015.00069
[14]
E. Kestnbaum. 2003. Culture on Ice: Figure Skating & Cultural Meaning. Wesleyan University Press. https://books.google.com/books?id=RrVPBjE–00C
[15]
Gregory Kramer, Bruce Walker, Terri L. Bonebright, Perry R. Cook, John H. Flowers, Nadine E. Miner, John G. Neuhoff, Robin Bargar, Stephen Barrass, Jonathan Berger, Grigori E. Evreinov, W. Tecumseh Fitch, Matti T. Gröhn, Steve Handel, Hans G. Kaper, Haim Levkowitz, Suresh K. Lodha, Barbara G. Shinn-Cunningham, Mary Simoni, and Sever Tipei. 1999. Sonification Report: Status of the Field and Research Agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display. https://api.semanticscholar.org/CorpusID:2927531
[16]
Daniel J. Levitin, Karon MacLean, Max Mathews, Lonny Chu, and Eric Jensen. 2000. The perception of cross-modal simultaneity (or “the Greenwich Observatory Problem” revisited). AIP Conference Proceedings 517, 1 (05 2000), 323–329. https://doi.org/10.1063/1.1291270 arXiv:https://pubs.aip.org/aip/acp/article-pdf/517/1/323/12195085/323_1_online.pdf
[17]
Steve Mann, Ryan Janzen, and Raymond Lo. 2008. Hyperacoustic instruments: Computer-controlled instruments that are not electrophones. In 2008 IEEE International Conference on Multimedia and Expo. 89–92. https://doi.org/10.1109/ICME.2008.4607378
[18]
Fritz Menzer, Anna Brooks, Pär Halje, Christof Faller, Martin Vetterli, and Olaf Blanke. 2010. Feeling in control of your footsteps: Conscious gait monitoring and the auditory consequences of footsteps. Cognitive neuroscience 1 (09 2010), 184–92. https://doi.org/10.1080/17588921003743581
[19]
Mauro Murgia, Tanja Hohmann, Alessandra Galmonte, Markus Raab, and Tiziano Agostini. 2012. Recognising one’s own motor actions through sound: the role of temporal factors. Perception 41, 8 (2012), 976–987.
[20]
Alexandra Pizzera, Tanja Hohmann, Lukas Streese, Anja Habbig, and Markus Raab. 2017. Long-term effects of acoustic reafference training (ART). European Journal of Sport Science 17 (2017), 1279 – 1288. https://api.semanticscholar.org/CorpusID:3456509
[21]
Sarah Ridge, Dustin Bruening, Steven Charles, Cody Stahl, Daniel Smith, Riley Reynolds, Brandon Adamo, Blake Harper, Chris Adair, Preston Manwaring, and Deborah King. 2020. IceSense Proof of Concept: Calibrating an Instrumented Figure Skating Blade to Measure On-Ice Forces. Sensors 20 (12 2020), 7082. https://doi.org/10.3390/s20247082
[22]
Yi ru Wang and Yu Sun. 2023. An Intelligent and Data-Based Skate Analyzer to Assist in Analyzing Movements of Skate on Ice. Computer Science, Engineering and Applications (2023). https://api.semanticscholar.org/CorpusID:257816600
[23]
Karsten Schaefer, Niklas Brown, and Wilfried Alt. 2016. MlSSlE - A NEW METHOD TO ANALYSE PERFORMANCE PARAMETERS OF FIGURE SKATING JUMPS. https://api.semanticscholar.org/CorpusID:114792518
[24]
Nina Schaffert, Thenille Braun Janzen, Klaus Mattes, and Michael H. Thaut. 2019. A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation. Frontiers in Psychology 10 (2019). https://doi.org/10.3389/fpsyg.2019.00244
[25]
Nina Schaffert, Benedict Oldag, and Paola Cesari. 2020. Sound matters: The impact of auditory deprivation on movement precision in rowing. European Journal of Sport Science 20 (2020), 1299 – 1306. https://api.semanticscholar.org/CorpusID:209893471
[26]
Yuchen Shi, Atsushi Ozaki, and Masaaki Honda. 2020. Kinematic Analysis of Figure Skating Jump by Using Wearable Inertial Measurement Units. Proceedings 49, 1 (2020). https://doi.org/10.3390/proceedings2020049124
[27]
Fabrizio Sors, Mauro Murgia, Ilaria Santoro, and Tiziano Agostini. 2015. Audio-Based Interventions in Sport. The Open Psychology Journal 8 (12 2015), 212–219. https://doi.org/10.2174/1874350101508010212
[28]
Jelle Stienstra, Kees Overbeeke, and Stephan Wensveen. 2011. Embodying Complexity through Movement Sonification: Case Study on Empowering the Speed-Skater. In Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction: Facing Complexity (Alghero, Italy) (CHItaly ’11). Association for Computing Machinery, New York, NY, USA, 39–44. https://doi.org/10.1145/2037296.2037310
[29]
Tatsuto Takeuchi. 1993. Auditory Information in Playing Tennis. Perceptual and Motor Skills 76, 3_suppl (1993), 1323–1328. https://doi.org/10.2466/pms.1993.76.3c.1323 arXiv:https://doi.org/10.2466/pms.1993.76.3c.1323PMID: 8337086.
[30]
Limao Tian, Xina Cheng, Masaaki Honda, and Takeshi Ikenaga. 2022. Multi-view 3D human pose reconstruction based on spatial confidence point group for jump analysis in figure skating. Complex ’I&’ Intelligent Systems 9 (08 2022). https://doi.org/10.1007/s40747-022-00837-z
[31]
Vincent van Rheden, Thomas Grah, and Alexander Meschtscherjakov. 2020. Sonification Approaches in Sports in the Past Decade: A Literature Review. In Proceedings of the 15th International Audio Mostly Conference (Graz, Austria) (AM ’20). Association for Computing Machinery, New York, NY, USA, 199–205. https://doi.org/10.1145/3411109.3411126
Index Terms
- The Motion Augmented Acoustic Skate (MAAS) System: A Device for Real-Time Figure Skating Sonification
Recommendations
Real-Time Optical Motion Capture Balance Sonification System
MOCO '20: Proceedings of the 7th International Conference on Movement and ComputingIn this study, we explored the effects of a motion capture-based real-time sonified biofeedback system on balance. We present the initial efforts towards developing a task-independent optical motion capture based real-time balance sonification system. ...
Examining effects of acoustic feedback on perception and modification of movement patterns in on-water rowing training
AM '11: Proceedings of the 6th Audio Mostly Conference: A Conference on Interaction with SoundThis paper describes a concept for providing acoustic feedback during on-water training to elite rowers and its implementation into the training process. The final aim was to improve the mean boat velocity by a reduction of intra-cyclic interruptions in ...
Making Movement Sonification Usable in Clinical Gait Rehabilitation: A User-Centered Study
AM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic CulturesSound-assisted movement rehabilitation is one of the most interesting and socially relevant applications of sonic interaction research, and existing research shows the potential of movement sonification to enhance patient motivation and movement re-...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Data Availability
Video 1 Video 2 Video 3 https://dl.acm.org/doi/10.1145/3658852.3658877#MAAS-Video1-MOCO24.mp4
Video 1 Video 2 Video 3 https://dl.acm.org/doi/10.1145/3658852.3658877#MAAS-Video2-MOCO24.mp4
Video 1 Video 2 Video 3 https://dl.acm.org/doi/10.1145/3658852.3658877#MAAS-Video3-MOCO24.mp4
Conference
MOCO '24
MOCO '24: 9th International Conference on Movement and Computing
May 30 - June 2, 2024
Utrecht, Netherlands
Acceptance Rates
MOCO '24 Paper Acceptance Rate 35 of 75 submissions, 47%;
Overall Acceptance Rate 85 of 185 submissions, 46%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 22Total Downloads
- Downloads (Last 12 months)22
- Downloads (Last 6 weeks)5
Reflects downloads up to 18 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format