Synchronization in games sound: an audiovisual study on player experience and performance
Authors: 
Yu Chen, 
Tian Min, Juntao Zhao, 
Wei CaiAuthors Info & Claims
Pages 22 - 28
Abstract
The asynchronous perception is one of the critical factors in the game experience. It includes temporal asynchrony in the game elements and interaction. The aesthetic coherence is also a part of the synchronous perception. There are emerging studies on asynchronous perception as the rising of the next generation gaming platform. We conducted two studies in this paper. First, we investigated the sensitivity of human perception to the asynchronous audiovisual and analyzed how the audiovisual content affects the perception. Then, we further explored the in-game asynchronous perception, focusing on the asynchronous sound effect and background music. The result indicates that the ability to distinguish the asynchronous audiovisual is a normal distribution among the people, and the in-game asynchronous sound will reduce the overall performance and experience, especially in the tempi of the background music.
References
[1]
[n.d.]. Googole Stadia. http://https://stadia.google.com/. Accessed 17 Feb. 2021.
[2]
[n.d.]. Steam Best Soundtrack Award. https://store.steampowered.com/steamawards#BestSoundtrack. Accessed 17 Feb. 2021.
[3]
Claudia Amezcua, Miguel Angel Guevara, and Julieta Ramos-Loyo. 2005. Effects of musical tempi on visual attention ERPs. International journal of neuroscience 115, 2 (2005), 193--206.
[4]
Mark H Anshel and Dan Q Marisi. 1978. Effect of music and rhythm on physical performance. Research Quarterly. American Alliance for Health, Physical Education and Recreation 49, 2 (1978), 109--113.
[5]
Wei Cai, Ryan Shea, Chun-Ying Huang, Kuan-Ta Chen, Jiangchuan Liu, Victor CM Leung, and Cheng-Hsin Hsu. 2016. The future of cloud gaming [point of view]. Proc. IEEE 104, 4 (2016), 687--691.
[6]
Jiulin Zhang Xiaoqing Fu. 2015. The influence of background music of video games on immersion. Journal of Psychology & Psychotherapy 5, 4 (2015).
[7]
Aline Hufschmitt, Stéphane Cardon, and Éric Jacopin. 2020. Manipulating Player Performance via Music Tempo in Tetris. In Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play. 146--152.
[8]
Wijnand A IJsselsteijn, Yvonne AW de Kort, and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven 46, 1 (2013).
[9]
Daniel Johnson and John Gardner. 2010. Personality, motivation and video games. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction. 276--279.
[10]
Daniel Johnson, M John Gardner, and Ryan Perry. 2018. Validation of two game experience scales: the player experience of need satisfaction (PENS) and game experience questionnaire (GEQ). International Journal of Human-Computer Studies 118 (2018), 38--46.
[11]
Effie L-C Law, Florian Brühlmann, and Elisa D Mekler. 2018. Systematic review and validation of the game experience questionnaire (geq)-implications for citation and reporting practice. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. 257--270.
[12]
Joost X Maier, Massimiliano Di Luca, and Uta Noppeney. 2011. Audiovisual asynchrony detection in human speech. Journal of Experimental Psychology: Human Perception and Performance 37, 1 (2011), 245.
[13]
Nick Perham and Joanne Vizard. 2011. Can preference for background music mediate the irrelevant sound effect? Applied Cognitive Psychology 25, 4 (2011), 625--631.
[14]
Stian Reimers and Neil Stewart. 2015. Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments. Behavior research methods 47, 2 (2015), 309--327.
[15]
Stian Reimers and Neil Stewart. 2016. Auditory presentation and synchronization in Adobe Flash and HTML5/JavaScript Web experiments. Behavior Research Methods 48, 3 (2016), 897--908.
[16]
Giovanni Ribeiro, Katja Rogers, Maximilian Altmeyer, Thomas Terkildsen, and Lennart E Nacke. 2020. Game Atmosphere: Effects of Audiovisual Thematic Cohesion on Player Experience and Psychophysiology. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 107--119.
[17]
Scott Rigby and Richard Ryan. 2007. The Player Experience of Need Satisfaction (PENS). White Paper (2007).
[18]
Rob LJ Van Eijk, Armin Kohlrausch, James F Juola, and Steven van de Par. 2008. Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type. Perception & psychophysics 70, 6 (2008), 955--968.
[19]
Vero Vanden Abeele, Lennart E Nacke, Elisa D Mekler, and Daniel Johnson. 2016. Design and preliminary validation of the player experience inventory. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. 335--341.
[20]
Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies 135 (2020).
[21]
Argiro Vatakis, Jordi Navarra, Salvador Soto-Faraco, and Charles Spence. 2008. Audiovisual temporal adaptation of speech: temporal order versus simultaneity judgments. Experimental brain research 185, 3 (2008), 521--529.
[22]
Tengfei Wang, Shuyi Zhang, Xiao Wu, and Wei Cai. 2019. Rhythm Dungeon: A Blockchain-Based Music Roguelike Game. Association for Computing Machinery, New York, NY, USA.
[23]
Sean M Zehnder and Scott D Lipscomb. 2006. The Role of Music in Video Games. (2006).
Index Terms
- Synchronization in games sound: an audiovisual study on player experience and performance
Recommendations
The interplay between immersion and appeal in video games
A 2í 2 study on immersion and appeal of video games is presented.Immersion and appeal are found to be highly related.Immersion is found to be unaffected by playing experience.Appeal is found to be affected both by game played and playing experience. ...
Asynchronous gameplay in pervasive multiplayer mobile games
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing SystemsOne of the interesting features in pervasive multiplayer games is that gaming can be blended into other daily activities. However, the players' current context creates challenges for this parallel activity and therefore, the game design should enable ...
The Appeal of MOBA Games: What Makes People Start, Stay, and Stop
CHI PLAY '16: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in PlayOnline multiplayer games are often rich sources of complex social interactions. In this paper, we focus on the unique player experiences (PX) created by Multiplayer Online Battle Arena (MOBA) games. We examine key phases of players' engagement with the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2022
34 pages
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 June 2022
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MMSys '22
Sponsor:
Acceptance Rates
Overall Acceptance Rate 4 of 7 submissions, 57%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 129Total Downloads
- Downloads (Last 12 months)34
- Downloads (Last 6 weeks)10
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in