research-article

Public Access

Pose-Guided Level Design

Authors:

Lap-Fai YuAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 554, Pages 1 - 12

https://doi.org/10.1145/3290605.3300784

Published: 02 May 2019 Publication History

All formats PDF

Abstract

Player's physical experience is a critical factor to consider in designing motion-based games that are played through motion sensor gaming consoles or virtual reality devices. However, adjusting the physical challenge involved in a motion-based game is difficult and tedious, as it is typically done manually by level designers on a trial-and-error basis. In this paper, we propose a novel approach for automatically synthesizing levels for motion-based games that can achieve desired physical movement goals. By formulating the level design problem as a trans-dimensional optimization problem which is solved by a reversible-jump Markov chain Monte Carlo technique, we show that our approach can automatically synthesize a variety of game levels, each carrying the desired physical movement properties. To demonstrate the generality of our approach, we synthesize game levels for two different types of motion-based games and conduct a user study to validate the effectiveness of our approach.

Supplementary Material

ZIP File (paper554.zip)

The auxiliary material contains the supplementary document, which provides additional details our main paper referring to.

Download
1.03 MB

MP4 File (paper554.mp4)

Supplemental video

Download
131.53 MB

MP4 File (paper554p.mp4)

Preview video

Download
2.50 MB

References

[1]

David Altimira, Florian'Floyd' Mueller, Gun Lee, Jenny Clarke, and Mark Billinghurst. 2014. Towards understanding balancing in exertion games. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology. ACM, 10.

Digital Library

[2]

David Altimira, Florian Floyd Mueller, Jenny Clarke, Gun Lee, Mark Billinghurst, and Christoph Bartneck. 2016. Digitally augmenting sports: an opportunity for exploring and understanding novel balancing techniques. In ACM SIGCHI. ACM, 1681--1691.

Digital Library

[3]

Elizabeth Behm-Morawitz, Jennifer Lewallen, and Grace Choi. 2016. A second chance at health: how a 3D virtual world can improve health self-efficacy for weight loss management among adults. Cyberpsychology, Behavior, and Social Networking 19, 2 (2016), 74--79.

[4]

Nadia Bianchi-Berthouze. 2013. Understanding the role of body movement in player engagement. Human-Computer Interaction 28, 1 (2013), 40--75.

[5]

Antonio Cejudo, Francisco Ayala, Pilar Sainz De Baranda, and Fernando Santonja. 2015. Reliability of two methods of clinical examination of the flexibility of the hip adductor muscles. International journal of sports physical therapy 10, 7 (2015), 976.

[6]

Siddhartha Chib and Edward Greenberg. 1995. Understanding the metropolis-hastings algorithm. The american statistician 49, 4 (1995), 327--335.

[7]

Seong-il Cho, Duk-hyun An, and Won-gyu Yoo. 2014. Effects of recreational exercises on the strength, flexibility, and balance of old-old elderly individuals. Journal of physical therapy science 26, 10 (2014), 1583--1584.

[8]

Woohyeok Choi, Jeungmin Oh, Darren Edge, Joohyun Kim, and Uichin Lee. 2016. SwimTrain: exploring exergame design for group fitness swimming. In ACM SIGCHI. ACM, 1692-1704.

Digital Library

[9]

Kate Compton and Michael Mateas. 2006. Procedural level design for platform games. In Proceedings of the Second AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. AAAI Press, ACM, 109--111.

Digital Library

[10]

Simon Demediuk, Marco Tamassia, William L Raffe, Fabio Zambetta, Xiaodong Li, and Florian Mueller. 2017. Monte carlo tree search based algorithms for dynamic difficulty adjustment. In Computational Intelligence and Games (CIG), 2017 IEEE Conference on. IEEE, 53--59.

[11]

Judith E Deutsch, Arielle Brettler, Caroline Smith, Jamie Welsh, Roshan John, Phyllis Guarrera-Bowlby, and Michal Kafri. 2011. Nintendo wii sports and wii fit game analysis, validation, and application to stroke rehabilitation. Topics in Stroke Rehabilitation 18, 6 (2011), 701--719.

[12]

Dajana Dimovska, Patrick Jarnfelt, Sebbe Selvig, and Georgios N Yannakakis. 2010. Towards procedural level generation for rehabilitation. In Proceedings of the 2010 Workshop on Procedural Content Generation in Games. ACM, Springer, 7.

Digital Library

[13]

Kathrin Gerling, Ian Livingston, Lennart Nacke, and Regan Mandryk. 2012. Full-body motion-based game interaction for older adults. In ACM SIGCHI. ACM, 1873--1882.

Digital Library

[14]

Stefan Gradl, Bjoern M Eskofier, Dominic Eskofier, Christopher Mutschler, and Stephan Otto. 2016. Virtual and augmented reality in sports: an overview and acceptance study. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, 885--888.

Digital Library

[15]

Lee EF Graves, Nicola D Ridgers, Karen Williams, Gareth Stratton, Greg Atkinson, and Nigel T Cable. 2010. The physiological cost and enjoyment of Wii Fit in adolescents, young adults, and older adults. Journal of Physical Activity and Health 7, 3 (2010), 393--401.

[16]

Peter J Green. 1995. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 4 (1995), 711--732.

[17]

Andrew D Hirschhorn, John W Lockhart, and John D Breckenridge. 2015. Can a physical activity monitor provide a valid measure of arm elevation angle? A study to assess agreement between the SenseWear Mini Armband and the universal goniometer. BMC musculoskeletal disorders 16, 1 (2015), 46.

[18]

AL Hof, MGJ Gazendam, and WE Sinke. 2005. The condition for dynamic stability. Journal of Biomechanics 38, 1 (2005), 1--8.

[19]

Britton Horn, Steve Dahlskog, Noor Shaker, Gillian Smith, and Julian Togelius. 2014. A comparative evaluation of procedural level generators in the Mario AI framework. In International Conference on the Foundations of Digital Games. Society for the Advancement of the Science of Digital Games, 1--8.

[20]

Katherine Isbister. 2013. Motion-Based Game Design: How to Design Quality Movement Games for Wii, Kinect, and Move. Morgan Kaufmann Publishers Inc.

Digital Library

[21]

Katherine Isbister and Florian "Floyd" Mueller. 2015. Guidelines for the design of movement-based games and their relevance to HCI. Human? Computer Interaction 30, 3--4 (2015), 366--399.

Digital Library

[22]

Martin Jennings-Teats, Gillian Smith, and Noah Wardrip-Fruin. 2010. Polymorph: A model for dynamic level generation. In Sixth Artificial Intelligence and Interactive Digital Entertainment Conference. AAAI Press, 11:1--11:4.

Digital Library

[23]

Mads Mùller Jensen, Majken K Rasmussen, Florian Floyd Mueller, and Kaj Grùnbñk. 2015. Keepin'it real: challenges when designing sports-training games. In ACM SIGCHI. ACM, 2003--2012.

Digital Library

[24]

Deborah Kendzierski and Kenneth J DeCarlo. 1991. Physical activity enjoyment scale: Two validation studies. Journal of sport and exercise psychology 13, 1 (1991), 50--64.

[25]

Miran Kim, Jeff Angermann, George Bebis, and Eelke Folmer. 2013. ViziCal: Accurate Energy Expenditure Prediction for Playing Exergames. In UIST. ACM, New York, NY, USA, 397--404.

Digital Library

[26]

Scott Kirkpatrick, C Daniel Gelatt, and Mario P Vecchi. 1983. Optimization by simulated annealing. Science 220, 4598 (1983), 671--680.

[27]

C Lamoth, M van Diest, J Stegenga, B Verkerke, and K Postema. 2015. A 6-week unsupervised home-based exergaming training program to improve balance of older adults. Gait & Posture 42 (2015), S86-S87.

[28]

Byungjoo Lee, Sunjun Kim, Antti Oulasvirta, Jong-In Lee, and Eunji Park. 2018. Moving Target Selection: A Cue Integration Model. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 230.

Digital Library

[29]

Byungjoo Lee and Antti Oulasvirta. 2016. Modelling error rates in temporal pointing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1857--1868.

Digital Library

[30]

Jih-Hsuan Lin. 2015. "Just Dance": The effects of exergame feedback and controller use on physical activity and psychological outcomes. Games for Health Journal 4, 3 (2015), 183--189.

[31]

Vipul Lugade, Victor Lin, and Li-Shan Chou. 2011. Center of mass and base of support interaction during gait. Gait & posture 33, 3 (2011), 406--411.

[32]

Ian Scott Mackenzie. 1992. Fitts' law as a performance model in humancomputer interaction. (1992).

[33]

I Scott MacKenzie. 1995. Movement time prediction in humancomputer interfaces. In Readings in Human-Computer Interaction. Elsevier, 483--493.

Digital Library

[34]

Florian'Floyd' Mueller, Richard Byrne, Josh Andres, and Rakesh Patibanda. 2018. Experiencing the Body as Play. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 210.

Digital Library

[35]

Florian'Floyd' Mueller, Darren Edge, Frank Vetere, Martin R Gibbs, Stefan Agamanolis, Bert Bongers, and Jennifer G Sheridan. 2011. Designing sports: a framework for exertion games. In ACM SIGCHI. ACM, 2651--2660.

Digital Library

[36]

Florian Mueller and Katherine Isbister. 2014. Movement-based game guidelines. In ACM SIGCHI. ACM, 2191--2200.

Digital Library

[37]

Florian Floyd Mueller, Josh Andres, Joe Marshall, Dag Svanñs, Kathrin Gerling, Jakob Tholander, Anna Lisa Martin-Niedecken, Elena Márquez CHI 2019, May 4--9, 2019, Glasgow, Scotland Uk Y. Zhang et al. Segura, Elise van den Hoven, Nicholas Graham, et al. 2018. Bodycentric computing: results from a weeklong Dagstuhl seminar in a German castle. Interactions 25, 4 (2018), 34--39.

Digital Library

[38]

Elisa F Ogawa, Tongjian You, and Suzanne G Leveille. 2016. Potential benefits of exergaming for cognition and dual-task function in older adults: a systematic review. Journal of Aging and Physical Activity 24, 2 (2016), 332-336.

[39]

Kalpana P Padala, Prasad R Padala, Shelly Y Lensing, Richard A Dennis, Melinda M Bopp, Paula K Roberson, and Dennis H Sullivan. 2017. Home-based exercise program improves balance and fear of falling in community-dwelling older adults with mild Alzheimer's disease: A pilot study. Journal of Alzheimer's Disease 59, 2 (2017), 565--574.

[40]

Marco Pasch, Nadia Bianchi-Berthouze, Betsy van Dijk, and Anton Nijholt. 2009. Movement-based sports video games: Investigating motivation and gaming experience. Entertainment Computing 1, 2 (2009), 49--61.

[41]

Rakesh Patibanda, Florian'Floyd' Mueller, Matevz Leskovsek, and Jonathan Duckworth. 2017. Life Tree: Understanding the Design of Breathing Exercise Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM, 19--31.

Digital Library

[42]

Chris Pedersen, Julian Togelius, and Georgios N Yannakakis. 2009. Modeling player experience in super mario bros. In Computational Intelligence and Games, 2009. CIG 2009. IEEE Symposium on. IEEE, 132- 139.

Digital Library

[43]

Gabriel Ploof, Bassam Alqahtani, Farwan Alghamdi, Garret Flynn, and Cai Xia Yang. 2017. Center of Mass Estimation using Motion Capture System. In IEEE Cyber Science and Technology Congress.

[44]

Roshanth Rajachandrakumar, Jotvarinder Mann, Alison Schinkel-Ivy, and Avril Mansfield. 2018. Exploring the relationship between stability and variability of the centre of mass and centre of pressure. Gait & posture 63 (2018), 254--259.

[45]

Richard D Roberts. 1997. Fitts' law, movement time and intelligence. Personality and Individual Differences 23, 2 (1997), 227--246.

[46]

Daniel Schoene, Trinidad Valenzuela, Stephen R Lord, and Eling D de Bruin. 2014. The effect of interactive cognitive-motor training in reducing fall risk in older people: a systematic review. BMC geriatrics 14, 1 (2014), 107.

[47]

Peizhi Shi and Ke Chen. 2016. Online level generation in Super Mario Bros via learning constructive primitives. In Computational Intelligence and Games (CIG), 2016 IEEE Conference on. IEEE, 1--8.

[48]

Jeff Sinclair, Philip Hingston, and Martin Masek. 2007. Considerations for the design of exergames. In Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia. ACM, 289--295.

Digital Library

[49]

Gillian Smith, Mike Treanor, Jim Whitehead, and Michael Mateas. 2009. Rhythm-based level generation for 2D platformers. In Proceedings of the 4th International Conference on Foundations of Digital Games. ACM, 175--182.

Digital Library

[50]

Amanda E Staiano, Anisha A Abraham, and Sandra L Calvert. 2013. Adolescent exergame play for weight loss and psychosocial improvement: a controlled physical activity intervention. Obesity 21, 3 (2013), 598--601.

[51]

Julian Togelius and Georgios N Yannakakis. 2016. Emotion-driven level generation. In Emotion in Games. Springer, 155--166.

[52]

Mike Van Diest, Claudine JC Lamoth, Jan Stegenga, Gijsbertus J Verkerke, and Klaas Postema. 2013. Exergaming for balance training of elderly: state of the art and future developments. Journal of Neuroengineering and Rehabilitation 10, 1 (2013), 101.

[53]

Pornratshanee Weerapong, Patria A Hume, and Gregory S Kolt. 2004. Stretching: mechanisms and benefits for sport performance and injury prevention. Physical Therapy Reviews 9, 4 (2004), 189--206.

[54]

Caroline Whyatt, Niamh A Merriman, William R Young, Fiona N Newell, and Cathy Craig. 2015. A Wii bit of fun: a novel platform to deliver effective balance training to older adults. Games for health journal 4, 6 (2015), 423--433.

[55]

S Wüest, NA Borghese, M Pirovano, R Mainetti, R van de Langenberg, and ED de Bruin. 2014. Usability and effects of an exergame-based balance training program. Games for Health Journal 3, 2 (2014), 106- 114.

[56]

Biao Xie, Yongqi Zhang, Haikun Huang, Elisa Ogawa, Tongjian You, and Lap-Fai Yu. 2018. Exercise Intensity-driven level design. IEEE TVCG (2018).

Digital Library

[57]

Georgios N Yannakakis and Julian Togelius. 2011. Experience-driven procedural content generation. IEEE Transactions on Affective Computing 2, 3 (2011), 147--161.

Digital Library

[58]

Yi-Ting Yeh, Lingfeng Yang, Matthew Watson, Noah D. Goodman, and Pat Hanrahan. 2012. Synthesizing Open Worlds with Constraints Using Locally Annealed Reversible Jump MCMC. ACM Trans. Graph. 31, 4, Article 56 (July 2012), 11 pages.

Digital Library

Cited By

Karaosmanoglu SWegner MCmentowski SSteinicke F(2024)Move, React, Repeat! The Role of Continuous Cues in Immersive ExergamesProceedings of the ACM on Human-Computer Interaction10.1145/36770918:CHI PLAY(1-23)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677091
Lee SHwang SOakley ILee K(2024)Expanding the Design Space of Vision-based Interactive Systems for Group Dance PracticeProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661568(2768-2787)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661568
Fan YZhu LWang HSong A(2024)Synthesize Personalized Training for Robot-Assisted Upper Limb Rehabilitation With Diversity EnhancementIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330894030:8(5705-5718)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3308940
Show More Cited By

Index Terms

Pose-Guided Level Design
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Towards understanding how to design for social play in exertion games

Players invest significant physical effort when playing exertion games. In addition to improving physical health, exertion games are also believed to facilitate social play amongst players. Despite these advantages, our understanding of how to design ...
Can "Gaming 2.0" help design "Serious Games"?: a comparative study
Sandbox '10: Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games

The "Serious Games" field raises a specific need. People without professional game design skills, such as teachers, corporate trainers, therapists and advertising professionals, request tools that could allow them to create or modify such games. This ...
The science of level design
FDG '10: Proceedings of the Fifth International Conference on the Foundations of Digital Games

Level designers create gameplay through geometry, AI scripting, and item placement. There is little formal understanding of this process, but rather a large body of design lore and rules of thumb. We have taken a first step in improving understanding by ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
620
Total Downloads

Downloads (Last 12 months)150
Downloads (Last 6 weeks)25

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Karaosmanoglu SWegner MCmentowski SSteinicke F(2024)Move, React, Repeat! The Role of Continuous Cues in Immersive ExergamesProceedings of the ACM on Human-Computer Interaction10.1145/36770918:CHI PLAY(1-23)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677091
Lee SHwang SOakley ILee K(2024)Expanding the Design Space of Vision-based Interactive Systems for Group Dance PracticeProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661568(2768-2787)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661568
Fan YZhu LWang HSong A(2024)Synthesize Personalized Training for Robot-Assisted Upper Limb Rehabilitation With Diversity EnhancementIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330894030:8(5705-5718)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3308940
Gokhman RSawdayi TKhan RSatyanarayana AVinjamuri RKadiyala S(2024)Accurate Body Pose Matching for Individuals with Stroke using Siamese Networks2024 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE)10.1109/CHASE60773.2024.00030(177-181)Online publication date: 19-Jun-2024
https://doi.org/10.1109/CHASE60773.2024.00030
Hofmann MAuradkar NBirchfield JCao JHughes AKim GKurpad SLum KMack KNilakantan ASeehorn MWarnock EMankoff JHudson S(2023)OPTIMISM: Enabling Collaborative Implementation of Domain Specific Metaheuristic OptimizationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580904(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580904
Li WHuang HSolomon TEsmaeili BYu L(2022)Synthesizing Personalized Construction Safety Training Scenarios for VR TrainingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.315051028:5(1993-2002)Online publication date: May-2022
https://doi.org/10.1109/TVCG.2022.3150510
Zhou ZXu AYatani K(2021)SyncUpProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34781205:3(1-25)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3478120
Mazumdar AMousas C(2021)Synthesizing affective virtual reality multicharacter experiencesComputer Animation and Virtual Worlds10.1002/cav.200432:3-4Online publication date: 24-May-2021
https://doi.org/10.1002/cav.2004
Li WXie BZhang YMeiss WHuang HYu L(2020)Exertion-aware path generationACM Transactions on Graphics10.1145/3386569.339239339:4(115:1-115:14)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392393
Li WTalavera JSamayoa ALien JYu L(2020)Automatic Synthesis of Virtual Wheelchair Training Scenarios2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.1581008046739(539-547)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.1581008046739
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents