research-article

Opportunities for Serious Game Technologies to Engage Children with Autism in a Pakistani Sociocultural and Institutional Context: An investigation of the design space for serious game technologies to enhance engagement of children with autism and to facilitate external support provided

Authors:

Laurianne Sitbon,

Faizan AhmadAuthors Info & Claims

OzCHI '22: Proceedings of the 34th Australian Conference on Human-Computer Interaction

Pages 338 - 347

https://doi.org/10.1145/3572921.3572923

Published: 06 April 2023 Publication History

Abstract

Usability and design of serious game technologies have been widely investigated as academic interventions tools for children with autism. However, besides the technology, the sociocultural and institutional context also impacts the gameplay activities of children with autism as well as the external support provided by instructors. Therefore, this paper investigates i) the impact of sociocultural and institutional context over the engagement of children with autism with serious game technologies, ii) the types of external support children with autism are offered or require during gameplay session, and iii) the type of rewards and encouragers that can act as unbiased support to increase the engagement of the children with autism during gameplay.

This paper investigates these factors with an inductive analysis of educational gameplay activities of 23 children with autism in Lahore, Pakistan. Our study found that sociocultural and institutional context has substantial impact over the gameplay activities of children with autism. Children required both physical and verbal support during the gameplay activities, and institutional context influences the behavior of instructors as well. Finally, dynamic animations, rewards and encouragers can keep the children engaged for longer in the gameplay.

References

[1]

Muneeb Imtiaz Ahmad and Suleman Shahid. 2015. Design and Evaluation of Mobile Learning Applications for Autistic Children in Pakistan. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 9296: 436–444. https://doi.org/10.1007/978-3-319-22701-6_32

Digital Library

[2]

Leandro M. Almeida, Diego P.Da Silva, Daieny P. Theodório, Wolley W. Silva, Silvia Cristina M. Rodrigues, Terigi A. Scardovelli, Alessandro P.Da Silva, and Marcia Aparecida S. Bissaco. 2019. ALTRIRAS: A Computer Game for Training Children with Autism Spectrum Disorder in the Recognition of Basic Emotions. International Journal of Computer Games Technology 2019. https://doi.org/10.1155/2019/4384896

[3]

Samanta Alves, António Marques, Cristina Queirós, Verónica Orvalho, S Alves, A Marques, C Queirós, and V Orvalho. 2013. LIFEisGAME Prototype: A Serious Game about Emotions for Children with Autism Spectrum Disorders. Retrieved from www.psychnology.org.

[4]

Muhammad Salar Anwar, Mahnoor Tahir, Khushboo Nusrat, and Muhammad R. Khan. 2018. Knowledge, Awareness, and Perceptions Regarding Autism Among Parents in Karachi, Pakistan. Cureus 10, 9. https://doi.org/10.7759/CUREUS.3299

[5]

Aude Billard, Ben Robins, Kerstin Dautenhahn, and Jacqueline Nadel. 2010. Building Robota, a Mini-Humanoid Robot for the Rehabilitation of Children With Autism. http://dx.doi.org/10.1080/10400435.2007.10131864 19, 1: 37–49. https://doi.org/10.1080/10400435.2007.10131864

[6]

B. Bossavit and S. Parsons. 2018. Outcomes for design and learning when teenagers with autism codesign a serious game: A pilot study. Journal of Computer Assisted Learning 34, 3: 293–305. https://doi.org/10.1111/JCAL.12242

[7]

Benoît Bossavit and Sarah Parsons. 2016. Designing an Educational Game For and With Teenagers with High Functioning Autism. https://doi.org/10.1145/2940299.2940313

Digital Library

[8]

Fatima A. Boujarwah, Nazneen, Hwajung Hong, Gregory D. Abowd, and Rosa I. Arriaga. 2011. Towards a framework to situate assistive technology design in the context of culture. ASSETS’11: Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility: 19–26. https://doi.org/10.1145/2049536.2049542

Digital Library

[9]

Alessandro Canossa, Jeremy B Badler, Magy Seif-El Nasr, Stefanie Tignor, and C Randall Colvin. In Your Face(t) Impact of Personality and Context on Gameplay Behavior Playable Innovative Technologies Lab.

[10]

Stéphanie Carlier, Sara van der Paelt, Femke Ongenae, Femke de Backere, and Filip de Turck. 2019. Using a serious game to reduce stress and anxiety in children with autism spectrum disorder. In PervasiveHealth: Pervasive Computing Technologies for Healthcare, 452–461. https://doi.org/10.1145/3329189.3329237

Digital Library

[11]

Jingying Chen, Guangshuai Wang, Kun Zhang, Guanghai Wang, and Leyuan Liu. 2019. A pilot study on evaluating children with autism spectrum disorder using computer games. Computers in Human Behavior 90: 204–214. https://doi.org/10.1016/j.chb.2018.08.057

[12]

Eirini Christinaki and Nikolaos Vidakis. A gesture-controlled Serious Game for teaching emotion recognition skills to preschoolers with autism. Retrieved from http://www.cs.ucsd.edu/users/gary/CAFE/.

[13]

Francesco Craig, Flaviana Tenuta, Andrea de Giacomo, Antonio Trabacca, and Angela Costabile. 2021. A systematic review of problematic video-game use in people with Autism Spectrum Disorders. Research in Autism Spectrum Disorders 82: 101726. https://doi.org/10.1016/J.RASD.2021.101726

[14]

Kevin Durkin. 2010. Videogames and Young People with Developmental Disorders: https://doi.org/10.1037/a0019438 14, 2: 122–140. https://doi.org/10.1037/A0019438

[15]

Marylene S. Eder, John Maruel L. Diaz, Joanne Ruth S. Madela, Marife U. Mag-usara, and Dhally Dith M. Sabellano. 2016. Fill me app: An interactive mobile game application for children with Autism. International Journal of Interactive Mobile Technologies 10, 3: 59–63. https://doi.org/10.3991/ijim.v10i3.5553

[16]

Hina Fazil and Nasir Sulman. 2014. Perceptions of School Administrators about Facilities Available in Schools for Children with Autism in Pakistan. Academic Research International 5, 4. Retrieved January 17, 2023 from www.savap.org.pk348www.journals.savap.org.pk

[17]

Juveriah Furrukh and Gulnaz Anjum. 2020. Coping with autism spectrum disorder (ASD) in Pakistan: A phenomenology of mothers who have children with ASD. http://www.editorialmanager.com/cogentpsychology 7, 1. https://doi.org/10.1080/23311908.2020.1728108

[18]

Ahmed Hassan, Niels Pinkwart, and Muhammad Shafi. 2021. Serious games to improve social and emotional intelligence in children with autism. Entertainment Computing 38: 100417. https://doi.org/10.1016/J.ENTCOM.2021.100417

[19]

Arshia Zernab Hassan, Bushra Tasnim Zahed, Fatema Tuz Zohora, Johra Muhammad Moosa, Tasmiha Salam, Md Mustafizur Rahman, Hasan Shahid Ferdous, and Syed Ishtiaque Ahmed. 2011. Developing the concept of money by interactive computer games for autistic children. Proceedings - 2011 IEEE InternationalSymposium on Multimedia, ISM 2011: 559–564. https://doi.org/10.1109/ISM.2011.99

Digital Library

[20]

Geoffrey Hookham and Keith Nesbitt. 2019. A Systematic Review of the Definition and Measurement of Engagement in Serious Games. https://doi.org/10.1145/3290688.3290747

Digital Library

[21]

Nazish Imran, Mansoor R. Chaudry, Muhammad W. Azeem, Muhammad R. Bhatti, Zaidan I. Choudhary, and Mohsin A. Cheema. 2011. A survey of Autism knowledge and attitudes among the healthcare professionals in Lahore, Pakistan. BMC Pediatrics 11, 1: 1–6. https://doi.org/10.1186/1471-2431-11-107/TABLES/2

[22]

Kamran Khowaja and Siti Salwah Salim. 2019. Serious Game for Children with Autism to Learn Vocabulary: An Experimental Evaluation. International Journal of Human-Computer Interaction 35, 1: 1–26. https://doi.org/10.1080/10447318.2017.1420006

[23]

Media Lab, Tiffany Y Tang, and Aonan Guan. “I will Help You Pass the Puzzle Piece to Your Partner if This is What You Want Me to”: The Design of Collaborative Puzzle Games to Train Chinese Children with Autism Spectrum Disorder Joint Attention Skills Pinata Winoto. Proceedings of the The 15th International Conference on Interaction Design and Children 16. https://doi.org/10.1145/2930674

Digital Library

[24]

Anabela Marto, Henrique A. Almeida, and Alexandrino Gonçalves. 2019. Using Augmented Reality in Patients with Autism: A Systematic Review. Lecture Notes in Computational Vision and Biomechanics 34: 454–463. https://doi.org/10.1007/978-3-030-32040-9_46

[25]

Nazneen, Fatima A. Boujarwah, Agata Rozga, Gregory D. Abowd, Rosa I. Arriaga, Ron Oberleitner, and Suhas Pharkute. 2012. Towards in-home collection of behavior specimens: Within the cultural context of autism in Pakistan. 2012 6th International Conference on Pervasive Computing Technologies for Healthcare and Workshops, PervasiveHealth 2012: 9–16. https://doi.org/10.4108/ICST.PERVASIVEHEALTH.2012.248701

[26]

Sarah Parsons and Sue Cobb. 2011. State-of-the-art of virtual reality technologies for children on the autism spectrum. https://doi.org/10.1080/08856257.2011.593831 26, 3: 355–366. https://doi.org/10.1080/08856257.2011.593831

[27]

Sathiyaprakash Ramdoss, Wendy MacHalicek, Mandy Rispoli, Austin Mulloy, Russell Lang, and Mark O'Reilly. 2012. Computer-based interventions to improve social and emotional skills in individuals with autism spectrum disorders: A systematic review. http://dx.doi.org/10.3109/17518423.2011.651655 15, 2: 119–135. https://doi.org/10.3109/17518423.2011.651655

[28]

Amirreza Rouhi, Micol Spitale, Fabio Catania, Giulia Cosentino, Mirko Gelsomini, and Franca Garzotto. 2019. Emotify: Emotional game for children with autism spectrum disorder based-on machine learning. In International Conference on Intelligent User Interfaces, Proceedings IUI, 31–32. https://doi.org/10.1145/3308557.3308688

Digital Library

[29]

Mohammed A. Saleh, Fazah Akhtar Hanapiah, and Habibah Hashim. 2021. Robot applications for autism: a comprehensive review. Disability and Rehabilitation: Assistive Technology 16, 6: 580–602. https://doi.org/10.1080/17483107.2019.1685016

[30]

Sumita Sharma, Krishnaveni Achary, Harmeet Kaur, Juhani Linna, Markku Turunen, Blessin Varkey, Jaakko Hakulinen, and Sanidhya Daeeyya. 2018. Wow! you're wearing a fitbit, you're a young boy now!: Socio-technical aspirations for children with autism in India. ASSETS 2018 - Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility: 174–184. https://doi.org/10.1145/3234695.3239329

Digital Library

[31]

Sumita Sharma, Tero Avellan, Juhani Linna, Krishnaveni Achary, Markku Turunen, Jaakko Hakulinen, and Blessin Varkey. 2020. Socio-Technical Aspirations for Children with Special Needs. ACM Transactions on Accessible Computing (TACCESS) 13, 3. https://doi.org/10.1145/3396076

Digital Library

[32]

Gavin Sim, Janet C. Read, Peggy Gregory, and Diana Xu. 2015. From England to Uganda: Children Designing and Evaluating Serious Games. https://doi.org/10.1080/07370024.2014.984034 30, 3–4: 263–293. https://doi.org/10.1080/07370024.2014.984034

Digital Library

[33]

Julia S.Y. Tang, Nigel T.M. Chen, Marita Falkmer, Sven Bӧlte, and Sonya Girdler. 2019. A systematic review and meta-analysis of social emotional computer based interventions for autistic individuals using the serious game framework. Research in Autism Spectrum Disorders 66: 101412. https://doi.org/10.1016/J.RASD.2019.101412

[34]

Julia S.Y. Tang, Marita Falkmer, Nigel T.M. Chen, Sven Bӧlte, and Sonya Girdler. 2019. Designing a Serious Game for Youth with ASD: Perspectives from End-Users and Professionals. Journal of Autism and Developmental Disorders 49, 3: 978–995. https://doi.org/10.1007/S10803-018-3801-9/TABLES/6

[35]

Stavros Tsikinas and Stelios Xinogalos. 2019. Studying the effects of computer serious games on people with intellectual disabilities or autism spectrum disorder: A systematic literature review. Journal of Computer Assisted Learning 35, 1: 61–73. https://doi.org/10.1111/JCAL.12311

[36]

Stavros Tsikinas and Stelios Xinogalos. 2020. Towards a serious games design framework for people with intellectual disability or autism spectrum disorder. Education and Information Technologies 25, 4: 3405–3423. https://doi.org/10.1007/S10639-020-10124-4/FIGURES/2

[37]

Zelai Sáenz de Urturi, Amaia Méndez Zorrilla, and Begoña García Zapirain. 2011. Serious Game based on first aid education for individuals with Autism Spectrum Disorder (ASD) using android mobile devices. Proceedings of CGAMES’2011 USA - 16th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational and Serious Games: 223–227. https://doi.org/10.1109/CGAMES.2011.6000343

Digital Library

[38]

Elisabeth M. Whyte, Joshua M. Smyth, and K. Suzanne Scherf. 2015. Designing Serious Game Interventions for Individuals with Autism. Journal of Autism and Developmental Disorders 45, 12: 3820–3831. https://doi.org/10.1007/S10803-014-2333-1/TABLES/1

[39]

Hanan Makki Zakari, Minhua Ma, and David Simmons. 2014. A Review of Serious Games for Children with Autism Spectrum Disorders (ASD). Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 8778: 93–106. https://doi.org/10.1007/978-3-319-11623-5_9

[40]

Jinan Zeidan, Eric Fombonne, Julie Scorah, Alaa Ibrahim, Maureen S. Durkin, Shekhar Saxena, Afiqah Yusuf, Andy Shih, and Mayada Elsabbagh. 2022. Global prevalence of autism: A systematic review update. Autism Research 15, 5: 778–790. https://doi.org/10.1002/AUR.2696

[41]

Yu Zhonggen. 2019. A Meta-Analysis of Use of Serious Games in Education over a Decade. International Journal of Computer Games Technology 2019. https://doi.org/10.1155/2019/4797032

Digital Library

[42]

2022. What is Autism Spectrum Disorder? | CDC. Retrieved April 13, 2022 from https://www.cdc.gov/ncbddd/autism/facts.html

[43]

Autism: Explaining the enigma, 2nd ed. - PsycNET. Retrieved January 17, 2023 from https://psycnet.apa.org/record/2003-00578-000

[44]

Diagnostic and Statistical Manual Diagnostic and Statistical Manual of Mental Disorders (4th edn, text of Mental Disorders (4th edn, text revision) (DSM ^ IV^TR) revision) (DSM ^ IV^TR). https://doi.org/10.1192/bjp.179.1.85-a

[45]

Autism. Retrieved January 17, 2023 from https://www.who.int/news-room/fact-sheets/detail/autism-spectrum-disorders

[46]

‘400k Pakistani children suffer from autism.’ Retrieved June 1, 2022 from https://tribune.com.pk/story/2292799/400k-pakistani-children-suffer-from-autism

Cited By

Singh GAhmad F(2024)An interactive augmented reality framework to enhance the user experience and operational skills in electronics laboratoriesSmart Learning Environments10.1186/s40561-023-00287-111:1Online publication date: 29-Jan-2024
https://doi.org/10.1186/s40561-023-00287-1
Ahmad NFeroz IAhmad F(2024)Creating Synthetic Test Data by Generative Adversarial Networks (GANs) for Mobile Health (mHealth) ApplicationsForthcoming Networks and Sustainability in the AIoT Era10.1007/978-3-031-62871-9_25(322-332)Online publication date: 26-Jun-2024
https://doi.org/10.1007/978-3-031-62871-9_25

Index Terms

Opportunities for Serious Game Technologies to Engage Children with Autism in a Pakistani Sociocultural and Institutional Context: An investigation of the design space for serious game technologies to enhance engagement of children with autism and to facilitate external support provided
1. Human-centered computing
  1. Accessibility
    1. Accessibility design and evaluation methods
  2. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Field studies

Recommendations

Players and Performance: Opportunities for Social Interaction with Augmented Tabletop Games at Centres for Children with Autism

This research aimed to investigate how children with autism interacted with rich audio and visual augmented reality (AR) tabletop games. Based on in-depth needs analysis facilitated through autism centers in China, we designed and developed MagicBLOCKS, ...
Using a Serious Game to Reduce Stress and Anxiety in Children with Autism Spectrum Disorder
PervasiveHealth'19: Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare

Autism Spectrum Disorder (ASD) is characterised by social interaction difficulties and communication difficulties. Moreover, children with ASD often suffer from other co-morbidities, such as anxiety and depression. Finding appropriate treatment can be ...
Game-based for Enhancing Autism Children's Communication Skill in Thailand
i-CREATe 2018: Proceedings of the 12th International Convention on Rehabilitation Engineering and Assistive Technology

The research study on children with autism spectrum disorder shows the increasing number of autism children in the population. The therapy in the initiate phase has become more important for children to start and practice in an earlier stage. Therefore, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '22: Proceedings of the 34th Australian Conference on Human-Computer Interaction

November 2022

373 pages

ISBN:9798400700248

DOI:10.1145/3572921

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

OzCHI '22

OzCHI '22: 34th Australian Conference on Human-Computer Interaction

November 29 - December 2, 2022

ACT, Canberra, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
123
Total Downloads

Downloads (Last 12 months)74
Downloads (Last 6 weeks)10

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Singh GAhmad F(2024)An interactive augmented reality framework to enhance the user experience and operational skills in electronics laboratoriesSmart Learning Environments10.1186/s40561-023-00287-111:1Online publication date: 29-Jan-2024
https://doi.org/10.1186/s40561-023-00287-1
Ahmad NFeroz IAhmad F(2024)Creating Synthetic Test Data by Generative Adversarial Networks (GANs) for Mobile Health (mHealth) ApplicationsForthcoming Networks and Sustainability in the AIoT Era10.1007/978-3-031-62871-9_25(322-332)Online publication date: 26-Jun-2024
https://doi.org/10.1007/978-3-031-62871-9_25

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents