research-article

CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders

Authors:

Soichiro Matsuda,

Izumi Futamata,

Ryoichi Sakuta,

Kenji SuzukiAuthors Info & Claims

ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

Pages 124 - 135

https://doi.org/10.1145/3308561.3353784

Published: 24 October 2019 Publication History

Abstract

In this paper, we propose a new mobile system to support therapists for teaching and tracking socio-communicative behaviors in children with neurodevelopmental disorders during music therapy sessions. The CHIMELIGHT system was designed to deal with the current issues in conventional therapies, such as the difficulty in both evaluating the performance and maintaining engagement of these children during therapeutic activities. The system evaluated movements made by a child with neurodevelopmental disorders playing a musical instrument while delivering contingent visual feedback based on real-time motion analysis. A set of metrics was implemented to evaluate the performance during the therapy activity and quantify specific target behaviors. An evaluation study performed during music therapy group sessions showed that the CHIMELIGHT-delivered visual feedback increased the engagement of children in the activity and decreased targeted negative behaviors. In some participants, we observed potential changes in their positive behaviors. Interviews and questionnaires provided to therapists showed that the developed system was effective for supporting evidence-based music therapy. Accordingly, our research enables new methods for both interactive therapy and mediation of the interaction between therapists and children with neurodevelopmental disorders.

References

[1]

Vera Bernard-Opitz, N. Sriram, and Sharul Sapuan. 1999. Enhancing vocal imitations in children with autism using the IBM SpeechViewer. Autism 3, 2: 131--147.

[2]

John Brooke. 1996. SUS: A quick and dirty usability scale. In Usability Evaluation in Industry, P. W. Jordan, B. Thomas, B. A. Weerdmeester, and A. L. McClelland (eds.). London: Taylor and Francis, UK, 194: 189--194.

[3]

Franceli L. Cibrian, Oscar Pena, Deysi Ortega, and Monica Tentori. 2017. BendableSound: An elastic multisensory interface using touch-based interactions to assist children with severe autism during music therapy. International Journal of Human-Computer Studies 0, 1--16.

[4]

Lisa M. Gallagher and Anita L. Steele. 2001. Developing and using a computerized database for music therapy in palliative medicine. Journal of Palliative Care 17, 3: 147--154.

[5]

Monika Geretsegger, Cochavit Elefant, Karin A. Mössler, and Christian Gold. 2014. Music therapy for people with autism spectrum disorder. Cochrane Database of Systematic Reviews 6, Art. No.: CD004381.

[6]

Avi Gilboa. 2007. Testing MAP: A graphic method for describing and analyzing music therapy sessions. The Arts in Psychotherapy 34, 4:309--320.

[7]

Nicole D. Hahna, Susan Hadley, Vern H. Miller, and Michelle Bonaventura. 2012. Music technology usage in music therapy: A survey of practice. The Arts in Psychotherapy 39, 456--464.

[8]

Joshua Hailpern. 2007. Encouraging Speech and Vocalization in Children with Autistic Spectrum Disorder. In Proceedings of the ACM SIGACCESS Accessibility and Computing (ASSETS'07), 89, 47--52.

Digital Library

[9]

Joshua Hailpern, Andrew Harris, Reed La Botz, Brianna Birman, and Karrie Karahalios. 2012. Designing Visualizations to Facilitate Multisyllabic Speech with Children with Autism and Speech Delays. In Proceedings of the Designing Interactive Systems Conference, 126--135.

Digital Library

[10]

Yuka Ishizuka and Junichi Yamamoto. 2016. Contingent imitation increases verbal interaction in children with autism spectrum disorders. Autism 20, 8, 1011--1020.

[11]

Amy Kalas. 2012. Joint attention responses of children with autism spectrum disorder to simple versus complex music. Journal of Music Therapy 49, 4, 430--452.

[12]

Colin Lee. 2000. A method of analyzing improvisations in music therapy. Journal of music therapy 37, 2, 147--167.

[13]

Hayoung A. Lim. 2012. Developmental Speech-Language Training through Music for Children with Autism Spectrum Disorders. London and Philadelphia: Jessica Kingsley Publishers.

[14]

Hayoung A. Lim and Ellary Draper. 2011. The effects of music therapy incorporated with applied behavior analysis verbal behavior approach for children with autism spectrum disorders. Journal of Music Therapy 48, 4, 532--550.

[15]

Joana Lobo and Kenji Suzuki. 2018. Designing Social Playware Mediated Communication with Contingent Feedback Devices. In Proceedings of the ACM Conference Companion Publication on Designing Interactive Systems (DIS18), 93--97.

Digital Library

[16]

Geoff Luck, Olivier Lartillot, Jaakko Erkkilä, Petri Toiviainen, and Kari Riikkilä. 2009. Predicting Music Therapy Clients' Type of Mental Disorder Using Computational Feature Extraction and Statistical Modelling Techniques. Communications in Computer and Information Science 37, 156--167.

[17]

Henrik H. Lund and Tumi Thorsteinsson. 2012. Social playware for mediating tele-play interaction over distance. Artificial Life and Robotics 16, 4, 435--440.

Digital Library

[18]

Wendy L. Magee (Ed.). 2014. Music Technology in Therapeutic and Health Settings. London: Jessica Kingsley Publishers.

[19]

Richard A. Magill. 1998. Motor Learning Concepts and Applications. Boston: McGraw-Hill.

[20]

John McGowan, Grégory Leplâtre, and Iain McGregor. 2017. CymaSense: A Novel Audio-Visual Therapeutic Tool for People on the Autism Spectrum. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17), 62--71.

Digital Library

[21]

François Michaud and Catherine Théberge-Turmel. 2002. Mobile Robotic Toys and Autism. In Socially Intelligent Agents - Creating Relationships with Computers and Robots. Springer, 125--132.

[22]

Eric B. Miller. 2011. Bio-Guided Music Therapy: A Practitioner's Guide to the Clinical Integration of Music and Biofeedback. London: Jessica Kingsley Publishers.

[23]

Narcís Parés, Anna Carreras, Jaume Durany, Jaume Ferrer, Pere Freixa, David Gomez, Orit Kruglanski, Roc Parés, Ignasi Ribas, Miquel Soler, and Alex Sanjurjo. 2005. Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment. In Proceedings of the conference on Interaction design and children, Colorado, 110--116.

Digital Library

[24]

Alaine E. Reschke-Hernández. 2011. History of music therapy treatment interventions for children with autism. Journal of Music Therapy 48, 2, 169--207.

[25]

Rebecca Schnall, Hwayoung Cho, and Jianfang Liu. 2018. Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study. JMIR Mhealth Uhealth 6, 1, e4.

[26]

SkoogMusic. Skoogmusic | We create music technology that lets anyone make music. Retrieved June, 2019 from http://www.skoogmusic.com/.

[27]

Stoyan R. Stoyanov, Leanne Hides, David J. Kavanagh, and Hollie Wilson. 2016. Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth 4, 2, e72.

[28]

Lilia Villafuerte, Milena Markova, and Sergi Jorda. 2012. Acquisition of social abilities through musical tangible user interface. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12), 745--760.

Digital Library

[29]

Thomas Wosch and Tony Wigram. 2007. Microanalysis in Music Therapy: Methods, Techniques and Applications for Clinicians, Researchers, Educators and Students. Jessica Kingsley Publishers.

Cited By

Sun JYang JZhou GJin YGong J(2024)Understanding Human-AI Collaboration in Music Therapy Through Co-Design with TherapistsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642764(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642764
Feng YWang ZYao YLi HDiao YPeng YMi H(2024)Co-designing the Collaborative Digital Musical Instruments for Group Music TherapyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642649(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642649
Zhou LZhang HWang Y(2024)DramaPlaya: A Multi-sensory Interactive Toolkit for the Home-Based Drama Therapy of Children with Developmental DelaysUniversal Access in Human-Computer Interaction10.1007/978-3-031-60881-0_16(250-263)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60881-0_16
Show More Cited By

Index Terms

CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders
1. Human-centered computing
  1. Interaction design
  2. Ubiquitous and mobile computing
2. Social and professional topics
  1. User characteristics
    1. Age
      1. Children
    2. People with disabilities

Recommendations

Technologies and Music Therapy from the Perspective of Music Therapists
BIBE2020: Proceedings of the Fourth International Conference on Biological Information and Biomedical Engineering

Music therapy has been used to treat individuals with Autism Spectrum Disorders (ASD) for a long period of time. As the development of technologies, both patients and therapists benefit from technological applications. This literature reviews music ...
Robot Assisted Music Therapy: A Case Study with Children Diagnosed with Autism
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

Music therapy is often used for children with autism to improve social interaction, communication, and imitation skills through music. Increasingly, music therapists have incorporated technology into therapy sessions as therapeutic tools. Robotics has ...
Designing Social Playware Mediated Communication with Contingent Feedback Devices
DIS '18 Companion: Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems

A majority of children with neurodevelopmental disorders struggle to acquire communication and social skills. Different types of therapies apply methodologies to encourage social interaction, speech, and vocalizations for these children; however, these ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

October 2019

730 pages

ISBN:9781450366762

DOI:10.1145/3308561

General Chair:
Jeffrey P. Bigham
Carnegie Mellon University., USA
,
Program Chairs:
Shiri Azenkot
Cornell Tech, USA
,
Shaun K. Kane
University of Colorado Boulder, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ASSETS '19

Sponsor:

SIGACCESS

ASSETS '19: The 21st International ACM SIGACCESS Conference on Computers and Accessibility

October 28 - 30, 2019

PA, Pittsburgh, USA

Acceptance Rates

ASSETS '19 Paper Acceptance Rate 41 of 158 submissions, 26%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
585
Total Downloads

Downloads (Last 12 months)111
Downloads (Last 6 weeks)16

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sun JYang JZhou GJin YGong J(2024)Understanding Human-AI Collaboration in Music Therapy Through Co-Design with TherapistsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642764(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642764
Feng YWang ZYao YLi HDiao YPeng YMi H(2024)Co-designing the Collaborative Digital Musical Instruments for Group Music TherapyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642649(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642649
Zhou LZhang HWang Y(2024)DramaPlaya: A Multi-sensory Interactive Toolkit for the Home-Based Drama Therapy of Children with Developmental DelaysUniversal Access in Human-Computer Interaction10.1007/978-3-031-60881-0_16(250-263)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60881-0_16
Cai YLiu ZYang ZTan YZhang JTang S(2023)Starrypia: An AR Gamified Music Adjuvant Treatment Application for Children with Autism Based on Combined TherapyProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606755(1-16)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606755
Dobesh SAlbert JAhmed SSharmin M(2023)Moving Towards an Accessible Approach to Music Therapy for Autistic People: A Systematic Review2023 IEEE 47th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC57700.2023.00069(472-480)Online publication date: Jun-2023
https://doi.org/10.1109/COMPSAC57700.2023.00069
Cheng LLam C(2023)Empowering Children with a Digital Musical Instrument Mobile App: Perspectives of Early Childhood EducatorsInternational Journal of Human–Computer Interaction10.1080/10447318.2023.223313640:18(5373-5383)Online publication date: 7-Jul-2023
https://doi.org/10.1080/10447318.2023.2233136
Monarca ITentori MCibrian F(2023)Understanding the musical interaction of children with autism spectrum disorder using elastic displayPersonal and Ubiquitous Computing10.1007/s00779-022-01703-y27:5(1843-1860)Online publication date: 3-Feb-2023
https://doi.org/10.1007/s00779-022-01703-y
Ibarra-Torres FCaiza GGarcia MBarona-Pico V(2023)Assemblable Musical Device for the Development of Attention in 5-Year-Old ChildrenIntelligent Sustainable Systems10.1007/978-981-19-7660-5_42(489-497)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-981-19-7660-5_42
Gizatdinova YRemizova VSand ASharma SRantanen KHelminen TKylliäinen A(2022)PigScape: An embodied video game for cognitive peer-training of impulse and behavior control in children with ADHDProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3550401(1-4)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3550401
Iijima RShitara AOchiai Y(2022)Designing Gestures for Digital Musical Instruments: Gesture Elicitation Study with Deaf and Hard of Hearing PeopleProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544828(1-8)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3544828
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents