abstract

Robotic Sonification for Promoting Emotional and Social Interactions of Children with ASD

Authors:

Ruimin Zhang,

Myounghoon Jeon,

Chung Hyuk Park,

Ayanna HowardAuthors Info & Claims

HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts

Pages 111 - 112

https://doi.org/10.1145/2701973.2702033

Published: 02 March 2015 Publication History

Get Access

Abstract

Deficiency in social interaction is one of the most crucial issues for children with Autism Spectrum Disorder (ASD). To foster their emotional and social communication, we have developed an orchestration robot platform. After describing our concepts of the use of sonification in the intervention sessions, we describe our efforts in developing a facial expression detection system and implementing a platform-free sonification server system.

References

[1]

Paul, R., Shriberg, L., McSweeney, J., Cicchetti, D., Klin, A. and Volkmar, R. 2005. Relations between prosodic performance and communication and socialization ratings in high functioning speakers with autism spectrum disorders. Journal of Autism and Developmental Disorders. 35 (2005), 861--869.

Crossref

Google Scholar

[2]

Castillo-Perez, S., Gomez-Perez, V., Velasco, M. C., Perez-Campos, E. and Mayoral, M.-A. 2010. Effects of music therapy on depression compared with psychotherapy. The Arts in Psychotherapy. 37 (2010), 387--390.

Crossref

Google Scholar

[3]

Wilson, F. 1988. Music and medicine: An old liasion, a new agenda. Psychomusicology: A Journal of Research in Music Cognition. 7, 2 (1988), 139--146.

Google Scholar

[4]

Kim, Y., Kwak, S. S. and Kim, M.-S. 2013. Am I acceptable to you? Effect of a robot's verbal language forms on people's social distance from robots. Computers in Human Behavior. 29 (2013), 1091--1101.

Digital Library

Google Scholar

[5]

Weinberg, G., Driscoll, S. and Parry, M. 2005. Musical interactions with a perceptual robotic percussionist. In Proceedings of IEEE International Workshop on Robot and Human Interactive Communication (Nashiville, TN, 2005). RO-MAN 2005. IEEE, 456--461.

Google Scholar

[6]

Mukhopadhyay, T. 2007. The Mind Tree. Riverhead Trade.

Google Scholar

[7]

Liao S., Zhu, X., Lei, Z., Zhang, L., and Li, S. Z. 2007. Learning multi-scale block local binary patterns for face recognition. In: Lee, S.-W., Li, S. Z. (eds.) ICB 2007. LNCS. 4642. Springer, Heidelberg (2007) 828--837.

Digital Library

Google Scholar

Cited By

View all

Alessandrini A(2023)Do Children with Autism Benefit from Educational Interventions Utilizing a Tangible Interface and Audio-augmented Drawings?Proceedings of the European Conference on Cognitive Ergonomics 202310.1145/3605655.3605680(1-8)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3605655.3605680
Robinson FBown OVelonaki M(2023)Spatially Distributed Robot Sound: A Case StudyProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596095(2707-2717)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596095
Robinson FBown OVelonaki M(2023)The Robot SoundscapeCultural Robotics: Social Robots and Their Emergent Cultural Ecologies10.1007/978-3-031-28138-9_3(35-65)Online publication date: 12-May-2023
https://doi.org/10.1007/978-3-031-28138-9_3
Show More Cited By

Index Terms

Robotic Sonification for Promoting Emotional and Social Interactions of Children with ASD
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing
2. Information systems
  1. Information retrieval
    1. Specialized information retrieval
      1. Multimedia and multimodal retrieval
        Music retrieval

Recommendations

Multisensory Robotic Therapy to Promote Natural Emotional Interaction for Children with ASD
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

Children with autism have a hard time both with expressing their emotions, and with understanding the emotions of others. As the population of children with autism increases, it is crucial we create effective therapeutic programs that will improve their ...
Emotional Robot to Examine Differences in Play Patterns and Affective Response of Children with and Without ASD
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

Robots are often employed to proactively engage children with Autism Spectrum Disorder (ASD) in well-defined physical or social activities to promote specific educational or therapeutic outcomes. However, much can also be learned by leveraging a robot's ...
Robotic animals might aid in the social development of children with autism
HRI '08: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction

This study investigated whether a robotic dog might aid in the social development of children with autism. Eleven children diagnosed with autism (ages 5-8) interacted with the robotic dog AIBO and, during a different period within the same experimental ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts

March 2015

336 pages

ISBN:9781450333184

DOI:10.1145/2701973

General Chairs:
Julie A. Adams
Vanderbilt University, USA
,
William Smart
Oregon State University, USA
,
Program Chairs:
Bilge Mutlu
University of Wisconsin-Madison, USA
,
Leila Takayama
Google[x], USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2015

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

National Institutes of Health

Conference

HRI '15

Sponsor:

HRI '15: ACM/IEEE International Conference on Human-Robot Interaction

March 2 - 5, 2015

Oregon, Portland, USA

Acceptance Rates

HRI'15 Extended Abstracts Paper Acceptance Rate 92 of 102 submissions, 90%;

Overall Acceptance Rate 192 of 519 submissions, 37%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
335
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alessandrini A(2023)Do Children with Autism Benefit from Educational Interventions Utilizing a Tangible Interface and Audio-augmented Drawings?Proceedings of the European Conference on Cognitive Ergonomics 202310.1145/3605655.3605680(1-8)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3605655.3605680
Robinson FBown OVelonaki M(2023)Spatially Distributed Robot Sound: A Case StudyProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596095(2707-2717)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596095
Robinson FBown OVelonaki M(2023)The Robot SoundscapeCultural Robotics: Social Robots and Their Emergent Cultural Ecologies10.1007/978-3-031-28138-9_3(35-65)Online publication date: 12-May-2023
https://doi.org/10.1007/978-3-031-28138-9_3
Johansen Svan Berkel NFritsch J(2022)Characterising Soundscape Research in Human-Computer InteractionProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533458(1394-1417)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533458
Nadri CDong JSwaim HKo SSanghavi HJeon M(2021)Investigating the Effects of Demographics and Framing on the Robot-Theater ProgramProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118132064111064:1(485-489)Online publication date: 9-Feb-2021
https://doi.org/10.1177/1071181320641110
Frid EBresin R(2021)Perceptual Evaluation of Blended Sonification of Mechanical Robot Sounds Produced by Emotionally Expressive Gestures: Augmenting Consequential Sounds to Improve Non-verbal Robot CommunicationInternational Journal of Social Robotics10.1007/s12369-021-00788-414:2(357-372)Online publication date: 22-May-2021
https://doi.org/10.1007/s12369-021-00788-4
Robinson Fvan den Hoven ELoke LShaer Ovan Dijk JKun A(2020)Audio CellsProceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3374920.3374999(955-960)Online publication date: 9-Feb-2020
https://dl.acm.org/doi/10.1145/3374920.3374999
Landry SJeon M(2020)Interactive sonification strategies for the motion and emotion of dance performancesJournal on Multimodal User Interfaces10.1007/s12193-020-00321-314:2(167-186)Online publication date: 14-Mar-2020
https://doi.org/10.1007/s12193-020-00321-3
Opie JJaiprakash APloderer BBrereton MRoberts J(2019)Towards Surgical RobotsProceedings of the 31st Australian Conference on Human-Computer-Interaction10.1145/3369457.3370916(255-265)Online publication date: 2-Dec-2019
https://dl.acm.org/doi/10.1145/3369457.3370916
Opie JJaiprakash APloderer BCrawford RBrereton MRoberts JBuchanan GStevenson D(2018)Understanding the challenges and needs of knee arthroscopy surgeons to inform the design of surgical robotsProceedings of the 30th Australian Conference on Computer-Human Interaction10.1145/3292147.3292213(458-462)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3292147.3292213
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Multisensory Robotic Therapy to Promote Natural Emotional Interaction for Children with ASD

Emotional Robot to Examine Differences in Play Patterns and Affective Response of Children with and Without ASD

Robotic animals might aid in the social development of children with autism