Work in Progress

MyWord: Supporting the Interest-based Learning of Words through a Personal Visual Dictionary

Authors:

Margot Brereton,

Bernd PlodererAuthors Info & Claims

DIS '17 Companion: Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems

Pages 132 - 137

https://doi.org/10.1145/3064857.3079133

Published: 10 June 2017 Publication History

Abstract

In this research we explore how interest-based interactive technologies can support learning, particularly for children for whom receptive language and the pace of the general curriculum can be challenging. We designed and iteratively developed MyWord, a visual dictionary tablet app, which supports the exploration of words through images that represent a child's interest. The prototype was derived from a parent's concept and a one-month deployment with her child. Early findings indicate that MyWord has the potential to support collaborative image curation, browsing and discovery of interests, and writing and spelling practices. This paper bridges knowledge between competency-based learning approaches and technology design. We conclude with reflections on early use of the MyWord app and pose questions to direct future work. \

References

[1]

Stanley Greenspan, Serena Wieder, and Robin Simons. 1998. The child with special needs: Encouraging intellectual and emotional growth. Addison-Wesley/Addison Wesley Longman

[2]

Joshua Hailpern, Karrie Karahalios, Jim Halle, Laura DeThorne, and Mary-Kelsey Coletto. 2008. Visualizations: speech, language & autistic spectrum disorder. In CHI'08 Extended Abstracts on Human Factors in Computing Systems (CHI '08), 3591--3596.

Digital Library

[3]

Joshua Hailpern, Andrew Harris, Reed La Botz, Brianna Birman, and Karrie Karahalios. 2012. Designing visualizations to facilitate multisyllabic speech with children with autism and speech delays. In Proceedings of the Designing Interactive Systems Conference (dis '12) 126--135.

Digital Library

[4]

Gillian R. Hayes, Sen Hirano, Gabriela Marcu, Mohamad Monibi, David H. Nguyen, and Michael Yeganyan. 2010. Interactive visual supports for children with autism. Personal and ubiquitous computing 14, 7: 663--680.

Digital Library

[5]

Steve Hodges, Lyndsay Williams, Emma Berry, Shahram Izadi, James Srinivasan, Alex Butler, Gavin Smyth, Narinder Kapur, and Ken Wood. 2006. SenseCam: A retrospective memory aid. In International Conference on Ubiquitous Computing, 177--193. Springer Berlin Heidelberg

Digital Library

[6]

Felicia Hurewitz and Katharine Beals. 2008. A role for grammar in autism CAIs. In Proceedings of the 7th international conference on Interaction design and children (IDC '08). 73--76. ACM.

Digital Library

[7]

Minkyeong Jeong, YoungTae Kim, Dongsun Yim, SeokJeong Yeon, Seokwoo Song, and John Kim. 2015. Lexical Representation of Emotions for High Functioning Autism (HFA) via Emotional Story Intervention using Smart Media. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, (CHI EA '15) 1983--1988.

Digital Library

[8]

Matthew Kam, Aishvarya Agarwal, Anuj Kumar, Siddhartha Lal, Akhil Mathur, Anuj Tewari, and John Canny. 2008. Designing e-learning games for rural children in India: a format for balancing learning with fun. In Proceedings of the 7th ACM conference on Designing interactive systems (DIS '08) 58--67.

Digital Library

[9]

Ha Kyung Kong, John Lee, Jie Ding, and Karrie Karahalios. 2016. EnGaze: Designing Behavior Visualizations with and for Behavioral Scientists. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16) 1185--1196.

Digital Library

[10]

1145/2901790.2901870 {10} Janice Light and David McNaughton. 2014. Communicative competence for individuals who require augmentative and alternative communication: A new definition for a new era of communication? Augmentative and Alternative Communication. 30, 1: 1-

[11]

Vânia Mendonça, Luísa Coheur, and Alberto Sardinha. 2015. Vithea-kids: a platform for improving language skills of children with autism spectrum disorder. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '15) 345--346

Digital Library

[12]

Julia Merryman, Andrea Tartaro, Miri Arie, and Justine Cassell. 2008. Designing virtual peers for assessment and intervention for children with autism. In Proceedings of the 7th international conference on Interaction design and children (IDC '08) 81--84.

Digital Library

[13]

Thomas Plötz, Nils Y. Hammerla, Agata Rozga, Andrea Reavis, Nathan Call, and Gregory D. Abowd. 2012. Automatic assessment of problem behavior in individuals with developmental disabilities. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12) 391--400.

Digital Library

[14]

David. A. Robb, Stefano Padilla, Thomas S. Methven, Britta Kalkreuter, and Mike J. Chantler. 2016. A Picture Paints a Thousand Words but Can it Paint Just One? In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16) 959--970.

Digital Library

[15]

Pheobe Sengers and Bill Gaver. 2006. Staying open to interpretation: engaging multiple meanings in design and evaluation. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06) 99--108.

Digital Library

[16]

Kristen Shinohara and Josh Tenenberg. 2007. Observing Sara: a case study of a blind person's interactions with technology. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '07) 171--178.

Digital Library

[17]

Cara Wilson, Laurianne Sitbon, Margot Brereton, Daniel Johnson, and Stewart Koplick. 2016. 'Put yourself in the picture': designing for futures with young adults with intellectual disability. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI '16). ACM, New York, NY, USA, 271281.

Digital Library

[18]

Pinata Winoto. 2016. Reflections on the Adoption of Virtual Reality-based Application on Word Recognition for Chinese Children with Autism. In Proceedings of the The 15th International Conference on Interaction Design and Children (IDC '16) 589--594.

Digital Library

Cited By

Glass DYuill N(2023)Moving Together: Social Motor Synchrony in Autistic Peer Partners Depends on Partner and Activity TypeJournal of Autism and Developmental Disorders10.1007/s10803-023-05917-854:8(2874-2890)Online publication date: 13-Jun-2023
https://doi.org/10.1007/s10803-023-05917-8
Scheepmaker LAal TKender KVallis SAal KSmith NMelenhorst MVan Twist AVeenstra MSchuler DMüller CWulf VWeibert AWeibert AWeibert AWeibert A(2022)Ethical Future Environments: Engaging refugees in Smart City participationAdjunct Proceedings of the 2022 Nordic Human-Computer Interaction Conference10.1145/3547522.3547704(1-5)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3547522.3547704
Taylor JWujal Wujal Aboriginal Shire Council WSoro ABrereton M(2022)Tangible ‘Design Non-Proposals’ for Relationship Building in Community-Based Co-Design ProjectsProceedings of the Participatory Design Conference 2022 - Volume 110.1145/3536169.3537780(63-74)Online publication date: 19-Aug-2022
https://dl.acm.org/doi/10.1145/3536169.3537780
Show More Cited By

Index Terms

MyWord: Supporting the Interest-based Learning of Words through a Personal Visual Dictionary
1. Social and professional topics

Recommendations

MyWord: enhancing engagement, interaction and self-expression with minimally-verbal children on the autism spectrum through a personal audio-visual dictionary
IDC '18: Proceedings of the 17th ACM Conference on Interaction Design and Children

Digital technologies to support children on the autism spectrum often offer predefined content for modelling, communicating and training. However, children may not relate to the content, and it may not match their own personal interests and motivations. ...
SensoryPaint: a multimodal sensory intervention for children with neurodevelopmental disorders
UbiComp '14: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Multimodal and natural user interfaces offer an innovative approach to sensory integration therapies. We designed and developed SensoryPaint, a multimodal system that allows users to paint on a large display using physical objects, body-based ...
Evaluating an iPad Game to Address Overselectivity in Preliterate AAC Users with Minimal Verbal Behavior
ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Overselectivity is a learning challenge that is largely unaddressed in the assistive technology community. Screening and intervention, done by specialists, is time-intensive and requires substantial training. Little to no treatments are available to the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '17 Companion: Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems

June 2017

424 pages

ISBN:9781450349918

DOI:10.1145/3064857

General Chair:
Oli Mival
Edinburgh Napier University, UK
,
Program Chairs:
Michael Smyth
Edinburgh Napier University, UK
,
Peter Dalsgaard
Aarhus University, Denmark

Copyright © 2017 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 June 2017

Check for updates

Author Tags

Qualifiers

Work in progress

Conference

DIS '17

Sponsor:

SIGCHI

DIS '17: Designing Interactive Systems Conference 2017

June 10 - 14, 2017

Edinburgh, United Kingdom

Acceptance Rates

DIS '17 Companion Paper Acceptance Rate 107 of 487 submissions, 22%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
214
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Glass DYuill N(2023)Moving Together: Social Motor Synchrony in Autistic Peer Partners Depends on Partner and Activity TypeJournal of Autism and Developmental Disorders10.1007/s10803-023-05917-854:8(2874-2890)Online publication date: 13-Jun-2023
https://doi.org/10.1007/s10803-023-05917-8
Scheepmaker LAal TKender KVallis SAal KSmith NMelenhorst MVan Twist AVeenstra MSchuler DMüller CWulf VWeibert AWeibert AWeibert AWeibert A(2022)Ethical Future Environments: Engaging refugees in Smart City participationAdjunct Proceedings of the 2022 Nordic Human-Computer Interaction Conference10.1145/3547522.3547704(1-5)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3547522.3547704
Taylor JWujal Wujal Aboriginal Shire Council WSoro ABrereton M(2022)Tangible ‘Design Non-Proposals’ for Relationship Building in Community-Based Co-Design ProjectsProceedings of the Participatory Design Conference 2022 - Volume 110.1145/3536169.3537780(63-74)Online publication date: 19-Aug-2022
https://dl.acm.org/doi/10.1145/3536169.3537780
Kulkami AChu SSharma NSathe S(2022)Interest-Based Learning through a Contextualizing Chatbot for Video-Based Online Learning Platforms2022 International Conference on Advanced Learning Technologies (ICALT)10.1109/ICALT55010.2022.00027(66-70)Online publication date: Jul-2022
https://doi.org/10.1109/ICALT55010.2022.00027
Ertl TMüller CAal KWulf VTachtler FScheepmaker LFitzpatrick GSmith NSchuler D(2021)Ethical Future Environments: Smart Thinking about Smart Cities means engaging with its Most VulnerableProceedings of the 10th International Conference on Communities & Technologies - Wicked Problems in the Age of Tech10.1145/3461564.3468165(340-345)Online publication date: 20-Jun-2021
https://dl.acm.org/doi/10.1145/3461564.3468165
Bircanin FSitbon LPloderer BAzaabanye Bayor AEsteban MKoplick SBrereton M(2020)The TalkingBox.Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3373625.3417025(1-8)Online publication date: 26-Oct-2020
https://dl.acm.org/doi/10.1145/3373625.3417025
Wilson CBrewster SFitzpatrick GCox AKostakos V(2019)Co-Designing Digital Technologies to Support Minimally-Verbal Children on the Autism SpectrumExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3299076(1-6)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290607.3299076
Bayor ABouhlel MJere N(2018)Co-designing with young adults with intellectual disability to develop social life skillsProceedings of the Second African Conference for Human Computer Interaction: Thriving Communities10.1145/3283458.3283517(1-5)Online publication date: 3-Dec-2018
https://dl.acm.org/doi/10.1145/3283458.3283517
Wilson CBrereton MPloderer BSitbon LGiannakos MJaccheri LDivitini M(2018)MyWordProceedings of the 17th ACM Conference on Interaction Design and Children10.1145/3202185.3202755(106-118)Online publication date: 19-Jun-2018
https://dl.acm.org/doi/10.1145/3202185.3202755

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents