demonstration

A gamified and adaptive learning system for neurodivergent workers in electronic assembling tasks

Authors:

Moritz Umfahrer,

Oliver KornAuthors Info & Claims

MuC '20: Proceedings of Mensch und Computer 2020

Pages 491 - 494

https://doi.org/10.1145/3404983.3410420

Published: 06 September 2020 Publication History

Abstract

Learning and work-oriented assistive systems are often designed to fit the workflow of neurotypical workers. Neurodivergent workers and individuals with learning disabilities often present cognitive and sensorimotor characteristics that are better accommodated with personalized learning and working processes. Therefore, we designed an adaptive learning system that combines an augmented interaction space with user-sensitive virtual assistance to support step-by-step guidance for neurodivergent workers in electronic assembling tasks. Gamified learning elements were also included in the interface to provide self-motivation and praise whenever users progress in their learning and work achievements.

References

[1]

Alyssa Alcorn, Helen Pain, Gnanathusharan Rajendran, Tim Smith, Oliver Lemon, Kaska Porayska-Pomsta, Mary Ellen Foster, Katerina Avramides, Christopher Frauenberger, and Sara Bernardini. 2011. Social communication between virtual characters and children with autism. In Proceedings of the 15th international conference on Artificial intelligence in education (AIED'11), Gautam Biswas, Susan Bull, Judy Kay, and Antonija Mitrovic (Eds.). Springer - Verlag, Berlin, Heidelberg, 7 -- 14.

Digital Library

[2]

Cynthia Putnam and Lorna Chong. 2008. Software and technologies designed for people with autism: what do users want? In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility (Assets '08). ACM, New York, NY, USA, 3--10.

Digital Library

[3]

European Disability Forum. 2019. The Europe 2020 strategy for Employment. http://www.edf-feph.org/employment

[4]

Eurostat. 2018. Disability statistics - labour market access. https://ec.europa.eu/eurostat/statistics-explained/pdfscache/34420.pdf

[5]

Ganit Richter, Daphne R. Raban, Sheizaf Rafaeli. 2015. Studying Gamification: The Effects of Rewards and Incentives on Motivation. In: T. Reiners, L. Wood (eds) Gamification in Education and Business. Springer.

[6]

Ian Glover. 2013. Play as You Learn: Gamification as a Technique for Motivating Learners. In Proceedings of EdMedia 2013 - Conference on Educational Media and Technology. AACE, Victoria, Canada.

[7]

Juho Hamari. 2017. Do badges increase user activity? A field experiment on the effects of gamification. Computers in Human Behavior. 71, 469--478.

Digital Library

[8]

Juneyoung Park, Seunghyun Kim, Auk Kim, and Mun Y. Yi. 2019. Learning to be better at the game: Performance vs. completion contingent reward for game-based learning. Computers & Education. 139, 1, 1--15.

Digital Library

[9]

Kaska Porayska-Pomsta, Christopher Frauenberger, Helen Pain, Gnanathusharan Rajendran, et al. 2012. Developing technology for autism: an interdisciplinary approach. Personal and Ubiquitous Computing. 16, 2, 117--127.

Digital Library

[10]

Katie Gaudion, Ashley Hall, Jeremy Myerson, and Liz Pellicano. 2015. A designer's approach: how can autistic adults with learning disabilities be involved in the design process? CoDesign. 11, 1, 49--69.

[11]

Markus Funk, Andreas Bächler, Liane Bächler, Oliver Korn, Christoph Krieger, Thomas Heidenreich, and Albrecht Schmidt. 2015. Comparing projected in-situ feedback at the manual assembly workplace with impaired workers. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '15). ACM, New York, NY, USA, Article 1, 1--8.

Digital Library

[12]

Michael Sailer, Jan Ulrich Hense, Sarah Katharina Mayr, and Heinz Mandl. 2017. How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior. 69, 371--380.

Digital Library

[13]

Oliver Korn, Albrecht Schmidt, and Thomas Hörz. 2013. The potentials of in-situ-projection for augmented workplaces in production: a study with impaired persons. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 979--984.

Digital Library

[14]

Oliver Korn, Markus Funk, and Albrecht Schmidt. 2015. Towards a gamification of industrial production: a comparative study in sheltered work environments. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '15). ACM, New York, NY, USA, 84--93.

Digital Library

[15]

Oliver Korn. 2012. Industrial playgrounds: how gamification helps to enrich work for elderly or impaired persons in production. In Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems (EICS '12). ACM, New York, NY, USA, 313--316.

Digital Library

[16]

Ramin Yaghoubzadeh, Marcel Kramer, Karola Pitsch, and Stefan Kopp. 2013. Virtual agents as daily assistants for elderly or cognitively impaired people: Studies on acceptance and interaction feasibility. In Proceedings of the International Workshop on Intelligent Virtual Agents (IVA 2013). Lecture Notes in Computer Science, vol 8108, 79--91. Springer, Berlin, Heidelberg.

[17]

Sarah Parsons and Peter Mitchell. 2002. The potential of virtual reality in social skills training for people with autistic spectrum disorders. Journal of Intellectual Disability Research. 46, 5, 430--443.

[18]

Tina R. Goldsmith and Linda A. LeBlanc. 2004. Use of technology in interventions for children with autism. Journal of Early and Intensive Behavior Intervention. 1, 2, 166--178.

Cited By

Agati SHounsell MPaterno A(2024)GRAAL—modeling, prototyping and assessing a gamified responsible augmented assembly line systemThe International Journal of Advanced Manufacturing Technology10.1007/s00170-024-13460-8132:5-6(2735-2751)Online publication date: 3-Apr-2024
https://doi.org/10.1007/s00170-024-13460-8
Bonello AFrancalanza ERefalo P(2023)Smart and Sustainable Human-Centred Workstations for Operators with Disability in the Age of Industry 5.0: A Systematic ReviewSustainability10.3390/su1601028116:1(281)Online publication date: 28-Dec-2023
https://doi.org/10.3390/su16010281
Theil AAnderton CCreed COlson NHolt RSarcar S(2023)Accessibility Research and Users with Multiple Disabilities or Complex NeedsProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3615651(1-6)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3615651
Show More Cited By

Index Terms

A gamified and adaptive learning system for neurodivergent workers in electronic assembling tasks
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
    2. Interactive systems and tools
2. Social and professional topics
  1. User characteristics
    1. People with disabilities

Recommendations

Wearable head-mounted 3D tactile display application scenarios
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Current generation virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) usually include no or only a single vibration motor for haptic feedback and do not use it for guidance. In a previous work, we presented HapticHead, a ...
Context-aware assistive systems at the workplace: analyzing the effects of projection and gamification
PETRA '14: Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments

Context-aware assistive systems (CAAS) have become ubiquitous in cars or smartphones but not in industrial work contexts: while there are systems controlling work results, context-specific assistance during the processes is hardly offered. As a result ...
Computerized Assessment of the Skills of Impaired and Elderly Workers: A Tool Survey and Comparative Study
PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

The number of impaired persons rises -- as a result of both regular degradation with age and psychological problems like burnout. Sheltered work organizations aim to reintegrate impaired persons into work environments and prepare them for the re-entry ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '20: Proceedings of Mensch und Computer 2020

September 2020

523 pages

ISBN:9781450375405

DOI:10.1145/3404983

General Chairs:
Bernhard Preim
Universität Magdeburg
,
Andreas Nürnberger
Universität Magdeburg
,
Christian Hansen
Universität Magdeburg

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 September 2020

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

Bundesministerium für Bildung und Forschung

Conference

MuC'20

MuC'20: Mensch und Computer 2020

September 6 - 9, 2020

Magdeburg, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
253
Total Downloads

Downloads (Last 12 months)67
Downloads (Last 6 weeks)9

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Agati SHounsell MPaterno A(2024)GRAAL—modeling, prototyping and assessing a gamified responsible augmented assembly line systemThe International Journal of Advanced Manufacturing Technology10.1007/s00170-024-13460-8132:5-6(2735-2751)Online publication date: 3-Apr-2024
https://doi.org/10.1007/s00170-024-13460-8
Bonello AFrancalanza ERefalo P(2023)Smart and Sustainable Human-Centred Workstations for Operators with Disability in the Age of Industry 5.0: A Systematic ReviewSustainability10.3390/su1601028116:1(281)Online publication date: 28-Dec-2023
https://doi.org/10.3390/su16010281
Theil AAnderton CCreed COlson NHolt RSarcar S(2023)Accessibility Research and Users with Multiple Disabilities or Complex NeedsProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3615651(1-6)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3615651
Wang MJeon M(2023)Assistive Technology for Adults on the Autism Spectrum: A Systematic SurveyInternational Journal of Human–Computer Interaction10.1080/10447318.2022.216356840:10(2433-2452)Online publication date: 8-Jan-2023
https://doi.org/10.1080/10447318.2022.2163568
Peltokorpi JHoedt SColman TRutten KAghezzaf ECottyn J(2023)Manual assembly learning, disability, and instructions: an industrial experimentInternational Journal of Production Research10.1080/00207543.2023.219595761:22(7903-7921)Online publication date: 11-Apr-2023
https://doi.org/10.1080/00207543.2023.2195957
Caserman PBaumgartner KGöbel SKorn O(2023)A best practice for gamification in large companies: An extensive study focusing inter-generational acceptanceMultimedia Tools and Applications10.1007/s11042-023-16877-783:12(35175-35195)Online publication date: 28-Sep-2023
https://doi.org/10.1007/s11042-023-16877-7
Ramadhan AWarnars HRazak F(2023)Combining intelligent tutoring systems and gamification: a systematic literature reviewEducation and Information Technologies10.1007/s10639-023-12092-x29:6(6753-6789)Online publication date: 9-Aug-2023
https://doi.org/10.1007/s10639-023-12092-x
Spiel KHornecker EWilliams RGood J(2022)ADHD and Technology Research – Investigated by Neurodivergent ReadersProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517592(1-21)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517592
Sousa Calepso AHube NBerenguel Senn NBrandt VSedlmair M(2022)cARdLearner: Using Expressive Virtual Agents when Learning Vocabulary in Augmented RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519631(1-6)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519631
Korn O(2022)Gamification in Industrial Production: An Overview, Best Practices, and Design RecommendationsHuman-Technology Interaction10.1007/978-3-030-99235-4_10(251-270)Online publication date: 14-Dec-2022
https://doi.org/10.1007/978-3-030-99235-4_10
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents