Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3430895.3460133acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesl-at-sConference Proceedingsconference-collections
research-article

Setting up, Troubleshooting, and Innovating on the Delivery of Online Instruction: A Case Study of an LMS Q&A Forum

Published: 08 June 2021 Publication History

Abstract

With the recent surge in online teaching, increasing numbers of instructors are using learning management systems (LMSs) to migrate their courses online and adapt their teaching methods. Given the steep learning curve for these feature-rich software applications, many instructors turn to online Q&A forums for help with learning and troubleshooting their LMS. We analyzed the content of 250 posts from a community-based Q&A forum for Canvas, a widely-used LMS, finding several recurring themes that illustrate how instructors are setting up courses for the first time, facilitating shared experiences between their students, and even seeking innovative ways to customize their course delivery. Our findings shed light on key barriers driving instructors to seek help and to what extent their help needs are actually addressed by the community. We discuss several opportunities for improving the design of LMSs and for better understanding and supporting instructors' custom needs to enhance their course delivery.

Supplementary Material

MP4 File (L-at-S21-lsfp022.mp4.mp4)
This video is for Learning At Scale 2021 for the paper titled: Setting up, Troubleshooting, and Innovating on the Delivery of Online Instruction: A Case Study of a Learning Management System (LMS)?s Q&A forum. We analyzed the content of 250 posts from a community-based Q&A forum for the Canvas LMS finding several recurring themes that illustrate how instructors are setting up courses for the first time, facilitating shared experiences between their students, and even seeking innovative ways to customize their course delivery. Our findings shed light on key barriers driving instructors to seek help and to what extent their help needs are actually addressed by the community. We discuss several opportunities for improving the design of LMSs and for better understanding and supporting instructors? custom needs to enhance their course delivery.

References

[1]
Pengcheng An, Saskia Bakker, Sara Ordanovski, Ruurd Taconis, Chris LE Paffen, and Berry Eggen. 2019. Unobtrusively enhancing reflection-in-action of teachers through spatially distributed ambient information. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--14.
[2]
Pengcheng An, Kenneth Holstein, Bernice d'Anjou, Berry Eggen, and Saskia Bakker. 2020. The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--17.
[3]
Yun-Jo An and Charles Reigeluth. 2011. Creating technology-enhanced, learner-centered classrooms: K--12 teachers' beliefs, perceptions, barriers, and support needs. Journal of Digital Learning in Teacher Education 28, 2 (2011), 54--62.
[4]
Jeffrey P Carpenter, Daniel G Krutka, and others. 2021. Continuity and change in educators' professional learning networks. Journal of Educational Change (2021), 1--29.
[5]
Rebeca Cerezo, Miguel Sánchez-Santillán, M Puerto Paule-Ruiz, and J Carlos Nú nez. 2016. Students' LMS interaction patterns and their relationship with achievement: A case study in higher education. Computers & Education 96 (2016), 42--54.
[6]
Andy Cockburn, Carl Gutwin, Joey Scarr, and Sylvain Malacria. 2014. Supporting novice to expert transitions in user interfaces. ACM Computing Surveys (CSUR) 47, 2 (2014), 1--36.
[7]
Leovy Echeverria, Ruth Cobos, and Mario Morales. 2013. Designing and evaluating collaborative learning scenarios in Moodle LMS Courses. In International Conference on Cooperative Design, Visualization and Engineering. Springer, 61--66.
[8]
edutechnica. 2020. LMS Data -- Spring 2020 Updates. (2020). https://edutechnica.com/2020/02/02/lms-data-spring-2020-updates/
[9]
Natalya Emelyanova and Elena Voronina. 2014. Introducing a learning management system at a Russian university: Students' and teachers' perceptions. International Review of Research in Open and Distributed Learning 15, 1 (2014), 272--289.
[10]
Christian Fischer, Barry Fishman, and Sarita Yardi Schoenebeck. 2019. New contexts for professional learning: Analyzing high school science teachers' engagement on Twitter. AERA Open 5, 4 (2019), 2332858419894252.
[11]
Cynthia Gautreau. 2011. Motivational factors affecting the integration of a learning management system by faculty. Journal of Educators Online 8, 1 (2011), n1.
[12]
Lesley Gourlay. 2011. New lecturers and the myth of "communities of practice'. Studies in continuing education 33, 1 (2011), 67--77.
[13]
Anthony Herrington, Jan Herrington, Lisa Kervin, and Brian Ferry. 2006. The design of an online community of practice for beginning teachers. Contemporary issues in technology and teacher education 6, 1 (2006), 120--132.
[14]
Kenneth Holstein, Gena Hong, Mera Tegene, Bruce M McLaren, and Vincent Aleven. 2018. The classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers. In Proceedings of the 8th international conference on learning Analytics and knowledge. 79--88.
[15]
Nathaniel Hudson, Parmit K Chilana, Xiaoyu Guo, Jason Day, and Edmund Liu. 2015. Understanding triggers for clarification requests in community-based software help forums. In 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 189--193.
[16]
Eun-Ok Im and Wonshik Chee. 2006. An online forum as a qualitative research method: practical issues. Nursing research 55, 4 (2006), 267.
[17]
Eun-Ok Im and Wonshik Chee. 2012. Practical guidelines for qualitative research using online forums. Computers, informatics, nursing: CIN 30, 11 (2012), 604.
[18]
IMS Global Learning Consortium. 2020. Learning Tools Interoperability. (2020). https://www.imsglobal.org/activity/learning-tools-interoperability
[19]
Instructure, Inc. 2020a. Canvas LMS | Learning Management System | Instructure. (2020). https://www.instructure.com/canvas/
[20]
Instructure, Inc. 2020b. Home - Canvas Community. (2020). https://community.canvaslms.com/
[21]
Johannes König, Daniela J J"ager-Biela, and Nina Glutsch. 2020. Adapting to online teaching during COVID-19 school closure: teacher education and teacher competence effects among early career teachers in Germany. European Journal of Teacher Education (2020), 1--15.
[22]
Alyssa Lai and Philip Savage. 2013. Learning management systems and principles of good teaching: Instructor and student perspectives. Canadian Journal of Learning and Technology 39, 3 (2013), n3.
[23]
Markets and Markets. 2020. Smart Learning Market by Software & Services. (2020). https://www.marketsandmarkets.com/Market-Reports/smart-digital-education-market-571.html
[24]
Gali Naveh, Dorit Tubin, and Nava Pliskin. 2010. Student LMS use and satisfaction in academic institutions: The organizational perspective. The Internet and Higher Education 13, 3 (2010), 127--133.
[25]
I. B. L. News. 2020. Canvas LMS Increases Its Lead to 30 Million Users, According to Its CEO's Data textbar IBL News. (2020). https://iblnews.org/canvas-lms-increases-its-lead-to-30-million-users/
[26]
Sarah Prestridge. 2010. ICT professional development for teachers in online forums: Analysing the role of discussion. Teaching and Teacher Education 26, 2 (2010), 252--258.
[27]
Susan M Printy. 2008. Leadership for teacher learning: A community of practice perspective. Educational administration quarterly 44, 2 (2008), 187--226.
[28]
Chrysi Rapanta, Luca Botturi, Peter Goodyear, Lourdes Guàrdia, and Marguerite Koole. 2020. Online university teaching during and after the Covid-19 crisis: Refocusing teacher presence and learning activity. Postdigital Science and Education (2020), 1--23.
[29]
Respondus, Inc. 2020. LockDown Browser - Respondus. (2020). https://web.respondus.com/he/lockdownbrowser/
[30]
Eunice Sari and Jan Herrington. 2013. Using design-based research to investigate the design and development of an online community of practice for teacher professional development. In EdMedia+ Innovate Learning. Association for the Advancement of Computing in Education (AACE), 121--127.
[31]
Abigail Sellen and Anne Nicol. 1995. Building user-centered on-line help. In Readings in Human-Computer Interaction. Elsevier, 718--723.
[32]
Vandana Singh and Michael B Twidale. 2008. The confusion of crowds: non-dyadic help interactions. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work. 699--702.
[33]
Vandana Singh, Michael B Twidale, and Dinesh Rathi. 2006. Open source technical support: A look at peer help-giving. In Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06), Vol. 6. IEEE, 118c--118c.
[34]
Anselm Strauss and Juliet Corbin. 1990. Basics of qualitative research: Grounded theory procedures and techniques. Sage publications.
[35]
Pei-Chen Sun, Ray J Tsai, Glenn Finger, Yueh-Yang Chen, and Dowming Yeh. 2008. What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & education 50, 4 (2008), 1183--1202.
[36]
Michael A Tagoe and Yaa Cole. 2020. Using the Sakai Learning Management System to change the way Distance Education nursing students learn: are we getting it right? Open Learning: The Journal of Open, Distance and e-Learning (2020), 1--21.
[37]
Jie Teo and Aditya Johri. 2013. Experts Learn More (than Newcomers): An Exploratory Study of Argumentation in an Online Help Forum. (2013).
[38]
Maria Tomprou, Laura Dabbish, Robert E Kraut, and Fannie Liu. 2019. Career Mentoring in Online Communities: Seeking and Receiving Advice from an Online Community. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--12.
[39]
Carla Van de Sande. 2011. A description and characterization of student activity in an open, online, mathematics help forum. Educational Studies in Mathematics 77, 1 (2011), 53--78.
[40]
Laton Vermette, Joanna McGrenere, Colin Birge, Adam Kelly, and Parmit K Chilana. 2019. Freedom to personalize my digital classroom: Understanding teachers' practices and motivations. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--14.
[41]
Laton Vermette, Joanna McGrenere, and Parmit K Chilana. 2020. Peek-through Customization: Example-Based In-Context Sharing for Learning Management Systems. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. 1155--1167.
[42]
Etienne Wenger. 1999. Communities of practice: Learning, meaning, and identity. Cambridge university press.
[43]
Richard E West, Greg Waddoups, and Charles R Graham. 2007. Understanding the experiences of instructors as they adopt a course management system. Educational Technology Research and Development 55, 1 (2007), 1--26.

Cited By

View all
  • (2023)Understanding Peer-to-Peer Instructional Support in an Online Community for Blind Audio ProducersProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608399(1-15)Online publication date: 22-Oct-2023
  • (2022)Uncovering Instructors’ Diverse Practices and Perceptions: A Field Deployment of a Customization-Sharing Platform that Supports Course ManagementProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501846(1-15)Online publication date: 29-Apr-2022

Index Terms

  1. Setting up, Troubleshooting, and Innovating on the Delivery of Online Instruction: A Case Study of an LMS Q&A Forum

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    L@S '21: Proceedings of the Eighth ACM Conference on Learning @ Scale
    June 2021
    380 pages
    ISBN:9781450382151
    DOI:10.1145/3430895
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 June 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. digital classroom tools
    2. help-seeking practices
    3. instructor communities
    4. learning management systems
    5. software help forums
    6. software troubleshooting

    Qualifiers

    • Research-article

    Conference

    L@S '21
    L@S '21: Eighth (2021) ACM Conference on Learning @ Scale
    June 22 - 25, 2021
    Virtual Event, Germany

    Acceptance Rates

    Overall Acceptance Rate 117 of 440 submissions, 27%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Understanding Peer-to-Peer Instructional Support in an Online Community for Blind Audio ProducersProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608399(1-15)Online publication date: 22-Oct-2023
    • (2022)Uncovering Instructors’ Diverse Practices and Perceptions: A Field Deployment of a Customization-Sharing Platform that Supports Course ManagementProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501846(1-15)Online publication date: 29-Apr-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media