Leveraging Artificial Intelligence Techniques for Effective Scaffolding of Personalized Learning in Workplaces

• Abdelrahman, G., & Wang, Q. (2019, Julie 18). Knowledge tracing with sequential key-value memory networks. Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. Presented at the SIGIR ‘19: The 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Paris France. https://doi.org/10.1145/3331184.3331195

• Albacete, P., Jordan, P., Katz, S., Chounta, I. A., & McLaren, B. M. (2019). The impact of student model updates on contingent scaffolding in a natural-language tutoring system. In S. Isotani, E. Millán, A. Ogan, P. Hastings, B. McLaren, & R. Luckin (Eds.), International conference on artificial intelligence in education (pp. 37–47). Springer. https://doi.org/10.1007/978-3-030-23204-7_4

  Chapter  Google Scholar 

• Alikaniotis, D., Yannakoudakis, H., & Rei, M. (2016, August). Automatic text scoring using neural networks. In 54th annual meeting of the Association for Computational Linguistics, ACL 2016 (pp. 715–725). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/P16-1068

  Chapter  Google Scholar 

• Aragon, S. R., & Johnson, S. D. (2002). Emerging roles and competencies for training in e-learning environments. Advances in Developing Human Resources, 4(4), 424–439. https://doi.org/10.1177/152342202237520

• Azevedo, R., Cromley, J. G., Winters, F. I., Moos, D. C., & Greene, J. A. (2005). Adaptive human scaffolding facilitates adolescents’ self-regulated learning with hypermedia. Instructional Science, 33(5–6), 381–412. https://doi.org/10.1007/s11251-005-1273-8

  Article  Google Scholar 

• Belland, B. R. (2017). Instructional scaffolding in STEM education. Springer. https://doi.org/10.1007/978-3-319-02565-0_2

  Book  Google Scholar 

• Boyer, N. R., Maher, P. A., & Kirkman, S. (2006). Transformative learning in online settings: The use of self-direction, metacognition, and collaborative learning. Journal of Transformative Education, 4(4), 335–361.

  Article  Google Scholar 

• Brookfield, S. (1995). Adult learning: An overview. International Encyclopedia of Education, 10, 375–380.

  Google Scholar 

• Chang, W. C., Yu, H. F., Zhong, K., Yang, Y., & Dhillon, I. S. (2020, August). Taming pretrained transformers for extreme multi-label text classification. In Proceedings of the 26th ACM SIGKDD international conference on Knowledge Discovery & Data Mining, (pp. 3163–3171).

  Google Scholar 

• Chen, C. H. (2014). An adaptive scaffolding e-learning system for middle school students’ physics learning. Australasian Journal of Educational Technology, 30(3), 342–355. https://doi.org/10.14742/ajet.430

  Article  Google Scholar 

• Chounta, I. A. (2019). Combining machine learning and learning analytics to provide personalized, adaptive scaffolding [paper presentation]. In 13th International conference on computer supported collaborative learning (CSCL 2019).

  Google Scholar 

• Clark, R. E., & Hannafin, M. J. (2012). Debate about the benefits of different levels of instructional guidance. In R. A. Reiser & J. V. Dempsey (Eds.), Trends and issues in instructional design and technology (3rd ed., pp. 367–383). Allyn & Bacon.

  Google Scholar 

• Conrad, D. (2014). Workplace communication problems: Inquiries by employees and applicable solutions. Journal of Business Studies Quarterly, 5(4), 105–116.

  Google Scholar 

• Corbett, A. T., & Anderson, J. R. (1994). Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and User-Adapted Interaction, 4(4), 253–278.

  Article  Google Scholar 

• De Laat, M., Joksimovic, S., & Ifenthaler, D. (2020). Artificial intelligence, real-time feedback and workplace learning analytics to support in situ complex problem-solving: A commentary. The International Journal of Information and Learning Technology, 37(5), 267–277. https://doi.org/10.1108/IJILT-03-2020-0026

  Article  Google Scholar 

• Dong, F., Zhang, Y., & Yang, J. (2017). Attention-based recurrent convolutional neural network for automatic essay scoring. In Proceedings of the 21st conference on computational natural language learning (CoNLL 2017) (pp. 153–162).

  Google Scholar 

• Doo, M., Bonk, C., & Heo, H. (2020). A meta-analysis of scaffolding effects in online learning in higher education. International Review of Research in Open and Distributed Learning, 21(3), 60–80. https://doi.org/10.19173/irrodl.v21i3.4638

  Article  Google Scholar 

• Drachsler, H., & Greller, W. (2016). Privacy and analytics: it’s a DELICATE issue: A checklist for trusted learning analytics. In Proceedings of the sixth international conference on learning analytics & knowledge (pp. 89–98).

  Chapter  Google Scholar 

• Duffy, M. C., & Azevedo, R. (2015). Motivation matters: Interactions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system. Computers in Human Behavior, 52, 338–348. https://doi.org/10.1016/j.chb.2015.05.041

  Article  Google Scholar 

• Embretson, S. E., & Reise, S. P. (2021). Item response theory (2nd ed.). Taylor & Francis.

  Google Scholar 

• Gervet, T., Koedinger, K., Schneider, J., & Mitchell, T. (2020). When is deep learning the best approach to knowledge tracing? JEDM Journal of Educational Data Mining, 12(3), 31–54.

  Google Scholar 

• Ghosh, A., Heffernan, N., & Lan, A. S. (2020, Augustus 23). Context-aware attentive knowledge tracing. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Presented at the KDD ‘20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual Event CA USA. https://doi.org/10.1145/3394486.3403282

• Gibbons, H. S., & Wentworth, G. P. (2001). Andrological and pedagogical training differences for online instructors. Online Journal of Distance Learning Administration, 4(3), 1–5.

  Google Scholar 

• Gunasekara, R. C., Nahamoo, D., Polymenakos, L. C., Ciaurri, D. E., Ganhotra, J., & Fadnis, K. P. (2019). Quantized dialog–a general approach for conversational systems. Computer Speech & Language, 54, 17–30. https://doi.org/10.1016/j.csl.2018.06.003

  Article  Google Scholar 

• Gursoy, M. E., Inan, A., Nergiz, M. E., & Saygin, Y. (2017). Privacy-preserving learning analytics: Challenges and techniques. IEEE Transactions on Learning Technologies, 10(1), 68–81. https://doi.org/10.1109/tlt.2016.2607747

  Article  Google Scholar 

• Gwet, K. L. (2014). Handbook of inter-rater reliability: The definitive guide to measuring the extent of agreement among raters. Advanced Analytics.

  Google Scholar 

• Hassell, K. D., Archbold, C. A., & Stichman, A. J. (2011). Comparing the Workplace Experiences of Male and Female Police Officers: Examining Workplace Problems, Stress, Jobc Satisfaction and Consideration of Career Change. International journal of police science & management, 13(1), 37–53. https://doi.org/10.1350/ijps.2011.13.1.217

• Jackson, C., Østerlund, C., Crowston, K., Harandi, M., Allen, S., Bahaadini, S., & Zevin, M. (2020). Teaching citizen scientists to categorize glitches using machine learning guided training. Computers in Human Behavior, 105(106198), 106198. https://doi.org/10.1016/j.chb.2019.106198

  Article  Google Scholar 

• Jennings, J., & Muldner, K. (2020). When does scaffolding provide too much assistance? A code-tracing tutor investigation. International Journal of Artificial Intelligence in Education, 1–36. https://doi.org/10.1007/s40593-020-00217-z

• Katakis, I., Tsoumakas, G., & Vlahavas, I. (2008, September). Multilabel text classification for automated tag suggestion. In Proceedings of the ECML/PKDD (Vol. 18, p. 5).

  Google Scholar 

• Katz, S., Albacete, P., Chounta, I. A., Jordan, P., McLaren, B. M., & Zapata-Rivera, D. (2021). Linking dialogue with student modelling to create an adaptive tutoring system for conceptual physics. International Journal of Artificial Intelligence in Education, 1–49. https://doi.org/10.1007/s40593-020-00226-y

• Ke, Z., & Ng, V. (2019). Automated essay scoring: A survey of the state of the art. IJCAI, 19, 6300–6308. https://doi.org/10.24963/ijcai.2019/879

  Article  Google Scholar 

• Ke, Z., Carlile, W., Gurrapadi, N., & Ng, V. (2018). Learning to give feedback: Modeling attributes affecting argument persuasiveness in student essays. In IJCAI (pp. 4130–4136).

  Google Scholar 

• Khajah, M., Lindsey, R. V., & Mozer, M. C. (2016). How deep is knowledge tracing?. arXiv preprint arXiv:1604.02416.

  Google Scholar 

• Kim, N. J., Belland, B. R., & Walker, A. E. (2018). Effectiveness of computer-based scaffolding in the context of problem-based learning for STEM education: Bayesian meta-analysis. Educational Psychology Review, 30, 397–429. https://doi.org/10.1007/s10648-017-9419-1

  Article  Google Scholar 

• Kinoshita, R., & Ueno, M. (2019). Probability based scaffolding system using Deep Learning. In Proceedings of the Annual Conference of JSAI 33rd Annual Conference. The Japanese Society for Artificial Intelligence.

  Google Scholar 

• Kitto, K., & Knight, S. (2019). Practical ethics for building learning analytics. British Journal of Educational Technology: Journal of the Council for Educational Technology, 50(6), 2855–2870. https://doi.org/10.1111/bjet.12868

  Article  Google Scholar 

• Knowles, M. S. (1968). Andragogy, not pedagogy. Adult Leadership, 16(10), 350–352.

  Google Scholar 

• Knowles, M. (1984). Andragogy in action. Jossey-Bass.

  Google Scholar 

• Lajoie, S. P. (2005). Extending the scaffolding metaphor. Instructional Science, 33(5–6), 541–557. https://doi.org/10.1007/s11251-005-1279-2

  Article  Google Scholar 

• Lepper, M. R., Drake, M. F., & O’Donnell-Johnson, T. (1997). Scaffolding techniques of expert human tutors. In K. Hogan & M. Pressley (Eds.), Advances in learning & teaching. Scaffolding student learning: Instructional approaches and issues (pp. 108–144). Brookline Books.

  Google Scholar 

• Liu, P., Qiu, X., & Huang, X. (2016). Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101.

  Google Scholar 

• Liu, J., Chang, W. C., Wu, Y., & Yang, Y. (2017, August). Deep learning for extreme multi-label text classification. In Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval (pp. 115–124).

  Google Scholar 

• Lu, Y., Wang, D., Meng, Q., & Chen, P. (2020). Towards interpretable deep learning models for knowledge tracing. Opgehaal van http://arxiv.org/abs/2005.06139

• Maderer, J. (2017, January 9). Jill Watson, round three, Georgia Tech course prepares for third semester with virtual teaching assistants. Georgia Tech News Center. Retrieved from http://www.news.gatech.edu/2017/01/09/jill-watson-round-three

• McCallum, A. K. (1999). Multi-label text classification with a mixture model trained by EM. In AAAI 99 workshop on text learning.

  Google Scholar 

• McLean, G. N. (2006). Rethinking adult learning in the workplace. Advances in Developing Human Resources, 8(3), 416–423.

  Article  Google Scholar 

• Page, E. B. (1966). The imminence of... grading essays by computer. The Phi Delta Kappan, 47(5), 238–243. https://www.jstor.org/stable/20371545

  Google Scholar 

• Pardo, A., & Siemens, G. (2014). Ethical and privacy principles for learning analytics. British Journal of Educational Technology: Journal of the Council for Educational Technology, 45(3), 438–450. https://doi.org/10.1111/bjet.12152

  Article  Google Scholar 

• Pavlik, P. I., Jr., Cen, H., & Koedinger, K. R. (2009). Performance factors analysis--a new alternative to knowledge tracing. In V. Dimitrova & R. Mizoguchi (Eds.), Proceedings of the 14th international conference on artificial intelligence in education. Brighton.

  Google Scholar 

• Persing, I., & Ng, V. (2014, June). Modeling prompt adherence in student essays. In Proceedings of the 52nd annual meeting of the Association for Computational Linguistics (vol. 1, Long papers) (pp. 1534–1543).

  Google Scholar 

• Piech, C., Spencer, J., Huang, J., Ganguli, S., Sahami, M., Guibas, L., & Sohl-Dickstein, J. (2015). Deep knowledge tracing. arXiv preprint arXiv:1506.05908.

  Google Scholar 

• Poquet, O., & de Laat, M. (2021). Developing capabilities: Lifelong learning in the age of AI. British Journal of Educational Technology, 52, 1695–1708. https://doi.org/10.1111/bjet.13123

  Article  Google Scholar 

• Pu, S., Converse, G., & Huang, Y. (2021). Deep performance factors analysis for knowledge tracing. In Lecture notes in computer science. Lecture notes in computer science (pp. 331–341). https://doi.org/10.1007/978-3-030-78292-4_27

  Chapter  Google Scholar 

• Puntambekar, S., & Hübscher, R. (2005). Tools for scaffolding students in a complex learning environment: What have we gained and what have we missed? Educational Psychologist, 40(1), 1–12. https://doi.org/10.1207/s15326985ep4001_1

  Article  Google Scholar 

• Reiser, B. J. (2004). Scaffolding complex learning: The mechanisms of structuring and problematizing student work. The Journal of the Learning Sciences, 13(3), 273–304. https://doi.org/10.1207/s15327809jls1303_2

  Article  Google Scholar 

• Rubel, A., & Jones, K. M. L. (2016). Student privacy in learning analytics: An information ethics perspective. The Information Society, 32(2), 143–159. https://doi.org/10.1080/01972243.2016.1130502

  Article  Google Scholar 

• Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(10), 1510–1529.

  Article  Google Scholar 

• Sun, T., Shao, Y., Li, X., Liu, P., Yan, H., Qiu, X., & Huang, X. (2020). Learning sparse sharing architectures for multiple tasks. In Proceedings of the AAAI conference on artificial intelligence (Vol. 34(5), pp. 8936–8943).

  Google Scholar 

• Taylor, D. L., Yeung, M., & Bashet, A. Z. (2021). Personalized and adaptive learning. In J. Ryoo & K. Winkelmann (Eds.), Innovative learning environments in STEM higher education (pp. 17–34). Springer. https://doi.org/10.1007/978-3-030-58948-6_2

  Chapter  Google Scholar 

• Tsutsumi, E., Kinoshita, R., & Ueno, M. (2021). Deep-IRT with independent student and item networks. International Educational Data Mining Society.

  Google Scholar 

• Ueno, M., & Miyazawa, Y. (2018). IRT-based adaptive hints to scaffold learning in programming. IEEE Transactions on Learning Technologies, 11(4), 415–428. https://doi.org/10.1109/tlt.2017.2741960

  Article  Google Scholar 

• Uto, M., Xie, Y., & Ueno, M. (2020, December). Neural automated essay scoring incorporating handcrafted features. In Proceedings of the 28th international conference on computational linguistics (pp. 6077–6088).

  Google Scholar 

• Wachsmuth, H., Al Khatib, K., & Stein, B. (2016, December). Using argument mining to assess the argumentation quality of essays. In Proceedings of COLING 2016, the 26th international conference on computational linguistics: Technical papers (pp. 1680–1691).

  Google Scholar 

• Waight, C. L., & Stewart, B. L. (2005). Valuing the adult learner in e-learning: Part one–a conceptual model for corporate settings. Journal of Workplace Learning, 27(5/6), 337–345.

  Article  Google Scholar 

• Wang, V. C. (2011). Online adult education: Policy, access, completion and equity. In Encyclopedia of information communication technologies and adult education integration (pp. 506–520). IGI Global.

  Chapter  Google Scholar 

• Wang, V., & Kania-Gosche, B. (2010). Rethinking the right teaching methods that work for online learners. International Journal of Adult Vocational Education and Technology (IJAVET), 1(3), 14–26. https://doi.org/10.4018/javet.2010070102

  Article  Google Scholar 

• Winkler, R., Hobert, S., Salovaara, A., Söllner, M., & Leimeister, J. M. (2020, April). Sara, the lecturer: Improving learning in online education with a scaffolding-based conversational agent. In Proceedings of the 2020 CHI conference on human factors in computing systems (pp. 1–14). Association for Computing Machinery Digital Library. https://doi.org/10.1145/3313831.3376781

  Chapter  Google Scholar 

• Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology and Psychiatry, 17(2), 89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

  Article  Google Scholar 

• Wu, J., Huang, Z., Liu, Q., Lian, D., Wang, H., Chen, E., & Wang, S. (2021). Federated deep knowledge tracing. In Proceedings of the 14th ACM international conference on web search and data mining. Presented at the WSDM ‘21: The fourteenth ACM international conference on web search and data mining, virtual event Israel. https://doi.org/10.1145/3437963.3441747

• Xiong, X., Zhao, S., Van Inwegen, E. G., & Beck, J. E. (2016). Going deeper with deep knowledge tracing. In Paper presented at the international conference on educational data mining (EDM). Educational Data Mining Society, Raleigh, NC.

  Google Scholar 

• Yang, B. (2003). Toward a holistic theory of knowledge and adult learning. Human Resource Development Review, 2(2), 106–129.

  Article  Google Scholar 

• Yang, H., & Cheung, L. P. (2018). Implicit heterogeneous features embedding in deep knowledge tracing. Cognitive Computation, 10(1), 3–14. https://doi.org/10.1007/s12559-017-9522-0

  Article  Google Scholar 

• Yeung, C. K. (2019). Deep-IRT: Make deep learning based knowledge tracing explainable using item response theory. Opgehaal van http://arxiv.org/abs/1904.11738

• Yeung, C. K., & Yeung, D. Y. (2018, Junie 26). Addressing two problems in deep knowledge tracing via prediction-consistent regularization. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale. Presented at the L@S ‘18: Fifth (2018) ACM Conference on Learning @ Scale, London United Kingdom. https://doi.org/10.1145/3231644.3231647

• Zhang, L., Xiong, X., Zhao, S., Botelho, A., & Heffernan, N. T. (2017a). Incorporating rich features into deep knowledge tracing. In Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale. Presented at the L@S 2017: Fourth (2017) ACM Conference on Learning @ Scale, Cambridge Massachusetts USA. https://doi.org/10.1145/3051457.3053976

• Zhang, J., Shi, X., King, I., & Yeung, D. Y. (2017b). Dynamic key-value memory networks for knowledge tracing. Proceedings of the 26th international conference on world wide web. Presented at the WWW ‘17: 26th international world wide web conference, Perth Australia. https://doi.org/10.1145/3038912.3052580

Download references