Abstract
Video lectures are considered as one of the primary media to cater good-quality educational content to the learners. The video lectures illustrate the course-relevant concepts with necessary details. However, they sometimes fail to offer a basic understanding of off-topic concepts. Such off-topic concepts may spawn cognitive overload among the learners if those concepts are not familiar to them. To address this issue, we present a video lecture augmentation system that identifies the off-topic concepts and links them to relevant video lecture segments to furnish a basic understanding of the concerned concepts. Our augmentation system segregated the video lectures by identifying topical shifts in the lectures using a word embedding-based technique. The video segments were indexed on the basis of the underlying concepts. Identification of off-topic concepts was performed by modeling inter-concept relations in a semantic space. For each off-topic concept, appropriate video segments were fetched and re-ranked such that the top-ranked video segment offers the most basic understanding of the target off-topic concept. The proposed augmentation system was deployed as a web-based learning platform. Performance of the constituent modules was measured by using a manually curated dataset consisting of six video courses from the National Programme on Technology Enhanced Learning (NPTEL) archive. Feedback from 12 research scholars was considered to assess the quality of augmentations and usability of the learning platform. Both system and human-based evaluation indicated that the recommended augmentations were able to offer a basic understanding of the concerned off-topic concepts.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
The data and code are available at https://github.com/KrishnenduGhosh/VL
References
Alemi, A. A., & Ginsparg, P. (2015). Text segmentation based on semantic word embeddings. arXiv:1503.05543.
Alvarez-Socorro, A., Sanz-Rodriguez, C., & Cabrera, J. L. (2015). Weighting dissimilarities to detect communities in networks. Philosophical Transactions of The Royal Society A: Mathematical Physical and Engineering Sciences, 373.
Antonie, M.-L., & Zaiane, O. R. (2002). Text document categorization by term association. In 2002 IEEE International Conference on Data Mining, 2002. Proceedings. (pp. 19–26). IEEE.
Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114–123.
Barrow, J., Jain, R., Morariu, V., Manjunatha, V., Oard, D., & Resnik, P. (2020). A joint model for document segmentation and segment labeling. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 313–322). Association for Computational Linguistics.
Bordogna, G., Carrara, P., & Pasi, G. (1995). Fuzzy approaches to extend boolean information retrieval. In Fuzziness in database management systems (pp. 231–274). Springer.
Brandes, U., Delling, D., Gaertler, M., Gorke, R., Hoefer, M., Nikoloski, Z., & Wagner, D. (2007). On modularity clustering. IEEE Transactions on Knowledge and Data Engineering, 20(2), 172–188.
Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom research into edx’s first MOOC. Research & Practice in Assessment, 8, 13–25.
Brooke, J. (1996). “SUS-A quick and dirty usability scale.” Usability evaluation in industry. CRC Press.
Burges, C. J. (2010). From ranknet to lambdarank to lambdamart: An overview. Technical Report MSR-TR-2010-82.
Caruana, R., Baluja, S., & Mitchell, T. (1996). Using the future to “sort out” the present: Rankprop and multitask learning for medical risk evaluation. In Advances in neural information processing systems (pp. 959–965).
Chen, T.-H., Zeng, K.-H., Hsu, W.-T., & Sun, M. (2016). Video captioning via sentence augmentation and spatio-temporal attention. In Asian Conference on Computer Vision (pp. 269–286). Springer.
Choi, F. Y. Y. (2000). Advances in domain independent linear text segmentation. In Proceedings of the 1st Meeting of the North American Chapter of the Association for Computational Linguistics (pp. 26–33.)
Choi, F., Wiemer-Hastings, P., & Moore, J. (2001). Latent semantic analysis for text segmentation. In Proceedings of 6th Conference on Empirical Methods in Natural Language Processing (pp. 109–117).
Chum, O., Philbin, J., Sivic, J., Isard, M., & Zisserman, A. (2007). Total recall: Automatic query expansion with a generative feature model for object retrieval. In 2007 IEEE 11th International Conference on Computer Vision (pp. 1–8). IEEE.
Clauset, A., Newman, M. E., & Moore, C. (2004). Finding community structure in very large networks. Physical review E, 70(6), 066111.
Cronbach, L. J., & Shavelson, R. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64(3), 391–418.
Cross, A., Bayyapunedi, M., Ravindran, D., Cutrell, E., & Thies, W. (2014). Vidwiki: enabling the crowd to improve the legibility of online educational videos. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (pp. 1167–1175). ACM.
Csurka, G., Dance, C., Fan, L., Willamowski, J., & Bray, C. (2004). Visual categorization with bags of keypoints. In Workshop on statistical learning in computer vision, ECCV, number 1-22 (pp. 1–2). Prague.
Dollmann, M., & Geierhos, M. (2016). On-and off-topic classification and semantic annotation of user-generated software requirements. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (pp. 1807–1816).
Du, L., Buntine, W., & Johnson, M. (2013). Topic segmentation with a structured topic model. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics (pp. 190–200). Human Language Technologies.
Evans, T. S. (2010). Clique graphs and overlapping communities. Journal of Statistical Mechanics: Theory and Experiment, 2010(12), P12037.
Fragkou, P., Petridis, V., & Kehagias, A. (2004). A dynamic programming algorithm for linear text segmentation. Journal of Intelligent Information Systems, 23(2), 179–197.
Freund, Y., Iyer, R., Schapire, R. E., & Singer, Y. (2003). An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research, 4(Nov), 933–969.
Furini, M. (2018). On introducing timed tag-clouds in video lectures indexing. Multimedia Tools and Applications, 77(1), 967–984.
Girvan, M., & Newman, M. E. (2002). Community structure in social and biological networks. Proceedings of the National Academy of Sciences, 99(12), 7821–7826.
Good, B. H., de Montjoye, Y. -A., & Clauset, A. (2010). Performance of modularity maximization in practical contexts. Physical Review E, 046106, 81.
Hearst, M. A. (1997). Texttiling: Segmenting text into multi-paragraph subtopic passages. Computational Linguistics, 23(1), 33–64.
Herbrich, R. (2000). Large margin rank boundaries for ordinal regression. Advances in large margin classifiers, 115–132.
Hsin, W. -J., & Cigas, J. (2013). Short videos improve student learning in online education. Journal of Computer Sciences in Colleges, 28(5), 253–259.
Jordan, K. (2013). MOOC completion rates: The data. e-Learning and Innovative Pedagogies.
Karrer, B., & Newman, M. E. J. (2011). Stochastic blockmodels and community structure in networks. Physical Review E, 8(1).
Kay, J., Reimann, P., Diebold, E., & Kummerfeld, B. (2013). MOOCs: So many learners, so much potential... IEEE Intelligent systems, 28(3), 70–77.
Kravvaris, D., & Kermanidis, K. L. (2019). Automatic point of interest detection for open online educational video lectures. Multimedia Tools and Applications, 78(2), 2465–2479.
Krishna, A., Bhowmick, P., Ghosh, K., Sahu, A., & Roy, S. (2015). Automatic generation and insertion of assessment items in online video courses. In Proceedings of the 20th International Conference on Intelligent User Interfaces Companion (pp. 1–4). ACM.
Kumar, V. (2014). Enhancing video lectures with digital footnotes. In 2014 IEEE Frontiers in Education Conference (FIE) Proceedings (pp. 1–3). IEEE.
Kurland, O., & Lee, L. (2005). Pagerank without hyperlinks: Structural re-ranking using links induced by language models. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’05 (pp. 306–313). New York: ACM.
Kurland, O., & Lee, L. (2006). Respect my authority!: HITS without hyperlinks, utilizing cluster-based language models. In Proceedings of the 29th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 83–90). ACM.
Lancichinetti, A., & Fortunato, S. (2009). Community detection algorithms: a comparative analysis. Physical Review E, 80(5).
Lewis, J. R. (1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 57–78.
Lewis, J. R., & Sauro, J. (2009). The factor structure of the system usability scale. In International conference on human centered design (pp. 94–103). Springer.
Li, N., Kidziński, Ł., & Dillenbourg, P. (2015). Augmenting collaborative MOOC video viewing with synchronized textbook. In IFIP Conference on Human-Computer Interaction (pp. 81–88). Springer.
Li, C., Yates, A., MacAvaney, S., He, B., & Sun, Y. (2020). Parade: Passage representation aggregation for document reranking. arXiv:2008.09093.
Liu, T. -Y., et al. (2009). Learning to rank for information retrieval. Foundations and Trends in Information Retrieval, 3(3), 225–331.
Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems (pp. 3111–3119).
Milligan, C., & Littlejohn, A. (2014). Supporting professional learning in a massive open online course. The International Review of Research in Open and Distributed Learning, 15(5).
Misra, H., Yvon, F., Jose, J. M., & Cappe, O. (2009). Text segmentation via topic modeling: an analytical study. In Proceedings of the 18th ACM conference on Information and knowledge management (pp. 1553–1556). ACM.
Mitrovic, A., Dimitrova, V., Lau, L., Weerasinghe, A., & Mathews, M. (2017). Supporting constructive video-based learning: requirements elicitation from exploratory studies. In International Conference on Artificial Intelligence in Education (pp. 224–237). Springer.
Mitrovic, A., Gordon, M., Piotrkowicz, A., & Dimitrova, V. (2019). Investigating the effect of adding nudges to increase engagement in active video watching. In International Conference on Artificial Intelligence in Education (pp. 320–332). Springer.
Mohan, K., Desai, A. R., Ashish, M., & Kumar, V. (2015). Enhancing digital educational repositories by linking videos and examinations. In 2015 IEEE Seventh International Conference on Technology for Education (T4E) (pp. 45–48). IEEE.
Mulvany, N. C. (1993). Indexing books. USA: University of Chicago Press.
Nangi, S. R., Kanchugantla, Y., Rayapati, P. G., & Bhowmik, P. K. (2019). Offvid: A system for linking off-topic concepts to topically relevant video lecture segments. In 2019 IEEE 16th International Conference on Advanced Learning Technologies (ICALT) (pp. 20–22). IEEE.
Newman, M. E. (2003). The structure and function of complex networks. SIAM Review, 45(2), 167–256.
Newman, M. E. (2004). Detecting community structure in networks. The European Physical Journal B, 38(2), 321–330.
Pappano, L. (2012). The year of the MOOC. The New York Times, 2(12), 2012.
Patil, S., & Ravindran, B. (2020). Predicting software defect type using concept-based classification. Empirical Software Engineering, 25(2), 1341–1378.
Ponte, J. M., & Croft, W. B. (1997). Text segmentation by topic. In International Conference on Theory and Practice of Digital Libraries (pp. 113–125). Springer.
Richmond, K., Smith, A. J., & Amitay, E. (1997). Detecting subject boundaries within text: A language independent statistical approach. In Second Conference on Empirical Methods in Natural Language Processing (pp. 47–54).
Riedl, M., & Biemann, C. (2012). Text segmentation with topic models. Journal for Language Technology and Computational Linguistics, 27(1), 47–69.
Sakahara, M., Okada, S., & Nitta, K. (2014). Domain-independent unsupervised text segmentation for data management. In 2014 IEEE International Conference on Data Mining Workshop (pp. 481–487). IEEE.
Salton, G., & Buckley, C. (1990). Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41 (4), 288–297.
Salton, G., & Harman, D. (2003). Information retrieval. In Encyclopedia of computer science (pp. 858–863). Chichester: Wiley.
Singh, G. K., Doke, A., Kumar, V., Bhat, S., & Pedanekar, N. (2014). Assessing the need of augmenting video lectures with supporting information. In International Conference on Learning and Collaboration Technologies (pp. 238–249). Springer.
Sivic, J., & Zisserman, A. (2003). Video Google: A text retrieval approach to object matching in videos. In Proceedings Ninth IEEE International Conference on Computer Vision, (Vol. 2 pp. 1470–1477). IEEE.
Tan, S. (2007). Large margin dragpushing strategy for centroid text categorization. Expert Systems with Applications, 33(1), 215–220.
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003). Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, (Vol. 1 pp. 173–180). Association for Computational Linguistics.
Tyler-Smith, K. (2006). Early attrition among first time elearners: a review of factors that contribute to drop-out, withdrawal and non-completion rates of adult learners undertaking elearning programmes. Journal of Online learning and Teaching, 2(2), 73–85.
Wieman, C. (2007). Aps news–the back page. the “curse of knowledge” or why intuition about teaching often fails. American Physical Society News, 16(10).
Witten, I. H., & Milne, D. N. (2008). An effective, low-cost measure of semantic relatedness obtained from wikipedia links. In Proceeding of AAAI Workshop on Wikipedia and Artificial Intelligence: an Evolving Synergy (pp. 25–30). AAAI Press.
Yaari, Y. (1997). Segmentation of expository texts by hierarchical agglomerative clustering. CoRR, cmp-lg/9709015.
Yang, D., Sinha, T., Adamson, D., & Rosé, C. P. (2013). Turn on, tune in, drop out: Anticipating student dropouts in massive open online courses. In Proceedings of the 2013 NIPS Data-driven education workshop, (Vol. 11 p. 14).
Zhuang, Z. (2005). iHITS: Extending hits for personal interests profiling. In 19th International Conference on Advanced Information Networking and Applications (AINA’05) Volume 1 (AINA papers), (Vol. 2 pp. 747–751). IEEE.
Acknowledgements
The authors would like to thank the research scholars from the Indian Institute of Technology Kharagpur for their enthusiastic participation in the rigorous annotation tasks that had been the basis for evaluating the proposed augmentation system and human-based evaluation tasks.
Funding
Not applicable
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest/Competing interests
Not applicable
Additional information
Availability of data and material
Data used in the current work is shared using Google drive. The detail is provided at a Github repository present at: https://github.com/KrishnenduGhosh/VL
Code availability
Codes for implementing the current work is provided at as a Github repository. The link is: https://github.com/KrishnenduGhosh/VL
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ghosh, K., Nangi, S.R., Kanchugantla, Y. et al. Augmenting Video Lectures: Identifying Off-topic Concepts and Linking to Relevant Video Lecture Segments. Int J Artif Intell Educ 32, 382–412 (2022). https://doi.org/10.1007/s40593-021-00257-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40593-021-00257-z