Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3343031.3351087acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

MOC: Measuring the Originality of Courseware in Online Education Systems

Published: 15 October 2019 Publication History

Abstract

In online education systems, the courseware plays a pivotal role in helping educators present and impart knowledge to students. The originality of courseware heavily impacts the choice of educators, because the teaching content evolves and so does courseware. However, how to measure the originality of a courseware is a challenging task, due to the lack of labels and the difficulty of quantification. To this end, we contribute a similarity ranking-based unsupervised approach to measure the originality of a courseware. In particular, we first exploit a pre-trained deep visual-text embedding to obtain the representations of images and texts in a local manner. Next, inspired by the design of capsule neural network, a vector-based pooling network is proposed to learn multimodal representations of images and texts. Finally, we propose a Discriminator to optimize the model by maximizing the mutual information between local features and global features in an unsupervised manner. To evaluate the performance of our proposed model, we further subtly collect a dataset for evaluating the originality of courseware by treating sequential versions of each courseware as ranking lists. Therefore, the learning-to-rank scheme can be utilized to evaluate the similarity-based ranking performance. Extensive experimental results have demonstrated the superiority of our proposed framework as compared to other state-of-the-art competitors.

References

[1]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of the International Conference on Learning Representations. ACM.
[2]
Piotr Bojanowski and Armand Joulin. 2017. Unsupervised learning by predicting noise. In Proceedings of the International Conference on Machine Learning, Vol. 70. ACM, 517--526.
[3]
Da Cao, Xiangnan He, Lianhai Miao, Yahui An, Chao Yang, and Richang Hong. 2018. Attentive group recommendation. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. ACM, 645--654.
[4]
Da Cao, Xiangnan He, Liqiang Nie, Xiaochi Wei, Xia Hu, Shunxiang Wu, and Tat-Seng Chua. 2017. Cross-platform app recommendation by jointly modeling ratings and texts. ACM Transactions on Information Systems, Vol. 35, 4 (2017), 37.
[5]
Jianlong Chang, Lingfeng Wang, Gaofeng Meng, Shiming Xiang, and Chunhong Pan. 2017. Deep adaptive image clustering. In Proceedings of the IEEE International Conference on Computer Vision. IEEE, 5879--5887.
[6]
Jingjing Chen, Chong-Wah Ngo, Fuli Feng, and Tat-Seng Chua. 2018. Deep Understanding of Cooking Procedure for Cross-modal Recipe Retrieval. In Proceedings of the ACM International Conference on Multimedia. ACM, 1020--1028.
[7]
Zhiyong Cheng, Xiaojun Chang, Lei Zhu, Rose C. Kanjirathinkal, and Moha Kankanhalli. 2018. MMALFM: Explainable recommendation by leveraging reviews and images., Vol. 37 (2018), 2.
[8]
Zhiyong Cheng, Jialie Shen, Lei Zhu, Mohan S Kankanhalli, and Liqiang Nie. 2017. Exploiting Music Play Sequence for Music Recommendation. In International Joint Conference on Artificial Intelligence, Vol. 17. Morgan Kaufmann, 3654--3660.
[9]
Wei Chu and S Sathiya Keerthi. 2005. New approaches to support vector ordinal regression. In Proceedings of the International Conference on Machine Learning. ACM, 145--152.
[10]
Corinna Cortes, Mehryar Mohri, and Ashish Rastogi. 2007. Magnitude-preserving ranking algorithms. In Proceedings of the International Conference on Machine Learning. ACM, 169--176.
[11]
David Cossock and Tong Zhang. 2006. Subset ranking using regression. In International Conference on Computational Learning Theory. Springer, 605--619.
[12]
Nick Craswell. 2009. Mean reciprocal rank. Encyclopedia of Database Systems (2009), 1703--1703.
[13]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
[14]
Laurent Dinh, David Krueger, and Yoshua Bengio. 2014. NICE: Non-linear independent components estimation. arXiv preprint arXiv:1410.8516 (2014).
[15]
Laurent Dinh, Jascha Sohl-Dickstein, and Samy Bengio. 2016. Density estimation using Real NVP. CoRR, Vol. abs/1605.08803 (2016).
[16]
Felix A Gers, Jürgen Schmidhuber, and Fred Cummins. 2000. Learning to Forget: Continual Prediction with LSTM. Neural Computation, Vol. 12, 10 (2000), 2451--2471.
[17]
Hicham Hage and Esma A"imeur. 2005. Exam Question Recommender System. In Artificial Intelligence in Education: Supporting Learning through Intelligent and Socially Informed Technology. IOS Press, 249--257.
[18]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition. IEEE, 770--778.
[19]
R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Adam Trischler, and Yoshua Bengio. 2018. Learning deep representations by mutual information estimation and maximization. In Proceedings of the International Conference on Learning Representations. ACM.
[20]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation, Vol. 9, 8 (1997), 1735--1780.
[21]
Kalervo J"arvelin and Jaana Kek"al"ainen. 2002. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems, Vol. 20 (2002), 422--446.
[22]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[23]
Durk P Kingma and Prafulla Dhariwal. 2018. Glow: Generative flow with invertible 1x1 convolutions. In Advances in Neural Information Processing Systems. MIT Press, 10236--10245.
[24]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. MIT Press, 1097--1105.
[25]
Chen-Yu Lee, Patrick W Gallagher, and Zhuowen Tu. 2016. Generalizing pooling functions in convolutional neural networks: Mixed, gated, and tree. In Artificial Intelligence and Statistics. JMLR, 464--472.
[26]
Hang Li. 2011. A short introduction to learning to rank. IEICE Transactions on Information and Systems, Vol. 94, 10 (2011), 1854--1862.
[27]
Qi Liu, Zai Huang, Zhenya Huang, Chuanren Liu, Enhong Chen, Yu Su, and Guoping Hu. 2018. Finding similar exercises in online education systems. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1821--1830.
[28]
Lin Ma, Zhengdong Lu, and Hang Li. 2016. Learning to answer questions from image using convolutional neural network. In Proceedings of the AAAI Conference on Artificial Intelligence. AAAI.
[29]
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).
[30]
Ramesh Nallapati. 2004. Discriminative models for information retrieval. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 64--71.
[31]
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. ACL, 1532--1543.
[32]
Jir'i Rihák and Radek Pelánek. 2017. Measuring Similarity of Educational Items Using Data on Learners' Performance. In Proceedings of the International Conference on Educational Data Mining . 16--23.
[33]
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, and Michael Bernstein. 2014. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision, Vol. 115, 3 (2014), 211--252.
[34]
Sara Sabour, Nicholas Frosst, and Geoffrey E Hinton. 2017. Dynamic routing between capsules. In Advances in Neural Information Processing Systems. MIT Press, 3856--3866.
[35]
Mohammad E Shiri, A Esma A"imeur, and Claude Frasson. 1998. Student modelling by case based Reasoning. In International Conference on Intelligent Tutoring Systems. Springer, 394--403.
[36]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. MIT Press, 5998--6008.
[37]
Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion. Journal of Machine Learning Research, Vol. 11 (2010), 3371--3408.
[38]
Maksims N Volkovs and Richard S Zemel. 2009. Boltzrank: learning to maximize expected ranking gain. In Proceedings of the International Conference on Machine Learning. ACM, 1089--1096.
[39]
Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, and Dell Zhang. 2017. Irgan: A minimax game for unifying generative and discriminative information retrieval models. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 515--524.
[40]
Jiayu Wang, Wengang Zhou, Jinhui Tang, Zhongqian Fu, Qi Tian, and Houqiang Li. 2018b. Unregularized Auto-Encoder with Generative Adversarial Networks for Image Generation. In Proceedings of the ACM International Conference on Multimedia. ACM, 709--717.
[41]
Shuhui Wang, Yangyu Chen, Junbao Zhuo, Qingming Huang, and Qi Tian. 2018a. Joint Global and Co-Attentive Representation Learning for Image-Sentence Retrieval. In Proceedings of the ACM International Conference on Multimedia. ACM, 1398--1406.
[42]
Suyun Wei, Ye Ning, Shuo Zhang, Huang Xia, and Zhu Jian. 2012. Item-Based Collaborative Filtering Recommendation Algorithm Combining Item Category with Interestingness Measure. In International Conference on Computer Science & Service System. IEEE, 2038--2041.
[43]
Fen Xia, Tie-Yan Liu, Jue Wang, Wensheng Zhang, and Hang Li. 2008. Listwise approach to learning to rank: theory and algorithm. In Proceedings of the International Conference on Machine Learning. ACM, 1192--1199.
[44]
Junyuan Xie, Ross Girshick, and Ali Farhadi. 2016. Unsupervised deep embedding for clustering analysis. In Proceedings of the International Conference on Machine Learning. ACM, 478--487.
[45]
Jun Xu and Hang Li. 2007. Adarank: a boosting algorithm for information retrieval. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 391--398.
[46]
Jen-Yuan Yeh, Jung-Yi Lin, Hao-Ren Ke, and Wei-Pang Yang. 2007. Learning to rank for information retrieval using genetic programming. In Proceedings of SIGIR 2007 Workshop on Learning to Rank for Information Retrieval .
[47]
Matthew Zeiler and Robert Fergus. 2013. Stochastic pooling for regularization of deep convolutional neural networks. In Proceedings of the International Conference on Learning Representation. ACM.
[48]
Liang Zhang, Bingpeng Ma, Guorong Li, Qingming Huang, and Qi Tian. 2017. Multi-networks joint learning for large-scale cross-modal retrieval. In Proceedings of the ACM International Conference on Multimedia. ACM, 907--915.
[49]
Zhaohui Zheng, Keke Chen, Gordon Sun, and Hongyuan Zha. 2007. A regression framework for learning ranking functions using relative relevance judgments. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 287--294.
[50]
Tianyu Zhu, Qi Liu, Zhenya Huang, Enhong Chen, Defu Lian, Yu Su, and Guoping Hu. 2018. MT-MCD: A Multi-task Cognitive Diagnosis Framework for Student Assessment. In International Conference on Database Systems for Advanced Applications. Springer, 318--335.

Cited By

View all
  • (2024)Multi-task Information Enhancement Recommendation model for educational Self-Directed Learning SystemExpert Systems with Applications10.1016/j.eswa.2024.124073(124073)Online publication date: May-2024
  • (2020)Fine-Grained Similarity Measurement between Educational Videos and ExercisesProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413783(331-339)Online publication date: 12-Oct-2020

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '19: Proceedings of the 27th ACM International Conference on Multimedia
October 2019
2794 pages
ISBN:9781450368896
DOI:10.1145/3343031
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. measurement of originality
  2. multimodal learning
  3. online education systems
  4. unsupervised learning

Qualifiers

  • Research-article

Conference

MM '19
Sponsor:

Acceptance Rates

MM '19 Paper Acceptance Rate 252 of 936 submissions, 27%;
Overall Acceptance Rate 995 of 4,171 submissions, 24%

Upcoming Conference

MM '24
The 32nd ACM International Conference on Multimedia
October 28 - November 1, 2024
Melbourne , VIC , Australia

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)1
Reflects downloads up to 24 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Multi-task Information Enhancement Recommendation model for educational Self-Directed Learning SystemExpert Systems with Applications10.1016/j.eswa.2024.124073(124073)Online publication date: May-2024
  • (2020)Fine-Grained Similarity Measurement between Educational Videos and ExercisesProceedings of the 28th ACM International Conference on Multimedia10.1145/3394171.3413783(331-339)Online publication date: 12-Oct-2020

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media