MFDNN: Mixed Features Deep Neural Network Model for Prompt-independent Automated Essay Scoring
Authors: 
Chang Liu, Gejian DingAuthors Info & Claims
Article No.: 83, Pages 1 - 7
Abstract
Most of the existing Automatic Essay Scoring (AES) models are prompt-dependent models that need the rated essays of specific prompt for training. However, there are few studies on prompt-independent AES. This paper studies how to fully use the effective prompt-dependent features to solve the prompt-independent AES problem. Different from the common method of only extracts multiple features, we consider reducing the interference between different features. We propose a new feature, called the deep dependent feature, which is extracted from the essay by a deep neural network. It is the representative feature that can distinguish the prompt label of the essay and has less overlap and conflict with other features. Firstly, we pre-scored the unrated target prompt data to generate pseudo data based on the manually extracted features. Then we build a new model, which is training on pseudo data to learn prompt-dependent information. Our model considers relevance feature, syntactic feature, and deep dependent feature. The performance of our model is evaluated on ASAP datasets, and the results show that our model outperforms the existing methods for prompt-independent AES.
References
[1]
K. Taghipour, H.T. Ng.2016. A neural approach to automated essay scoring. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, November 1-4, 1882–1891. https://www.aclweb.org/anthology/D16-1193.
[2]
F. Dong, Y. Zhang. 2016. Automatic features for essay scoring - an empirical study. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, November 1-4, 1072–1077. https://www.aclweb.org/anthology/D16-1115
[3]
F. Dong, Y. Zhang, J. Yang. 2017. Attention-based recurrent convolutional neural network for automatic essay scoring. In Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017),Vancouver, Canada, August 3-4, 153–162.http://dx.doi.org/10.18653/v1/K17-1017
[4]
C. Jin, B. He, K. Hui, L. Sun.2018.TDNN: A two-stage deep neural networkfor prompt-independent automated essay scoring. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15-20, 2018, Volume 1: Long Papers, 1088–1097. http://dx.doi.org/10.18653/v1/P18-1100
[5]
X Li, M Chen, J Nie. 2020. SEDNN: Shared and enhanced deep neural network model for cross-prompt automated essay scoring. Knowledge-Based Systems 210 (2020) 106491
[6]
H. Yannakoudakis, T. Briscoe, B. Medlock. 2011. A new dataset and method for automatically grading ESOL texts. In the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 19-24 June, 2011, Portland, Oregon, USA, 180–189. https://www.aclweb.org/anthology/P11-1019/.
[7]
Hongbo Chen, Jungang Xu, and Ben He. 2014. Automated essay scoring by capturing relative writing quality. Comput. J. 57(9):1318–1330.Jason Jerald. 2015. The VR Book: Human-Centered Design for Virtual Reality. Association for Computing Machinery and Morgan & Claypool.
[8]
Y Dauphin, H Vries, and Y Bengio. 2015. Equilibrated adaptive learning rates for nonconvex optimization. In Advances in Neural Information Processing Systems,1504–1512
[9]
W Yin, H Schütze. 2015. Convolutional Neural Network for Paraphrase Identification. In Proceeding of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, 901–911
[10]
J Mueller, A Thyagarajan. 2016. Siamese recurrent architectures for learning sentence similarity. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16)
[11]
D. Alikaniotis, H. Yannakoudakis, M. Rei. 2016. Automatic text scoring using neural networks. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, August 7-12, 2016, Berlin, Germany, Volume 1: Long Papers. https://www.aclweb.org/anthology/P16-1068
[12]
M.L. van der, G. Hinton. 2008. Visualizing data using t-SNE. Mach Learn Res. 9. Nov (2008) 2579–2605
Recommendations
Automatic essay scoring with recurrent neural network
HP3C '19: Proceedings of the 3rd International Conference on High Performance Compilation, Computing and CommunicationsAs deep learning has developed rapidly in recent years, the automatic essay scoring system, based on deep learning models, has become more reliable than previous feature-based systems. Recent researchers have developed an approach based on recurrent ...
On Issues of Feature Extraction in Chinese Automatic Essay Scoring System
Proceedings of the 2007 conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That WorkAutomatic essay scoring is a very important tool for many educational researches. However, the linguistic differences between Chinese and English indicate a need to reconsider various issues when designing Chinese automatic essay scoring systems. This ...
A Ranked-Based Learning Approach to Automated Essay Scoring
CGC '12: Proceedings of the 2012 Second International Conference on Cloud and Green ComputingAutomated essay scoring is the computer techniques and algorithms that evaluate and score essays automatically. Compared with human rater, automated essay scoring has the advantage of fairness, less human resource cost and timely feedback. In previous ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2021
699 pages
ISBN:9781450385053
DOI:10.1145/3508546
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 25 February 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ACAI'21
ACAI'21: 2021 4th International Conference on Algorithms, Computing and Artificial Intelligence
December 22 - 24, 2021
Sanya, China
Acceptance Rates
Overall Acceptance Rate 173 of 395 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 110Total Downloads
- Downloads (Last 12 months)24
- Downloads (Last 6 weeks)0
Reflects downloads up to 28 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format