Nothing Special   »   [go: up one dir, main page]

IEICE Transactions on Information and Systems
Online ISSN : 1745-1361
Print ISSN : 0916-8532
Regular Section
Chinese Spelling Correction Based on Knowledge Enhancement and Contrastive Learning
CNONIX National Standard Application and Promotion Lab">Hao WANG CNONIX National Standard Application and Promotion Lab">Yao MA CNONIX National Standard Application and Promotion Lab">Jianyong DUAN CNONIX National Standard Application and Promotion Lab">Li HE CNONIX National Standard Application and Promotion Lab">Xin LI
Author information
JOURNAL FREE ACCESS

2024 Volume E107.D Issue 9 Pages 1264-1273

Details
Abstract

Chinese Spelling Correction (CSC) is an important natural language processing task. Existing methods for CSC mostly utilize BERT models, which select a character from a candidate list to correct errors in the sentence. World knowledge refers to structured information and relationships spanning a wide range of domains and subjects, while definition knowledge pertains to textual explanations or descriptions of specific words or concepts. Both forms of knowledge have the potential to enhance a model's ability to comprehend contextual nuances. As BERT lacks sufficient guidance from world knowledge for error correction and existing models overlook the rich definition knowledge in Chinese dictionaries, the performance of spelling correction models is somewhat compromised. To address these issues, within the world knowledge network, this study injects world knowledge from knowledge graphs into the model to assist in correcting spelling errors caused by a lack of world knowledge. Additionally, the definition knowledge network in this model improves the error correction capability by utilizing the definitions from the Chinese dictionary through a comparative learning approach. Experimental results on the SIGHAN benchmark dataset validate the effectiveness of our approach.

Content from these authors
© 2024 The Institute of Electronics, Information and Communication Engineers
Previous article Next article
feedback
Top