Abstract
Current general digitization approach of paper media is converting them into the digital images by a scanner, and then reading them by an OCR to generate ASCII text for full-text retrieval. However, it is impossible to recognize all characters with 100% accuracy by the present OCR technology. Therefore, it is important to know the impact of OCR accuracy on automatic text classification to reveal its technical feasibility. In this research we perform automatic text classification experiments for English newswire articles to study on the relationships between the accuracies of OCR and the text classification employing the statistical classification techniques.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ohta, M., Takasu, A., Adachi, J.: Retrieval Methods for English-Text with Missrecognized OCR Characters. In: Proceedings of the Fourth International Conference on Document Analysis and Recognition (ICDAR), Ulm, Germany, August 18-20, pp. 950–956 (1997)
Myka, A., Guntzer, U.: Measuring the Effects of OCR Errors on Similarity Linking. In: Proceedings of the Fourth International Conference on Document Analysis and Recognition (ICDAR), Ulm, Germany, August 18-20, pp. 968–973 (1997)
Sebastiani, F.: Machine Learning in Automated Text Categorization. ACM Computing Surveys 34(1), 1–47 (2002)
Fukumoto, T., Wakabayashi, T., Kimura, F., Miyake, Y.: Accuracy Improvement of Handwritten Character Recognition By GLVQ. In: Proceedings of the Seventh International Workshop on Frontiers in Handwriting Recognition Proceedings(IWFHR VII), September 2000, pp. 271–280 (2000)
Zu, G., Ohyama, W., Wakabayashi, T., Kimura, F.: Accuracy improvement of automatic text classification based on feature transformation. In: DocEng 2003 (ACM Symposium on Document Engineering 2003), Grenoble, France, November 20-22, pp. 118–120 (2003)
Chang, C.C., Lin, C.J.: LIBSVM – A Library for Support Vector Machines (Version 2.33) (2002.4), http://www.csie.ntu.edu.tw/~cjlin/libsvm/index.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zu, G., Murata, M., Ohyama, W., Wakabayashi, T., Kimura, F. (2004). The Impact of OCR Accuracy on Automatic Text Classification. In: Chi, CH., Lam, KY. (eds) Content Computing. AWCC 2004. Lecture Notes in Computer Science, vol 3309. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30483-8_49
Download citation
DOI: https://doi.org/10.1007/978-3-540-30483-8_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23898-0
Online ISBN: 978-3-540-30483-8
eBook Packages: Springer Book Archive