Article

Accuracy improvement of automatic text classification based on feature transformation

Authors:

Guowei Zu,

Wataru Ohyama,

Tetsushi Wakabayashi,

Fumitaka KimuraAuthors Info & Claims

DocEng '03: Proceedings of the 2003 ACM symposium on Document engineering

Pages 118 - 120

https://doi.org/10.1145/958220.958242

Published: 20 November 2003 Publication History

Get Access

Abstract

In this paper, we describe a comparative study on techniques of feature transformation and classification to improve the accuracy of automatic text classification. The normalization to the relative word frequency, the principal component analysis (K-L transformation) and the power transformation were applied to the feature vectors, which were classified by the Euclidean distance, the linear discriminant function, the projection distance, the modified projection distance and the SVM.

References

[1]

Sebastiani, F.: Machine Learning in Automated Text Categorization. ACM Computing Surveys, Vol. 34, No. 1, 1--47, March 2002.

Digital Library

Google Scholar

[2]

Lam,W., Han,Y.: Automatic Textual Document Categorization Based on Generalized Instance Sets and a Metamodel. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.25, No.5, 628--633, May 2003.

Digital Library

Google Scholar

[3]

Fukunaga,K.: Introduction to Statistical Pattern Recognition, 76--77, Academic Press, Inc, 1990.

Digital Library

Google Scholar

[4]

Fukumoto,T., Wakabayashi,T. Kimura,F. and Miyake,Y.: Accuracy Improvement of Handwritten Character Recognition By GLVQ, Proceedings of the Seventh International Workshop on Frontiers in Handwriting Recognition Proceedings(IWFHR VII), 271--280 September 2000.

Google Scholar

[5]

R. Sebastiani, A. Sperduti, and N. Valdambrini: "An Improved boosting algorithm and its application to text categorization", Proceedings of the Ninth International Conference on Information and Knowledge Management (CIKM 2000), pp.78--85 (2000)

Digital Library

Google Scholar

[6]

Y. Yang, and X. Liu: "A re-examination of text categorization methods", Proceedings of the Twenty-First International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.42--49 (1999)

Digital Library

Google Scholar

[7]

C. Cortes, and V. Vapnik : "Support-vector network", Machine Learning 20, pp.273--297 (1995).

Digital Library

Google Scholar

[8]

C.C. Chang, and C. J. Lin "LIBSVM -- A Library for Support Vector Machines (Version 2.33)", http://www.csie.ntu.edu.tw/ cjlin/libsvm/index.html, (2002.4).

Google Scholar

Cited By

View all

Tona Landu TBousso MLoum MSall OFaty LDia YSawadogo I(2022)Machine Learning Algorithm for Text Categorization of News Articles from Senegalese Online News Websites2022 17th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI54924.2022.9820408(1-8)Online publication date: 22-Jun-2022
https://doi.org/10.23919/CISTI54924.2022.9820408
Kobayashi VMol SBerkers HKismihók GDen Hartog D(2017)Text Classification for Organizational ResearchersOrganizational Research Methods10.1177/109442811771932221:3(766-799)Online publication date: 12-Jul-2017
https://doi.org/10.1177/1094428117719322
Srividya MAhmed M(2017)A filtering of message in online social network using hybrid classifierCluster Computing10.1007/s10586-017-1300-yOnline publication date: 12-Nov-2017
https://doi.org/10.1007/s10586-017-1300-y
Show More Cited By

Index Terms

Accuracy improvement of automatic text classification based on feature transformation
1. Applied computing
  1. Document management and text processing

Recommendations

Improving Automatic Text Classification by Integrated Feature Analysis

Feature transformation in automatic text classification (ATC) can lead to better classification performance. Furthermore dimensionality reduction is important in ATC. Hence, feature transformation and dimensionality reduction are performed to obtain ...
A New Chinese Text Feature Selection Method in Centroid-Based Classifier
ISIP '08: Proceedings of the 2008 International Symposiums on Information Processing

Feature selection method based on text study is a mainstream method currently, whose research key lies in finding out one suitable feature assessment method, which can reduce the numbers of the words to be processed as less as possible in the situation ...
Exploiting the systematic review protocol for classification of medical abstracts

Objective: To determine whether the automatic classification of documents can be useful in systematic reviews on medical topics, and specifically if the performance of the automatic classification can be enhanced by using the particular protocol of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

DocEng '03: Proceedings of the 2003 ACM symposium on Document engineering

November 2003

260 pages

ISBN:1581137249

DOI:10.1145/958220

General Chairs:
Cécile Roisin
Université Pierre Mendès and INRIA Rhône-Alpes
,
Ethan V. Munson
University of Wisconsin-Milwaukee
,
Program Chair:
Christine Vanoirbeek
Swiss Federal Institute of Technology, Lausanne, Switzerland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 November 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

DocEng03

Sponsor:

SIGWEB

DocEng03: ACM Symposium on Document Engineering

November 20 - 22, 2003

Grenoble, France

Acceptance Rates

Overall Acceptance Rate 194 of 564 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
783
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tona Landu TBousso MLoum MSall OFaty LDia YSawadogo I(2022)Machine Learning Algorithm for Text Categorization of News Articles from Senegalese Online News Websites2022 17th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI54924.2022.9820408(1-8)Online publication date: 22-Jun-2022
https://doi.org/10.23919/CISTI54924.2022.9820408
Kobayashi VMol SBerkers HKismihók GDen Hartog D(2017)Text Classification for Organizational ResearchersOrganizational Research Methods10.1177/109442811771932221:3(766-799)Online publication date: 12-Jul-2017
https://doi.org/10.1177/1094428117719322
Srividya MAhmed M(2017)A filtering of message in online social network using hybrid classifierCluster Computing10.1007/s10586-017-1300-yOnline publication date: 12-Nov-2017
https://doi.org/10.1007/s10586-017-1300-y
Mouratis TKotsiantis S(2009)Increasing the Accuracy of Discriminative of Multinomial Bayesian Classifier in Text ClassificationProceedings of the 2009 Fourth International Conference on Computer Sciences and Convergence Information Technology10.1109/ICCIT.2009.13(1246-1251)Online publication date: 24-Nov-2009
https://dl.acm.org/doi/10.1109/ICCIT.2009.13
Ruiz-Rico FVicedo JRubio-Sánchez M(2008)MEDLINE Abstracts Classification Based on Noun Phrases ExtractionBiomedical Engineering Systems and Technologies10.1007/978-3-540-92219-3_38(507-519)Online publication date: 2008
https://doi.org/10.1007/978-3-540-92219-3_38
Ruiz-Rico FVicedo JRubio-Sánchez MBulterman DBrailsford D(2006)NEWPARProceedings of the 2006 ACM symposium on Document engineering10.1145/1166160.1166196(128-137)Online publication date: 10-Oct-2006
https://dl.acm.org/doi/10.1145/1166160.1166196
Murata MBusagala LOhyama WWakabayashi TKimura F(2006)The impact of OCR accuracy and feature transformation on automatic text classificationProceedings of the 7th international conference on Document Analysis Systems10.1007/11669487_45(506-517)Online publication date: 13-Feb-2006
https://dl.acm.org/doi/10.1007/11669487_45
Ikonomakis MKotsiantis STampakas V(2005)Text classificationProceedings of the 9th WSEAS International Conference on Computers10.5555/1369599.1369724(1-6)Online publication date: 14-Jul-2005
https://dl.acm.org/doi/10.5555/1369599.1369724
Langer HLüngen HBayerl P(2004)Text type structure and logical document structureProceedings of the 2004 ACL Workshop on Discourse Annotation10.5555/1608938.1608945(49-56)Online publication date: 25-Jul-2004
https://dl.acm.org/doi/10.5555/1608938.1608945
Zu GMurata MOhyama WWakabayashi TKimura F(2004)The Impact of OCR Accuracy on Automatic Text ClassificationContent Computing10.1007/978-3-540-30483-8_49(403-409)Online publication date: 2004
https://doi.org/10.1007/978-3-540-30483-8_49

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Improving Automatic Text Classification by Integrated Feature Analysis

A New Chinese Text Feature Selection Method in Centroid-Based Classifier

Exploiting the systematic review protocol for classification of medical abstracts