research-article

Free access

Multilingual text induced spelling correction

Author:

Martin ReynaertAuthors Info & Claims

MLR '04: Proceedings of the Workshop on Multilingual Linguistic Ressources

Page 117

Published: 28 August 2004 Publication History

PDF eReader

Abstract

We present TISC, a multilingual, language-independent and context-sensitive spelling checking and correction system designed to facilitate the automatic removal of non-word spelling errors in large corpora. Its lexicon is derived from raw text corpora, without supervision, and contains word unigrams and word bigrams. The system employs input context and lexicon evidence to automatically propose a limited number of ranked correction candidates. We describe the implemented trilingual (Dutch, English, French) prototype and evaluate it on English and Dutch text, monolingual and mixed, containing real-world errors in context.

References

[1]

E. Brill and R. C. Moore. 2000. An improved error model for noisy channel spelling correction. In Proc. of the 38th Annual Meeting of the ACL, pages 286--293.

Digital Library

Google Scholar

[2]

P. R. Clarkson and R. Rosenfeld. 1997. Statistical language modeling using the CMU-Cambridge toolkit. In Proceedings ESCA Eurospeech 1997.

Google Scholar

[3]

Fred J. Damerau. 1964. A technique for computer detection and correction of spelling errors. Communications of the ACM, Volume 7, Issue 3 (March 1964):171--176.

Digital Library

Google Scholar

[4]

EAGLES-I. 1996. Final Report. In Evaluation of Natural Language Processing Systems, volume EAGLES DOCUMENT EAG-EWG-PR.2.

Google Scholar

[5]

David Graff. 2003. The New York Times Newswire Service. English Gigaword LDC-2003T05.

Google Scholar

[6]

Donald E. Knuth, 1981. Sorting and Searching, volume 2 of The Art of Computer Programming, section 6.4, pages 513--558. Addison-Wesley, Reading, Massachusetts, second edition.

Google Scholar

[7]

Karen Kukich. 1992. Techniques for automatically correcting words in text. ACM Computing Surveys, 24(4):377--439.

Digital Library

Google Scholar

[8]

V. I. Levenshtein. 1965. Binary codes capable of correcting deletions, insertions, and reversals. In Cybernetics and Control Theory, volume 10(8), pages 707--710. Original in: Doklady Nauk SSSR 163(4): 845--848 (1965).

Google Scholar

[9]

D. Lewis, Y. Yang, T. G. Rose, and F. Li. 2003. RCV1: A new benchmark collection for text categorization research. Journal of Machine Learning Research.

Digital Library

Google Scholar

[10]

Martin Reynaert. 2004. Text induced spelling correction. In Proceedings COLING 2004, Geneva.

Digital Library

Google Scholar

[11]

George Kingsley Zipf. 1935. The psycho-biology of language: an introduction to dynamic philology. The M.I.T. Press, Cambridge, MA, 1965 - 2nd. edition.

Google Scholar

Recommendations

Text induced spelling correction
COLING '04: Proceedings of the 20th international conference on Computational Linguistics

We present TISC, a language-independent and context-sensitive spelling checking and correction system designed to facilitate the automatic removal of non-word spelling errors in large corpora. Its lexicon is derived from a very large corpus of raw text, ...
Information retrieval and spelling correction: an inquiry into lexical disambiguation
SAC '02: Proceedings of the 2002 ACM symposium on Applied computing

In a preliminary study, we show the effect of spelling errors on an ad hoc information retrieval task. Then, we report on the comparison of different strategies for correcting spelling errors resulting in non-existent words. Unlike interactive spelling ...
Inducing multilingual text analysis tools via robust projection across aligned corpora
HLT '01: Proceedings of the first international conference on Human language technology research

This paper describes a system and set of algorithms for automatically inducing stand-alone monolingual part-of-speech taggers, base noun-phrase bracketers, named-entity taggers and morphological analyzers for an arbitrary foreign language. Case studies ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MLR '04: Proceedings of the Workshop on Multilingual Linguistic Ressources

August 2004

124 pages

Editors:
Gilles Sérasset
GETA CLIPS-IMAG, Université Joseph Fourier - Grenoble I, France
,
Susan Armstrong
ISSCO, Université de Genève, Switzerland
,
Christian Boitet
GETA CLIPS-IMAG, Université Joseph Fourier - Grenoble I, France
,
Andrei Popescu-Belis
ISSCO, Université de Genève, Switzerland
,
Dan Tufis
RACAI, Uni Bucharest, Romania

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 28 August 2004

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
214
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)4

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Recommendations

Text induced spelling correction

Information retrieval and spelling correction: an inquiry into lexical disambiguation

Inducing multilingual text analysis tools via robust projection across aligned corpora

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

View options

PDF

eReader

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations