Article

Free access

An experiment in hybrid dictionary and statistical sentence alignment

Authors:

Nigel Collier,

Kenji Ono,

Hideki HirakawaAuthors Info & Claims

ACL '98/COLING '98: Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics - Volume 1

Pages 268 - 274

https://doi.org/10.3115/980845.980889

Published: 10 August 1998 Publication History

PDF eReader

Abstract

The task of aligning sentences in parallel corpora of two languages has been well studied using pure statistical or linguistic models. We developed a linguistic method based on lexical matching with a bilingual dictionary and two statistical methods based on sentence length ratios and sentence offset probabilities. This paper seeks to further our knowledge of the alignment task by comparing the performance of the alignment models when used separately and together, i.e. as a hybrid system. Our results show that for our English-Japanese corpus of newspaper articles, the hybrid system using lexical matching and sentence length ratios outperforms the pure methods.

References

[1]

P. Brown, J. Lai, and R. Mercer. 1991. Aligning sentences in parallel corpora. In 29th Annual Meeting of the Association for Computational Linguistics, Berkeley, California, USA.

Digital Library

Google Scholar

[2]

S. Chen. 1993. Aligning sentences in bilingual corpora using lexical information. 31st Annual Meeting of the Association of Computational Linguistics, Ohio, USA, 22--26 June.

Digital Library

Google Scholar

[3]

K. Church. 1993. Char_align: a program for aligning parallel texts at the character level. In 31st Annual Meeting of the Association for Computational Linguistics, Ohio, USA, pages 1--8, 22--26 June.

Digital Library

Google Scholar

[4]

N. Collier, H. Hirakawa, and A. Kumano. 1998a. Creating a noisy parallel corpus from newswire articles using multi-lingual information retrieval. Trans. of Information Processing Society of Japan (to appear).

Google Scholar

[5]

N. Collier, H. Hirakawa, and A. Kumano. 1998b. Machine translation vs. dictionary term translation - a comparison for English-Japanese news article alignment. In Proceedings of COLING-ACL'98, University of Montreal, Canada, 10th August.

Digital Library

Google Scholar

[6]

P. Fung and D. Wu. 1994. Statistical augmentation of a Chinese machine readable dictionary. In Second Annual Workshop on Very Large Corpora, pages 69--85, August.

Google Scholar

[7]

W. Gale and K. Church. 1991. A program for aligning sentences in bilingual corpora. In Proceedings of the 29th Annual Conference of the Association for Computational Linguistics (ACL-91), Berkeley, California, pages 177--184.

Digital Library

Google Scholar

[8]

W. Gale and K. Church. 1993. A program for aligning sentences in a bilingual corpora. Computational Linguistics, 19(1):75--102.

Digital Library

Google Scholar

[9]

M. Kay and M. Röshcheisen. 1993. Text-translation alignment. Computational Linguistics, 19:121--142.

Digital Library

Google Scholar

[10]

T. Utsuro, H. Ikeda, M. Yamane, Y. Matsumoto, and N. Nagao. 1994. Bilingual text matching using bilingual dictionary and statistics. In COLING-94, 15th International Conference, Kyoto, Japan, volume 2, August 5--9.

Digital Library

Google Scholar

[11]

D. Wu. 1994. Aligning a parallel English-Chinese corpus statistically with lexical criteria. In 32nd Annual Meeting of the Association for Computational Linguistics, New Mexico, USA, pages 80--87, June 27--30.

Digital Library

Google Scholar

Cited By

View all

Ten Hacken P(2019)Has There Been a Revolution in Machine Translation?Machine Translation10.1023/A:101314092128016:1(1-19)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1023/A%3A1013140921280
Echizen-ya HAraki KMomouchi Y(2006)Automatic extraction of bilingual word pairs using inductive chain learning in various languagesInformation Processing and Management: an International Journal10.1016/j.ipm.2005.11.00442:5(1294-1315)Online publication date: 1-Sep-2006
https://dl.acm.org/doi/10.1016/j.ipm.2005.11.004

An experiment in hybrid dictionary and statistical sentence alignment

Recommendations

A Multilingual Procedure for Dictionary-Based Sentence Alignment
AMTA '98: Proceedings of the Third Conference of the Association for Machine Translation in the Americas on Machine Translation and the Information Soup

This paper describes a sentence alignment technique based on a machine readable dictionary. Alignment takes place in a single pass through the text, based on the scores of matches between pairs of source and target sentences. Pairings consisting of sets ...
High-performance bilingual text alignment using statistical and dictionary information

This paper describes an accurate and robust text alignment system for structurally different languages. Among structurally different languages such as Japanese and English, there is a limitation on the amount of word correspondences that can be ...
High-performance bilingual text alignment using statistical and dictionary information
ACL '96: Proceedings of the 34th annual meeting on Association for Computational Linguistics

This paper describes an accurate and robust text alignment system for structurally different languages. Among structurally different languages such as Japanese and English, there is a limitation on the amount of word correspondences that can be ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACL '98/COLING '98: Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics - Volume 1

August 1998

768 pages

Program Chairs:
Christian Boitet
Université Joseph Fourier, Grenoble, France
,
Pete Whitelock
Sharp Laboratories of Europe Ltd., Oxford, United Kingdom

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 10 August 1998

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
342
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)7

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ten Hacken P(2019)Has There Been a Revolution in Machine Translation?Machine Translation10.1023/A:101314092128016:1(1-19)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1023/A%3A1013140921280
Echizen-ya HAraki KMomouchi Y(2006)Automatic extraction of bilingual word pairs using inductive chain learning in various languagesInformation Processing and Management: an International Journal10.1016/j.ipm.2005.11.00442:5(1294-1315)Online publication date: 1-Sep-2006
https://dl.acm.org/doi/10.1016/j.ipm.2005.11.004

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

A Multilingual Procedure for Dictionary-Based Sentence Alignment

High-performance bilingual text alignment using statistical and dictionary information

High-performance bilingual text alignment using statistical and dictionary information