Article

Free access

Statistical machine translation with word- and sentence-aligned parallel corpora

Authors:

Chris Callison-Burch,

David Talbot,

Miles OsborneAuthors Info & Claims

ACL '04: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics

Pages 175 - es

https://doi.org/10.3115/1218955.1218978

Published: 21 July 2004 Publication History

PDF eReader

Abstract

The parameters of statistical translation models are typically estimated from sentence-aligned parallel corpora. We show that significant improvements in the alignment and translation quality of such models can be achieved by additionally including word-aligned data during training. Incorporating word-level alignments into the parameter estimation of the IBM models reduces alignment error rate and increases the Bleu score when compared to training the same models only on sentence-aligned data. On the Verbmobil data set, we attain a 38% reduction in the alignment error rate and a higher Bleu score with half as many training examples. We discuss how varying the ratio of word-aligned to sentence-aligned data affects the expected performance gain.

References

[1]

Peter Brown, Stephen Della Pietra, Vincent Della Pietra, and Robert Mercer. 1993. The mathematics of machine translation: Parameter estimation. Computational Linguistics, 19(2):263--311, June.

Digital Library

Google Scholar

[2]

Adrian Corduneanu. 2002. Stable mixing of complete and incomplete information. Master's thesis, Massachusetts Institute of Technology, February.

Google Scholar

[3]

A. P. Dempster, N. M. Laird, and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39(1): 1--38, Nov.

Crossref

Google Scholar

[4]

Ulrich Germann. 2001. Building a statistical machine translation system from scratch: How much bang for the buck can we expect? In ACL 2001 Workshop on Data-Driven Machine Translation, Toulouse, France, July 7.

Digital Library

Google Scholar

[5]

Philipp Koehn, Franz Josef Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of the HLT/NAACL.

Digital Library

Google Scholar

[6]

I. Dan Melamed. 1998. Manual annotation of translational equivalence: The blinker project. Cognitive Science Technical Report 98/07, University of Pennsylvania.

Google Scholar

[7]

Rada Mihalcea and Ted Pedersen. 2003. An evaluation exercise for word alignment. In Rada Mihalcea and Ted Pedersen, editors, HLT-NAACL 2003 Workshop: Building and Using Parallel Texts.

Digital Library

Google Scholar

[8]

Kamal Nigam, Andrew K. McCallum, Sebastian Thrun, and Tom M. Mitchell. 2000. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39(2/3): 103--134.

Digital Library

Google Scholar

[9]

Franz Josef Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1): 19--51, March.

Digital Library

Google Scholar

[10]

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2001. Bleu: a method for automatic evaluation of machine translation. IBM Research Report RC22176(W0109-022), IBM.

Google Scholar

[11]

Philip Resnik and Noah Smith. 2003. The web as a parallel corpus. Computational Linguistics, 29(3):349--380, September.

Digital Library

Google Scholar

Cited By

View all

Sanentz SLesk MGiven L(2015)Toward a semantic stability index (SSI) via a preliminary exploration of translation loopingProceedings of the 78th ASIS&T Annual Meeting: Information Science with Impact: Research in and for the Community10.5555/2857070.2857143(1-4)Online publication date: 6-Nov-2015
https://dl.acm.org/doi/10.5555/2857070.2857143
Govada AJoshi PMittal SSahay S(2015)Hybrid Approach for Inductive Semi Supervised Learning Using Label Propagation and Support Vector MachineProceedings of the 11th International Conference on Machine Learning and Data Mining in Pattern Recognition - Volume 916610.1007/978-3-319-21024-7_14(199-213)Online publication date: 20-Jul-2015
https://dl.acm.org/doi/10.1007/978-3-319-21024-7_14
Hoang CLe CPham STrong GHluchy LQuyet TCastelli EDuc KChi MTran V(2012)Refining lexical translation training scheme for improving the quality of statistical phrase-based translationProceedings of the 3rd Symposium on Information and Communication Technology10.1145/2350716.2350727(55-62)Online publication date: 23-Aug-2012
https://dl.acm.org/doi/10.1145/2350716.2350727
Show More Cited By

Recommendations

Toward statistical machine translation without parallel corpora
EACL '12: Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics

We estimate the parameters of a phrase-based statistical machine translation system from monolingual corpora instead of a bilingual parallel corpus. We extend existing research on bilingual lexicon induction to estimate both lexical and phrasal ...
Word Sense Based Hindi-Tamil Statistical Machine Translation

Corpus based natural language processing has emerged with great success in recent years. It is not only used for languages like English, French, Spanish, and Hindi but also is widely used for languages like Tamil, Telugu etc. This paper focuses to ...
Automatic induction of bilingual resources from aligned parallel corpora: application to shallow-transfer machine translation

The availability of machine-readable bilingual linguistic resources is crucial not only for rule-based machine translation but also for other applications such as cross-lingual information retrieval. However, the building of such resources (bilingual ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACL '04: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics

July 2004

729 pages

General Chair:
Donia Scott
ITRI, University of Brighton

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 21 July 2004

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
765
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)3

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sanentz SLesk MGiven L(2015)Toward a semantic stability index (SSI) via a preliminary exploration of translation loopingProceedings of the 78th ASIS&T Annual Meeting: Information Science with Impact: Research in and for the Community10.5555/2857070.2857143(1-4)Online publication date: 6-Nov-2015
https://dl.acm.org/doi/10.5555/2857070.2857143
Govada AJoshi PMittal SSahay S(2015)Hybrid Approach for Inductive Semi Supervised Learning Using Label Propagation and Support Vector MachineProceedings of the 11th International Conference on Machine Learning and Data Mining in Pattern Recognition - Volume 916610.1007/978-3-319-21024-7_14(199-213)Online publication date: 20-Jul-2015
https://dl.acm.org/doi/10.1007/978-3-319-21024-7_14
Hoang CLe CPham STrong GHluchy LQuyet TCastelli EDuc KChi MTran V(2012)Refining lexical translation training scheme for improving the quality of statistical phrase-based translationProceedings of the 3rd Symposium on Information and Communication Technology10.1145/2350716.2350727(55-62)Online publication date: 23-Aug-2012
https://dl.acm.org/doi/10.1145/2350716.2350727
Gao QGuzman FVogel SJoshi AHuang CJurafsky D(2010)EMDCProceedings of the 23rd International Conference on Computational Linguistics10.5555/1873781.1873821(349-357)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1873781.1873821
Huang SLi KDai XChen JLapata M(2010)Improving word alignment by semi-supervised ensembleProceedings of the Fourteenth Conference on Computational Natural Language Learning10.5555/1870568.1870585(135-143)Online publication date: 15-Jul-2010
https://dl.acm.org/doi/10.5555/1870568.1870585
Gao QBach NVogel SCallison-Burch CKoehn PMonz CPeterson KZaidan O(2010)A semi-supervised word alignment algorithm with partial manual alignmentsProceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR10.5555/1868850.1868851(1-10)Online publication date: 15-Jul-2010
https://dl.acm.org/doi/10.5555/1868850.1868851
Gao QVogel SCallison-Burch CDredze M(2010)Consensus versus expertiseProceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk10.5555/1866696.1866700(30-34)Online publication date: 6-Jun-2010
https://dl.acm.org/doi/10.5555/1866696.1866700
Ambati VVogel SCarbonell JSettles BSmall KTomanek K(2010)Active semi-supervised learning for improving word alignmentProceedings of the NAACL HLT 2010 Workshop on Active Learning for Natural Language Processing10.5555/1860625.1860627(10-17)Online publication date: 6-Jun-2010
https://dl.acm.org/doi/10.5555/1860625.1860627
Ambati VVogel SCarbonell J(2010)Active learning-based elicitation for semi-supervised word alignmentProceedings of the ACL 2010 Conference Short Papers10.5555/1858842.1858909(365-370)Online publication date: 11-Jul-2010
https://dl.acm.org/doi/10.5555/1858842.1858909
Holmqvist MStymne SFoo JAhrenberg LCallison-Burch CKoehn PMonz CSchroeder J(2009)Improving alignment for SMT by reordering and augmenting the training corpusProceedings of the Fourth Workshop on Statistical Machine Translation10.5555/1626431.1626456(120-124)Online publication date: 30-Mar-2009
https://dl.acm.org/doi/10.5555/1626431.1626456
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Recommendations

Toward statistical machine translation without parallel corpora

Word Sense Based Hindi-Tamil Statistical Machine Translation

Automatic induction of bilingual resources from aligned parallel corpora: application to shallow-transfer machine translation

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations