Article

Free access

Decoding algorithm in statistical machine translation

Authors:

ACL '98/EACL '98: Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics

Pages 366 - 372

https://doi.org/10.3115/976909.979664

Published: 07 July 1997 Publication History

PDF eReader

Abstract

Decoding algorithm is a crucial part in statistical machine translation. We describe a stack decoding algorithm in this paper. We present the hypothesis scoring method and the heuristics used in our algorithm. We report several techniques deployed to improve the performance of the decoder. We also introduce a simplified model to moderate the sparse data problem and to speed up the decoding process. We evaluate and compare these techniques/models in our statistical machine translation system.

References

[1]

Brown, P. F., S. A. Della-Pietra, V. J. Della-Pietra, and R. L. Mercer. 1993. The Mathematics of Statistical Machine Translation: Parameter Estimation. Computational Linguistics, 19(2):263--311.

Digital Library

Google Scholar

[2]

Brown, P. F., S. A. Della Pietra, V. J. Della Pietra, J. D. Lafferty, and R. L. Mercer. 1992. Analysis, Statistical Transfer, and Synthesis in Machine Translation. In Proceedings of the fourth International Conference on Theoretical and Methodological Issues in Machine Translation, pages 83--100.

Google Scholar

[3]

Cormen, Thomas H., Charles E. Leiserson, and Ronald L. Rivest. 1990. Introduction to Algorithms. The MIT Press, Cambridge, Massachusetts.

Digital Library

Google Scholar

[4]

Magerman, D. 1994. Natural Language Parsing as Statistical Pattern Recognition. Ph. D. thesis, Stanford University.

Digital Library

Google Scholar

[5]

Nilsson, N. 1971. Problem-Solving Methods in Artificial Intelligence. McGraw Hill, New York, New York.

Digital Library

Google Scholar

[6]

Suhm, B., P. Geutner, T. Kemp, A. Lavie, L. Mayfield, A. McNair, I. Rogina, T. Schultz, T. Sloboda, W. Ward, M. Woszczyna, and A. Waibel. 1995. JANUS: Towards multilingual spoken language translation. In Proceedings of the ARPA Speech Spoken Language Technology Workshop, Austin, TX, 1995.

Google Scholar

[7]

Vogel, S., H. Ney, and C. Tillman. 1996. HMM-Based Word Alignment in Statistical Translation. In Proceedings of the Seventeenth International Conference on Computational Linguistics: COLING-96, pages 836--841, Copenhagen, Denmark.

Digital Library

Google Scholar

Cited By

View all

Liebeskind CLiebeskind SBouhnik D(2023)Machine Translation for Historical Research: A case study of Aramaic-Ancient Hebrew TranslationsJournal on Computing and Cultural Heritage 10.1145/3627168Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3627168
Al-Issa SAl-Ayyoub MAl-Khaleel OElmitwally N(2023)Building a neural speech recognizer for quranic recitationsInternational Journal of Speech Technology10.1007/s10772-022-09988-326:4(1131-1151)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10772-022-09988-3
Waibel A(2019)Multimodal dialogue processing for machine translationThe Handbook of Multimodal-Multisensor Interfaces10.1145/3233795.3233811(577-620)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3233795.3233811
Show More Cited By

Decoding algorithm in statistical machine translation
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
2. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

Preventing translation quality deterioration caused by beam search decoding in neural machine translation using statistical machine translation
Graphical abstract

Display Omitted

Abstract
Decoding is an important part of machine translation systems, and the most popular inference algorithm used here is beam search. Beam search algorithm improves translation by allowing a larger search space to be traversed than greedy ...
Bidirectional decoding for statistical machine translation
COLING '02: Proceedings of the 19th international conference on Computational linguistics - Volume 1

This paper describes the right-to-left decoding method, which translates an input string by generating in right-to-left direction. In addition, presented is the bidirectional decoding method, that can take both of the advantages of left-to-right and ...
English Language Statistical Machine Translation Oriented Classification Algorithm
ICITBS '15: Proceedings of the 2015 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS)

In this paper, we study on the problem of statistical machine translation (SMT) for English language, and the main innovation is that we introduce the SVM classifier to solve this problem. Particularly, the process of statistical machine translation is ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

July 1997

543 pages

Program Chairs:
Philip R. Cohen
Oregon Graduate Institute
,
Wolfgang Wahlster
DFKI Saarbrücken, Germany

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 07 July 1997

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
1,270
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)4

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liebeskind CLiebeskind SBouhnik D(2023)Machine Translation for Historical Research: A case study of Aramaic-Ancient Hebrew TranslationsJournal on Computing and Cultural Heritage 10.1145/3627168Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3627168
Al-Issa SAl-Ayyoub MAl-Khaleel OElmitwally N(2023)Building a neural speech recognizer for quranic recitationsInternational Journal of Speech Technology10.1007/s10772-022-09988-326:4(1131-1151)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10772-022-09988-3
Waibel A(2019)Multimodal dialogue processing for machine translationThe Handbook of Multimodal-Multisensor Interfaces10.1145/3233795.3233811(577-620)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3233795.3233811
van der Aa HLeopold HReijers H(2017)Comparing textual descriptions to process models - The automatic detection of inconsistenciesInformation Systems10.1016/j.is.2016.07.01064:C(447-460)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1016/j.is.2016.07.010
Aa HLeopold HReijers H(2015)Detecting Inconsistencies Between Process Models and Textual DescriptionsProceedings of the 13th International Conference on Business Process Management - Volume 925310.1007/978-3-319-23063-4_6(90-105)Online publication date: 31-Aug-2015
https://dl.acm.org/doi/10.1007/978-3-319-23063-4_6
Jiang HWang XTian J(2010)Second-order HMM for event extraction from short messageProceedings of the Natural language processing and information systems, and 15th international conference on Applications of natural language to information systems10.5555/1894525.1894545(149-156)Online publication date: 23-Jun-2010
https://dl.acm.org/doi/10.5555/1894525.1894545
Wang JZhu JCrestani FMarchand-Maillet SChen HEfthimiadis ESavoy J(2010)On statistical analysis and optimization of information retrieval effectiveness metricsProceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval10.1145/1835449.1835489(226-233)Online publication date: 19-Jul-2010
https://dl.acm.org/doi/10.1145/1835449.1835489
Lopez A(2008)Statistical machine translationACM Computing Surveys10.1145/1380584.138058640:3(1-49)Online publication date: 13-Aug-2008
https://dl.acm.org/doi/10.1145/1380584.1380586
Zhang HGildea DJurafsky DGaussier E(2006)Efficient search for Inversion Transduction GrammarProceedings of the 2006 Conference on Empirical Methods in Natural Language Processing10.5555/1610075.1610109(224-231)Online publication date: 22-Jul-2006
https://dl.acm.org/doi/10.5555/1610075.1610109
Kumar SDeng YByrne W(2006)A weighted finite state transducer translation template model for statistical machine translationNatural Language Engineering10.1017/S135132490500381512:1(35-75)Online publication date: 1-Mar-2006
https://dl.acm.org/doi/10.1017/S1351324905003815
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Preventing translation quality deterioration caused by beam search decoding in neural machine translation using statistical machine translation

Bidirectional decoding for statistical machine translation

English Language Statistical Machine Translation Oriented Classification Algorithm