The surface realisation task: recent developments and future plans
Pages 136 - 140
Abstract
The Surface Realisation Shared Task was first run in 2011. Two common-ground input representations were developed and for the first time several independently developed surface realisers produced realisations from the same shared inputs. However, the input representations had several shortcomings which we have been aiming to address in the time since. This paper reports on our work to date on improving the input representations and on our plans for the next edition of the SR Task. We also briefly summarise other related developments in NLG shared tasks and outline how the different ideas may be usefully brought together in the future.
References
[1]
Anja Belz, Michael White, Dominic Espinosa, Deidre Hogan, Eric Kow, and Amanda Stent. 2011. The first surface realisation shared task: Overview and evaluation results. In Proceedings of the 13th European Workshop on Natural Language Generation (ENLG'11), pages 217--226. Association for Computational Linguistics.
[2]
Bernd Bohnet, Leo Wanner, Simon Mille, and Alicia Burga. 2010. Broad coverage multilingual deep sentence generation with a stochastic multi-level realizer. In Proceedings of the 23rd International Conference on Computational Linguistics, Beijing, China.
[3]
Nadjet Bouayad-Agha, Gerard Casamayor, Leo Wanner, and Chris Mellish. 2012. Content selection from semantic web data. In Proceedings of the 7th International Natural Language Generation Conference (INLG'12).
[4]
Richard Johansson and Pierre Nugues. 2007. Extended constituent-to-dependency conversion for English. In Joakim Nivre, Heiki-Jaan Kaalep, Kadri Muischnek, and Mare Koit, editors, Proceedings of NODALIDA 2007, pages 105--112, Tartu, Estonia.
[5]
Philipp Koehn. 2004. Statistical significance tests for machine translation evaluation. In Dekang Lin and Dekai Wu, editors, Proceedings of EMNLP 2004, pages 388--395, Barcelona, Spain, July. Association for Computational Linguistics.
[6]
Eric Kow and Anja Belz. 2012. LG-Eval: A toolkit for creating online language evaluation experiments. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC'12).
[7]
Adam Meyers, Ruth Reeves, Catherine Macleod, Rachel Szekely, Veronika Zielinska, Brian Young, and Ralph Grishman. 2004. The NomBank project: An interim report. In NAACL/HLT Workshop Frontiers in Corpus Annotation.
[8]
Martha Palmer, Daniel Gildea, and Paul Kingsbury. 2005. The Proposition Bank: A corpus annotated with semantic roles. In Computational Linguistics Journal, pages 71--105.
[9]
Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In In Proceedings of Association for Machine Translation in the Americas, pages 223--231.
[10]
Mihai Surdeanu, Richard Johansson, Adam Meyers, Lluís Màrquez, and Joakim Nivre. 2008. The CoNLL 2008 shared task on joint parsing of syntactic and semantic dependencies. In Proceedings of the Twelfth Conference on Computational Natural Language Learning (CoNLL'08), Manchester, UK.
[11]
Michael White. 2012. Shared task proposal: Syntactic paraphrase ranking. In Proceedings of the 7th International Natural Language Generation Conference (INLG'12).
[12]
Ying Zhang and Stephan Vogel. 2010. Significance tests of automatic machine translation evaluation metrics. Machine Translation, 24: 51--65.
- The surface realisation task: recent developments and future plans
Recommendations
DCU*at generation challenges 2011 surface realisation track
ENLG '11: Proceedings of the 13th European Workshop on Natural Language GenerationIn this paper we describe our system and experimental results on the development set of the Surface Realisation Shared Task. DCU submitted 1-best outputs for the Shallow sub-task of the shared task, using a surface realisation technique based on ...
The first surface realisation shared task: overview and evaluation results
ENLG '11: Proceedings of the 13th European Workshop on Natural Language GenerationThe Surface Realisation (SR) Task was a new task at Generation Challenges 2011, and had two tracks: (1) Shallow: mapping from shallow input representations to realisations; and (2) Deep: mapping from deep input representations to realisations. Five ...
A proposal for a Spanish surface realization shared task
ENLG '11: Proceedings of the 13th European Workshop on Natural Language GenerationWe propose a competitive shared evaluation task for Surface Realization in Spanish. The task would be carried out in 2012. It would involve the generation of text in Spanish from a common ground input shared by all systems. Separate corpora for training/...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Publisher
Association for Computational Linguistics
United States
Publication History
Published: 30 May 2012
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 98Total Downloads
- Downloads (Last 12 months)40
- Downloads (Last 6 weeks)8
Reflects downloads up to 22 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in