Sentence alignment for monolingual comparable corpora

N Elhadad, R Barzilay - 2003 - academiccommons.columbia.edu
2003academiccommons.columbia.edu
We address the problem of sentence alignment for monolingual corpora, a phenomenon
distinct from alignment in parallel corpora. Aligning large comparable corpora automatically
would provide a valuable resource for learning of text-totext rewriting rules. We incorporate
context into the search for an optimal alignment in two complementary ways: learning rules
for matching paragraphs using topic structure and further refining the matching through local
alignment to find good sentence pairs. Evaluation shows that our alignment method …
Abstract
We address the problem of sentence alignment for monolingual corpora, a phenomenon distinct from alignment in parallel corpora. Aligning large comparable corpora automatically would provide a valuable resource for learning of text-totext rewriting rules. We incorporate context into the search for an optimal alignment in two complementary ways: learning rules for matching paragraphs using topic structure and further refining the matching through local alignment to find good sentence pairs. Evaluation shows that our alignment method outperforms state-of-the-art systems developed for the same task.
academiccommons.columbia.edu