TER-Plus: paraphrase, semantic, and alignment enhancements to Translation Edit Rate

TitleTER-Plus: paraphrase, semantic, and alignment enhancements to Translation Edit Rate
Publication TypeJournal Articles
Year of Publication2009
AuthorsSnover M, Madnani N, Dorr BJ, Schwartz R
JournalMachine Translation
Volume23
Issue2
Pagination117 - 127
Date Published2009///
ISBN Number0922-6567
Abstract

This paper describes a new evaluation metric, TER-Plus (TERp) for automatic evaluation of machine translation (MT). TERp is an extension of Translation Edit Rate (TER). It builds on the success of TER as an evaluation metric and alignment tool and addresses several of its weaknesses through the use of paraphrases, stemming, synonyms, as well as edit costs that can be automatically optimized to correlate better with various types of human judgments. We present a correlation study comparing TERp to BLEU, METEOR and TER, and illustrate that TERp can better evaluate translation adequacy.

URLhttp://dx.doi.org/10.1007/s10590-009-9062-9