Nouveau-ROUGE: A Novelty Metric for Update Summarization

TitleNouveau-ROUGE: A Novelty Metric for Update Summarization
Publication TypeJournal Articles
Year of Publication2011
AuthorsConroy JM, Schlesinger JD, O'Leary DP
JournalComputational Linguistics
Pagination1 - 8
Date Published2011///
ISBN Number0891-2017

An update summary should provide a fluent summarization of new information on a time-evolving topic, assuming that the reader has already reviewed older documents or summaries. In 2007 and 2008, an annual summarization evaluation included an update summarization task. Several participating systems produced update summaries indistinguishable from human-generated summaries when measured using ROUGE. However, no machine system performed near human-level performance in manual evaluations such as pyramid and overall responsiveness scoring.