| |
In February of 2004, Bonnie Dorr and her student David Zajic (in
collaboration with Rich Schwartz at BBN) competed in the Document
Understanding Conference (DUC)---a summarization evaluation conducted
by NIST. Their headline generator, Topiary, was evaluated
automatically using a new metric called Rouge.
In the area of single-document (monolingual) summarization,
Topiary placed first (out of 40 systems) on 3 Rouge measures and
was the only system on this task to score better than a human summary
on one measure. On the single-document (cross-lingual) track, Dorr's
team placed 2nd on 4 Rouge measures.
Other UMD participants included Dianne O'Leary and her colleagues
(who finished first place in the area of multi-document
summarization). Remote participants included researchers from
Columbia University, CCS, LCC, NYU, USC/ISI, University of Sheffield,
University of Michigan, Microsoft Research, University of Quebec,
University of Ottawa, University of Lethbridge, and several others. |
