Evaluating Visual Analytics at the 2007 VAST Symposium Contest

TitleEvaluating Visual Analytics at the 2007 VAST Symposium Contest
Publication TypeJournal Articles
Year of Publication2008
AuthorsPlaisant C, Grinstein G, Scholtz J, Whiting M, O'Connell T, Laskowski S, Chien L, Tat A, Wright W, Gorg C, Liu Z, Parekh N, Singhal K, Stasko J
JournalComputer Graphics and Applications, IEEE
Pagination12 - 21
Date Published2008/04//march
ISBN Number0272-1716
Keywords2007, analytics, analytics;data, and, Contest;Visual, Science, Symposium, Technology;data, VAST, visualisation;, visualization;visual

In this article, we report on the contest's data set and tasks, the judging criteria, the winning tools, and the overall lessons learned in the competition. We believe that by organizing these contests, we're creating useful resources for researchers and are beginning to understand how to better evaluate VA tools. Competitions encourage the community to work on difficult problems, improve their tools, and develop baselines for others to build or improve upon. We continue to evolve a collection of data sets, scenarios, and evaluation methodologies that reflect the richness of the many VA tasks and applications.