TY - JOUR T1 - Advancing User-Centered Evaluation of Visual Analytic Environments Through Contests JF - Information VisualizationInformation Visualization Y1 - 2009 A1 - Costello,Loura A1 - Grinstein,Georges A1 - Plaisant, Catherine A1 - Scholtz,Jean KW - metrics KW - synthetic data KW - user-centered evaluation KW - visual analytics AB - In this paper, the authors describe the Visual Analytics Science and Technology (VAST) Symposium contests run in 2006 and 2007 and the VAST 2008 and 2009 challenges. These contests were designed to provide researchers with a better understanding of the tasks and data that face potential end users. Access to these end users is limited because of time constraints and the classified nature of the tasks and data. In that respect, the contests serve as an intermediary, with the metrics and feedback serving as measures of utility to the end users. The authors summarize the lessons learned and the future directions for VAST Challenges. VL - 8 SN - 1473-8716, 1473-8724 UR - http://ivi.sagepub.com/content/8/3/230 CP - 3 M3 - 10.1057/ivs.2009.16 ER -