TY - CONF T1 - Evaluating visual and statistical exploration of scientific literature networks T2 - 2011 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) Y1 - 2011 A1 - Gove,R. A1 - Dunne,C. A1 - Shneiderman, Ben A1 - Klavans,J. A1 - Dorr, Bonnie J KW - abstracting KW - academic literature KW - action science explorer KW - automatic clustering KW - citation analysis KW - citation network visualization KW - Communities KW - Context KW - custom exploration goal KW - Data visualization KW - Databases KW - Document filtering KW - document handling KW - document ranking KW - easy-to-understand metrics KW - empirical evaluation KW - Google KW - Graphical user interfaces KW - Information filtering KW - Information Visualization KW - Libraries KW - literature exploration KW - network statistics KW - paper filtering KW - paper ranking KW - scientific literature network KW - statistical exploration KW - summarization technique KW - user-defined tasks KW - visual exploration KW - Visualization AB - Action Science Explorer (ASE) is a tool designed to support users in rapidly generating readily consumable summaries of academic literature. It uses citation network visualization, ranking and filtering papers by network statistics, and automatic clustering and summarization techniques. We describe how early formative evaluations of ASE led to a mature system evaluation, consisting of an in-depth empirical evaluation with four domain experts. The evaluation tasks were of two types: predefined tasks to test system performance in common scenarios, and user-defined tasks to test the system's usefulness for custom exploration goals. The primary contribution of this paper is a validation of the ASE design and recommendations to provide: easy-to-understand metrics for ranking and filtering documents, user control over which document sets to explore, and overviews of the document set in coordinated views along with details-on-demand of specific papers. We contribute a taxonomy of features for literature search and exploration tools and describe exploration goals identified by our participants. JA - 2011 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) PB - IEEE SN - 978-1-4577-1246-3 M3 - 10.1109/VLHCC.2011.6070403 ER -