%0 Conference Paper %B Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement %D 2010 %T Obtaining valid safety data for software safety measurement and process improvement %A Basili, Victor R. %A Zelkowitz, Marvin V %A Layman,Lucas %A Dangle,Kathleen %A Diep,Madeline %K case study %K NASA %K risk analysis %K safety metrics %X We report on a preliminary case study to examine software safety risk in the early design phase of the NASA Constellation spaceflight program. Our goal is to provide NASA quality assurance managers with information regarding the ongoing state of software safety across the program. We examined 154 hazard reports created during the preliminary design phase of three major flight hardware systems within the Constellation program. Our purpose was two-fold: 1) to quantify the relative importance of software with respect to system safety; and 2) to identify potential risks due to incorrect application of the safety process, deficiencies in the safety process, or the lack of a defined process. One early outcome of this work was to show that there are structural deficiencies in collecting valid safety data that make software safety different from hardware safety. In our conclusions we present some of these deficiencies. %B Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement %S ESEM '10 %I ACM %C New York, NY, USA %P 46:1–46:4 - 46:1–46:4 %8 2010/// %@ 978-1-4503-0039-1 %G eng %U http://doi.acm.org/10.1145/1852786.1852846 %R 10.1145/1852786.1852846 %0 Journal Article %J IEEE Transactions on Visualization and Computer Graphics %D 2006 %T Knowledge discovery in high-dimensional data: case studies and a user survey for the rank-by-feature framework %A Seo,Jinwook %A Shneiderman, Ben %K case study %K Computer aided software engineering %K Computer Society %K Data analysis %K data mining %K data visualisation %K Data visualization %K database management systems %K e-mail user survey %K Genomics %K Helium %K Hierarchical Clustering Explorer %K hierarchical clustering explorer. %K high-dimensional data %K Histograms %K Information visualization evaluation %K interactive systems %K interactive tool %K knowledge discovery %K multivariate data %K Rank-by-feature framework %K Scattering %K Testing %K user interface %K User interfaces %K user survey %K visual analytic tools %K visual analytics %K visualization tools %X Knowledge discovery in high-dimensional data is a challenging enterprise, but new visual analytic tools appear to offer users remarkable powers if they are ready to learn new concepts and interfaces. Our three-year effort to develop versions of the hierarchical clustering explorer (HCE) began with building an interactive tool for exploring clustering results. It expanded, based on user needs, to include other potent analytic and visualization tools for multivariate data, especially the rank-by-feature framework. Our own successes using HCE provided some testimonial evidence of its utility, but we felt it necessary to get beyond our subjective impressions. This paper presents an evaluation of the hierarchical clustering explorer (HCE) using three case studies and an e-mail user survey (n=57) to focus on skill acquisition with the novel concepts and interface for the rank-by-feature framework. Knowledgeable and motivated users in diverse fields provided multiple perspectives that refined our understanding of strengths and weaknesses. A user survey confirmed the benefits of HCE, but gave less guidance about improvements. Both evaluations suggested improved training methods %B IEEE Transactions on Visualization and Computer Graphics %V 12 %P 311 - 322 %8 2006/06//May %@ 1077-2626 %G eng %N 3 %R 10.1109/TVCG.2006.50 %0 Journal Article %J Intelligent Systems and their Applications, IEEE %D 1998 %T IMACS: a case study in real-world planning %A Gupta,S.K. %A Nau, Dana S. %A Regli,W. C. %K automated designer's aid %K CAD/CAM %K case study %K computer aided analysis %K computer aided production planning %K design modifications %K IMACS %K intelligent design assistants %K Interactive Manufacturability Analysis and Critiquing System %K interactive systems %K machined parts evaluation %K machining %K manufacturability %K planning (artificial intelligence) %K planning systems %X This article discusses the complexities of real-world planning and how to create planning systems to address them. IMACS (Interactive Manufacturability Analysis and Critiquing System), an automated designer's aid, evaluates machined parts and suggests design modifications to improve their manufacturability, offering advantages over the planning techniques used in classical planning systems %B Intelligent Systems and their Applications, IEEE %V 13 %P 49 - 60 %8 1998/06//may %@ 1094-7167 %G eng %N 3 %R 10.1109/5254.683210 %0 Conference Paper %B 18th International Conference on Distributed Computing Systems, 1998. Proceedings %D 1998 %T LBF: a performance metric for program reorganization %A Eom, H. %A Hollingsworth, Jeffrey K %K case study %K Computational modeling %K computer network %K Computer science %K Debugging %K distributed processing %K distributed program %K Educational institutions %K Integrated circuit testing %K LBF metric %K load balancing factor %K Load management %K measurement %K NIST %K parallel program %K parallel programming %K performance metric %K program reorganization %K program tuning %K Programming profession %K resource allocation %K software metrics %K software performance evaluation %K US Department of Energy %X We introduce a new performance metric, called Load Balancing Factor (LBF), to assist programmers with evaluating different tuning alternatives. The LBF metric differs from traditional performance metrics since it is intended to measure the performance implications of a specific tuning alternative rather than quantifying where time is spent in the current version of the program. A second unique aspect of the metric is that it provides guidance about moving work within a distributed or parallel program rather than reducing it. A variation of the LBF metric can also be used to predict the performance impact of changing the underlying network. The LBF metric can be computed incrementally and online during the execution of the program to be tuned. We also present a case study that shows that our metric can predict the actual performance gains accurately for a test suite of six programs %B 18th International Conference on Distributed Computing Systems, 1998. Proceedings %I IEEE %P 222 - 229 %8 1998/05/26/29 %@ 0-8186-8292-2 %G eng %R 10.1109/ICDCS.1998.679505 %0 Conference Paper %B Real-Time Systems Symposium, 1994., Proceedings. %D 1994 %T Verifying an intelligent structural control system: a case study %A Elseaidy,W. M %A Cleaveland, Rance %A Baugh,J. W. %K automatic verification tool %K case study %K Concurrency Workbench %K Distributed computing %K Distributed control %K distributed processing %K finite automata %K finite-state processes %K formal verification %K graphical specification language %K high-level design %K intelligent control %K intelligent structural control system verification %K Logic %K Modechart %K Process algebra %K Real time systems %K real-time systems %K Specification languages %K structural engineering computing %K temporal logic %K temporal process algebra %K time-varying systems %K Timing %K timing properties %K visual languages %X Describes the formal verification of the timing properties of the design of an intelligent structural control system using the Concurrency Workbench, an automatic verification tool for finite-state processes. The high-level design of the system is first given in Modechart, a graphical specification language for real-time systems, and then translated into a temporal process algebra supported by the Workbench. The facilities provided by this tool are then used to analyze the system and ultimately show it to be correct %B Real-Time Systems Symposium, 1994., Proceedings. %I IEEE %P 271 - 275 %8 1994/12/07/9 %@ 0-8186-6600-5 %G eng %R 10.1109/REAL.1994.342708