Prioritizing component compatibility tests via user preferences

TitlePrioritizing component compatibility tests via user preferences
Publication TypeConference Papers
Year of Publication2009
AuthorsYoon I-C, Sussman A, Memon AM, Porter A
Conference NameSoftware Maintenance, 2009. ICSM 2009. IEEE International Conference on
Date Published2009/09//
Keywordscompatibility testing prioritization, component configurations, computer clusters, Middleware, Middleware systems, object-oriented programming, program testing, software engineering, Software systems, third-party components, user preferences

Many software systems rely on third-party components during their build process. Because the components are constantly evolving, quality assurance demands that developers perform compatibility testing to ensure that their software systems build correctly over all deployable combinations of component versions, also called configurations. However, large software systems can have many configurations, and compatibility testing is often time and resource constrained. We present a prioritization mechanism that enhances compatibility testing by examining the ldquomost importantrdquo configurations first, while distributing the work over a cluster of computers. We evaluate our new approach on two large scientific middleware systems and examine tradeoffs between the new prioritization approach and a previously developed lowest-cost-configuration-first approach.