GUI Interaction Testing: Incorporating Event Context

TitleGUI Interaction Testing: Incorporating Event Context
Publication TypeJournal Articles
Year of Publication2011
AuthorsYuan X, Cohen MB, Memon AM
JournalSoftware Engineering, IEEE Transactions on
Pagination559 - 574
Date Published2011/08//july
ISBN Number0098-5589
Keywordsautomatic test case generation, automatic test pattern generation, combinatorial interaction testing, event driven nature, graphical user interface, Graphical user interfaces, GUI interaction testing, program testing

Graphical user interfaces (GUIs), due to their event-driven nature, present an enormous and potentially unbounded way for users to interact with software. During testing, it is important to #x201C;adequately cover #x201D; this interaction space. In this paper, we develop a new family of coverage criteria for GUI testing grounded in combinatorial interaction testing. The key motivation of using combinatorial techniques is that they enable us to incorporate #x201C;context #x201D; into the criteria in terms of event combinations, sequence length, and by including all possible positions for each event. Our new criteria range in both efficiency (measured by the size of the test suite) and effectiveness (the ability of the test suites to detect faults). In a case study on eight applications, we automatically generate test cases and systematically explore the impact of context, as captured by our new criteria. Our study shows that by increasing the event combinations tested and by controlling the relative positions of events defined by the new criteria, we can detect a large number of faults that were undetectable by earlier techniques.