A Framework for Software Engineering Experimental Replications

TitleA Framework for Software Engineering Experimental Replications
Publication TypeConference Papers
Year of Publication2008
AuthorsMendonca MG, Maldonado JC, de Oliveira MCF, Carver J, Fabbri CPF, Shull F, Travassos GH, Hohn EN, Basili VR
Conference NameEngineering of Complex Computer Systems, 2008. ICECCS 2008. 13th IEEE International Conference on
Date Published2008/04/31/3
Keywordsengineering, engineering;, evidence;experimental, experimental, Experiments;experimental, for, Framework, Improving, knowledge, of, replication, replication;software, sharing;software, the, transfer;knowledge

Experimental replications are very important to the advancement of empirical software engineering. Replications are one of the key mechanisms to confirm previous experimental findings. They are also used to transfer experimental knowledge, to train people, and to expand a base of experimental evidence. Unfortunately, experimental replications are difficult endeavors. It is not easy to transfer experimental know-how and experimental findings. Based on our experience, this paper discusses this problem and proposes a Framework for Improving the Replication of Experiments (FIRE). The FIRE addresses knowledge sharing issues both at the intra-group (internal replications) and inter-group (external replications) levels. It encourages coordination of replications in order to facilitate knowledge transfer for lower cost, higher quality replications and more generalizable results.