A Systematic Literature Review of Test Breakage Prevention and Repair Techniques <s> Research Methodology <s> Empirical software engineering research needs research guidelines to improve the research and reporting processes. We propose a preliminary set of research guidelines aimed at stimulating discussion among software researchers. They are based on a review of research guidelines developed for medical researchers and on our own experience in doing and reviewing software engineering research. The guidelines are intended to assist researchers, reviewers, and meta-analysts in designing, conducting, and evaluating empirical studies. Editorial boards of software engineering journals may wish to use our recommendations as a basis for developing guidelines for reviewers and for framing policies for dealing with the design, data collection, and analysis and reporting of empirical studies. <s> BIB001 </s> A Systematic Literature Review of Test Breakage Prevention and Repair Techniques <s> Research Methodology <s> As with any engineering discipline, software development requires a measurement mechanism for feedback and evaluation. Measurement supports creating a corporate memory and is an aid in answering a variety of questions associated with the enactment of any software process. Measurement also helps, during the course of a project, to assess its progress, to take corrective action based on this assessment, and to evaluate the impact of such action. ::: ::: ::: ::: According to many studies made on the application of metrics and models in industrial environments, measurement in order to be effective must be. ::: ::: ::: ::: Focused on specific goals ::: ::: ::: ::: ::: Applied to all life-cycle products, processes, and resources ::: ::: ::: ::: ::: Interpreted on the basis of characterization and understanding of the organizational context, environment, and goals ::: ::: ::: ::: ::: This means that measurement must be defined in a top-down fashion. It must be focused, based on goals and models. A metric-driven, bottom-up approach, will not work because there are many observable characteristics in software (e.g., time, number of defects, complexity, lines of code, severity of failures, effort, productivity, defect density). A context specific selection of metrics and guidelines on how to use and interpret them should be made, based on the appropriate models and goals of that environment. ::: ::: ::: ::: The most common and popular mechanism for goal-oriented software measurement is the Goal Question Metric approach which is presented in this article in combination with examples from GQM application in industry ::: ::: ::: Keywords: ::: ::: industrial application; ::: phases; ::: measurable software; ::: quality improvement <s> BIB002 </s> A Systematic Literature Review of Test Breakage Prevention and Repair Techniques <s> Research Methodology <s> Background: In 2004 the concept of evidence-based software engineering (EBSE) was introduced at the ICSE04 conference. Aims: This study assesses the impact of systematic literature reviews (SLRs) which are the recommended EBSE method for aggregating evidence. Method: We used the standard systematic literature review method employing a manual search of 10 journals and 4 conference proceedings. Results: Of 20 relevant studies, eight addressed research trends rather than technique evaluation. Seven SLRs addressed cost estimation. The quality of SLRs was fair with only three scoring less than 2 out of 4. Conclusions: Currently, the topic areas covered by SLRs are limited. European researchers, particularly those at the Simula Laboratory appear to be the leading exponents of systematic literature reviews. The series of cost estimation SLRs demonstrate the potential value of EBSE for synthesising evidence and making it available to practitioners. <s> BIB003
We perform a Systematic Literature Review (SLR) by following widely accepted guidelines given in BIB003 BIB001 BIB002 . Based on the guidelines, given in BIB001 , we conducted this study in three steps, i.e., Planning, Conducting and Reporting. To clearly articulate the aims of the study, we use the Goal-Question-Metric (GQM) paradigm, given in BIB002 . Table 1 depicts our review protocol for conducting this SLR. 