Summary of a Literature Review in Scalability of QoS-aware Service Composition <s> A. RESEARCH QUESTIONS <s> Objective: Our objective is to describe how softwareengineering might benefit from an evidence-basedapproach and to identify the potential difficultiesassociated with the approach.Method: We compared the organisation and technicalinfrastructure supporting evidence-based medicine (EBM)with the situation in software engineering. We consideredthe impact that factors peculiar to software engineering(i.e. the skill factor and the lifecycle factor) would haveon our ability to practice evidence-based softwareengineering (EBSE).Results: EBSE promises a number of benefits byencouraging integration of research results with a view tosupporting the needs of many different stakeholdergroups. However, we do not currently have theinfrastructure needed for widespread adoption of EBSE.The skill factor means software engineering experimentsare vulnerable to subject and experimenter bias. Thelifecycle factor means it is difficult to determine howtechnologies will behave once deployed.Conclusions: Software engineering would benefit fromadopting what it can of the evidence approach providedthat it deals with the specific problems that arise from thenature of software engineering. <s> BIB001 </s> Summary of a Literature Review in Scalability of QoS-aware Service Composition <s> A. RESEARCH QUESTIONS <s> Service-oriented system engineering (SOSE) has drawn increasing attention since service-oriented computing was introduced in the beginning of this decade. A large number of SOSE challenges that call for special software engineering efforts have been proposed in the research community. Our goal is to gain insight into the current status of SOSE research issues as published to date. To this end, we conducted a systematic literature review exploring SOSE challenges that have been claimed between January 2000 and July 2008. This paper presents the results of the systematic review as well as the empirical research method we followed. In this review, of the 729 publications that have been examined, 51 were selected as primary studies, from which more than 400 SOSE challenges were elicited. By applying qualitative data analysis methods to the extracted data from the review, we proved our hypotheses about the classification scheme. We are able to conclude that the SOSE challenges can be classified along two dimensions: (a) based on themes (or topics) that they cover and (b) based on characteristics (or types) that they reveal. By analyzing the distribution of the SOSE challenges on the topics and types in the years 2000–2008, we are able to point out the trend in SOSE research activities. The findings of this review further provide empirical evidence for establishing future SOSE research agendas. <s> BIB002
Our study intended to answer the following questions: [RQ1:] How are authors on QoS-based dynamic service composition evaluating the scalability of their solutions? [RQ2:] What are the scaling dimensions (and their value ranges) being considered by researchers in this area to characterize the scalability of their solutions? [RQ3:] What are the metrics being considered by researchers to characterize the scalability of their solutions? B. DATA SOURCES AND SEARCH STRATEGY In software engineering, electronic databases are normally considered sufficient BIB001 BIB002 . Hence, we used the following search engines: IEEE Explore, ACM Digital Library, Science Direct, Engineering Village (which searches INSPEC as well as EI Compendex), ISI Web of Knowledge, Google Scholar, and CiteSeer. We searched all the data sources, using a combination of the following keywords (and variations): quality of service (QoS, QoS-aware, QoSenabled), web service composition (WSC, Service Composition, Service-based, Service-Oriented, Servicebased Architecture, Service oriented Architecture, Serviceselection) and dynamic (Adaptive, Adaptation, Self-adaptive, Self-optimizing, Self-healing, Self-managing). The search strings formed by these keywords were adapted for each search engine.