A systematic literature review of open source software quality assessment models <s> Implications of the results <s> Component-Based Software Development has become a popular approach to building software intensive systems. Besides using Commercial Off-The-Shelf components, an organization may choose to use Open Source Software components. Using OSS has been reported to have many benefits, but there are also challenges involved. Understanding the potential challenges of using OSS in developing products is important for practitioners, so they become aware of them and can anticipate them and take appropriate measures to address these challenges. We have performed a thorough review of the literature to identify challenges that may arise, as reported in the literature. This paper presents and discusses these findings. Researchers can discuss potential causes and solutions of our synthesized findings as well as benefit from provided references to literature on OSS challenges as input for future research. <s> BIB001 </s> A systematic literature review of open source software quality assessment models <s> Implications of the results <s> There are many open source and commercially available Learning Management System (LMS) on the Internet and one of the important problems in this field is how to choose an LMS that will be the most effective one and that will satisfy the requirements. In order to help in the solution of this problem, the author has developed a computer program to aid in the selection of an LMS. The developed system is web-based and can easily be used over the Internet any where over the world at any time. The developed system is basically a web-based decision support system used to evaluate LMSs by using a flexible and smart algorithm derived from artificial intelligent concepts with fuzzy logic values. The paper describes the development of the LMS evaluation system. The individuals who are most likely to be interested in the LMS evaluation process are teachers, students, and any educational organizations such as: universities, schools, institutes, and anyone else who seeks to have a LMS. <s> BIB002 </s> A systematic literature review of open source software quality assessment models <s> Implications of the results <s> Recently, because of the rapid increase in the popularity of the Internet, the delivery of learning programmes has gradually shifted from local desktop to online-based applications. As more and more technological tools become available for online education, there is an increasing interest among educators and other professionals in the application of these tools with regard to online courses. In large-scale operations, online learning management systems (LMSs) can save cost and time. LMSs are software applications that comprise a suite of tools for learning and teaching online. In conventional educational settings, online LMSs can help to improve the speed and effectiveness of the educational process, communication among learners, and also between staff and students. There are a large number of open-source and commercially available LMSs on the marketplace, and one of the problems facing an administrator or instructor is how to choose the LMS that can meet his/her needs. This paper describes a software system developed by the author to aid in the selection of a suitable LMS. The software is a web-based decision support system, titled Easy Way to Evaluate LMSs, and is based on using a multi-attribute decision-making algorithm for the effective selection of an LMS. <s> BIB003 </s> A systematic literature review of open source software quality assessment models <s> Implications of the results <s> Electronic Book or e-Book has become a new medium in education. An important consideration of e-Book in the education system is the quality of software that are shipped with it. The term ‘e-Book’ is ambiguous at best, and has been used interchangeably with netbook, mini laptop and e-reader to name a few. This paper is interested in determining an appropriate model for evaluating the quality of software in e-Book. It is argued that in order to reap the best possible outcome from e-Book (and on-line learning), quality of the software used should be of ‘acceptable’ standard. Past research efforts are reviewed and a comparison is made to identify best quality ‘characteristics’ that should be used in the evaluation of e-Book. An extension of the ISO 9126 model for assessment is proposed, categorizing five quality characteristics for e-Book. <s> BIB004 </s> A systematic literature review of open source software quality assessment models <s> Implications of the results <s> Reviews of software from experienced users play an important role for software acquisition decision. In order to share their experiences, an online software recommendation system has been developed. This information is not only useful for users or customers, but it is also be used for evaluating the software. Since there are many of reviews are accumulated and expressed in both formal and informal written languages, it takes time for concluding the evaluation. Therefore, we are interested in an automatically process to extract software information attributes from the reviews in order to provide software review representation. One essential problem is the different sentiment of the same sentence in different environment. To solve this problem, rule-based classification is used as our machine learning model. In this research, software quality extracted from user perspective with respect to ISO 9126 is selected to be the characteristic model. We also propose a methodology for a software product reviews mining based on software quality ontology and a product software quality in use scores for software review representation. Our classification approach is applied from two lists of sentiment words (positive and negative words) combining with rule-based classification method. Our result yields four percent of the accuracy improvement from simple classification applied only two lists of sentiment words. <s> BIB005 </s> A systematic literature review of open source software quality assessment models <s> Implications of the results <s> AbstractDecision-making is primarily a process that involves different actors: people, groups of people, institutions and the state. As a discipline, multi-criteria decision-making has a relatively short history. Since 1950s and 1960s, when foundations of modern multi-criteria decision-making methods have been laid, many researches devoted their time to development of new multi-criteria decision-making models and techniques. In the past decades, researches and development in the field have accelerated and seem to continue growing exponentially. Despite the intensive development worldwide, few attempts have been made to systematically present the theoretical bases and developments of multi-criteria decision-making methods. However, the methodological choices and framework for assessment of decisions are still under discussion. The article describes the situation with reviews of MCDM/MADM methods. Furthermore, there is a need for research to study the strengths and weaknesses of different decision-making me... <s> BIB006 </s> A systematic literature review of open source software quality assessment models <s> Implications of the results <s> ContextSoftware quality models provide either abstract quality characteristics or concrete quality measurements; there is no seamless integration of these two aspects. Quality assessment approaches are, hence, also very specific or remain abstract. Reasons for this include the complexity of quality and the various quality profiles in different domains which make it difficult to build operationalised quality models. ObjectiveIn the project Quamoco, we developed a comprehensive approach aimed at closing this gap. MethodThe project combined constructive research, which involved a broad range of quality experts from academia and industry in workshops, sprint work and reviews, with empirical studies. All deliverables within the project were peer-reviewed by two project members from a different area. Most deliverables were developed in two or three iterations and underwent an evaluation. ResultsWe contribute a comprehensive quality modelling and assessment approach: (1) A meta quality model defines the structure of operationalised quality models. It includes the concept of a product factor, which bridges the gap between concrete measurements and abstract quality aspects, and allows modularisation to create modules for specific domains. (2) A largely technology-independent base quality model reduces the effort and complexity of building quality models for specific domains. For Java and C# systems, we refined it with about 300 concrete product factors and 500 measures. (3) A concrete and comprehensive quality assessment approach makes use of the concepts in the meta-model. (4) An empirical evaluation of the above results using real-world software systems showed: (a) The assessment results using the base model largely match the expectations of experts for the corresponding systems. (b) The approach and models are well understood by practitioners and considered to be both consistent and well suited for getting an overall view on the quality of a software product. The validity of the base quality model could not be shown conclusively, however. (5) The extensive, open-source tool support is in a mature state. (6) The model for embedded software systems is a proof-of-concept for domain-specific quality models. ConclusionWe provide a broad basis for the development and application of quality models in industrial practice as well as a basis for further extension, validation and comparison with other approaches in research. <s> BIB007
Based on the comparison of the existing quality assessment models, there is clearly no suitable model-each model has its own limitations. As a result, the findings of this analysis have implications especially for practitioners who work towards coming up with new assessment models. They should note the following points in line with the research questions posed in this study: • Emphasis should shift from trying to build comprehensive models (containing all the possible software characteristics) to building models that include only essential quality characteristics. This study has shown that these essential quality characteristics include: maintainability, usability and maintenance capacity of software community. By narrowing down to these three essential quality characteristics, model developers would help to reduce the burden of OSS evaluation via existing quality assessment models, which has been referred to largely as being laborious and time consuming to conduct  BIB001 ). • Newer models should incorporate selection methods that are amenable to automation as this is not the case in most of the existing OSS quality assessment models reviewed in this study. The selection methods mostly adopted are the model (32%), process (21%) and other (16%) such as guidelines, which are not easily amenable to automation BIB004 . Model developers should thus turn their focus to data mining techniques BIB005 , framework or tool-based selection methods, which are currently among the least considered options. The advantage this offers is that it will help quicken the evaluation process resulting in faster decisionmaking. Following this advice could also bring about increased adoption of the models in practice  . In addition, model developers can also consider modeling quality assessment as a multicriteria decision-making (MCDM) problem so as to facilitate automation as seen in recent studies  BIB002 BIB003 BIB006 ). • From Fig. 5 , it can be observed that 47% of the quality assessment models considered do not mention the domain of application. This implies that most of the models were designed to be domain-independent. As such, domain-independence should be the focus of model developers BIB007 . A domain independent model is one that is able to assess quality in various category of OSS including those that are data-dominant, system software, control-dominant and computation-dominant. It should also be able to this with little or no customization. By following this particular consideration, the model proposed can tend to be widely adopted and possibly standardized.