752937
In cloud, do MTC or HTC service providers benefit from the economies of scale?
Cloud computing, which is advocated as an economic platform for daily computing, has become a hot topic for both industrial and academic communities in the last couple of years. The basic idea behind cloud computing is that resource providers, which own the cloud platform, offer elastic resources to end users. In this paper, we intend to answer one key question to the success of cloud computing: in cloud, do many task computing (MTC) or high throughput computing (HTC) service providers, which offer the corresponding computing service to end users, benefit from the economies of scale? To the best of our knowledge, no previous work designs and implements the enabling system to consolidate MTC and HTC workloads on the cloud platform and no one answers the above question. Our research contributions are threefold: first, we propose an innovative usage model, called dynamic service provision (DSP) model, for MTC or HTC service providers. In the DSP model, the resource provider provides the service of creating and managing runtime environments for MTC or HTC service providers, and consolidates heterogeneous MTC or HTC workloads on the cloud platform; second, based on the DSP model, we design and implement Dawningcloud, which provides automatic management for heterogeneous workloads; third, a comprehensive evaluation of Dawningcloud has been performed in an emulatation experiment. We found that for typical workloads, in comparison with the previous two cloud solutions, Dawningcloud saves the resource consumption maximally by 46.4% (HTC) and 74.9% (MTC) for the service providers, and saves the total resource consumption maximally by 29.7% for the resource provider. At the same time, comparing with the traditional solution that provides MTC or HTC services with dedicated systems, Dawningcloud is more cost-effective. To this end, we conclude that for typical MTC and HTC workloads, on the cloud platform, MTC and HTC service providers and the resource service provider can benefit from the economies of scale.
1037558
PhoenixG: a unified management framework for industrial information grid
The industrial information grid is a special kind of system, the users of which exclusively own geographically distributed computing resources for business service, and try to maintain the lowest total cost of ownership while guaranteeing quality of service. In this paper, we classify the industrial information grid as an extension to grid problem; develop a unified management framework for new management paradigm, which supports the distribution of administration labor and collaboration of system administrator at different locations; propose a self-organizing algorithm, which supports the initial establishment, daily management and exception processing of industrial information grid. Finally, we evaluate the performance of system management, and analyze the management overhead with this new management paradigm.
14894173
Gingko: correlating causal paths in distributed systems
Many large-scale systems are distributed systems of multiple communicating components. Finding causal paths of message traces between components throughout these systems is important to uncover runtime behaviors and identify the root cause of failures, but this "art" often hides in the heads of developers or domain experts. Our goal is to design tools and algorithms to help developers record this art into logs and help the modestly-skilled users and system administrators master it to make better use and management of distributed systems. In this paper, we present a methodology that automatically builds the causal paths of message traces by 1) an agreement with programmers on the style and content of logs produced by operational distributed systems they develop and 2) a correlation algorithm to build message causal paths with the clues from these logs. To validate this mechanism, we have implemented Gingko, a prototype providing a tool chain for users to gain better comprehensions of distributed systems and to debug them efficiently when errors happen.
15192522
A layered design methodology of cluster system stack
The application range of cluster has expanded beyond scientific computing, but the present cluster system software fails to provide a flexible architecture to promote code reuse and facilitate building cluster system software for different computing contexts, most of which are developed from scratch case by case, or integrated or packaged with ldquothe best practicerdquo. In this paper, we have proposed a layered design methodology to build cluster system stack with different layers concentrating on different functions, and developed common sets of core service as reusing framework for different computing context. Following this methodology, we have built Phoenix-a complete cluster system stack for both scientific and business computing, which is verified and deployed on Dawning 4000 A super computer for scientific computing and other cluster systems for business computing. The qualitative evaluation and our practices show the design methodology of Phoenix has advantages over other methodologies.
368510
A Performance Model for Domino Mail Server
Using performance model to analyze the Internet service is prevailing. However, the research of the performance model for mail server retrains in the immature status. In this paper, based on the queue theory, we propose a performance model for Domino mail server. The verification and analysis of the model are also presented. The experimental results show that this model characterizes the behavior of Domino mail server well and prove that it is useful for the qualitative performance measurement of Domino mail server.
2643198
Easy and reliable cluster management: the self-management experience of Fire Phoenix
High-Performance clusters are rapidly becoming an important computing platform for both scientific and business applications. To fulfil the new demands and challenges, cluster system software is inevitably complex. Even for experienced administrators, the management of a cluster system is an exhausting job. This paper introduces Fire Phoenix, a scalable and self-managing cluster system software that supports both scientific and commercial applications. With the self-configuring and self-healing features, much of the machine configuration and error recovery can be done automatically. Our design has been proven effective in the operations of the Dawning 4000A supercomputer, which is the biggest cluster system in China
2805830
Kapa: A File Sharing System Based on HP2P
In this paper, we present Kapa, a new file sharing system based on HP2P which is a two-layer hybrid P2P network that combines the strongpoint of DHT and flooding methods to improve the performance of whole system. The design of Kapa, including the HP2P and the file sharing modules, is introduced in detail. By the analysis and simulation of Kapa, we conclude that Kapa is good at scalability, efficiency, and stability.
7150014
Service View Description of a Service Oriented C4ISR Architecture Framework
This paper presents a Service Oriented C4ISR Architecture Framework and prescribes the Service View description. In the future integrated joint operation, similar to Network-Centric Operation, C4ISR system which enables to federate systems, sensors and effectors to promote military effectiveness, is moving towards a more dynamic producer/consumer environment. SOA is an architectural design approach to application integration that provides such an environment through the flexible connectivity of applications implemented as services. In order to improve the C4ISR Architecture Framework (C4ISRAF) including SOA related issues, service and related elements are added to the C4ISRAF as integrated parts and Service View is added to the framework. Further, Service View and its product descriptions are prescribed by the service related elements.
12607701
An AIS-Based Service Match Model
Aiming at the problem that self-learning ability of the current system usually appears weak during service discovery, a novel artificial immune system (AIS) based service match model is proposed, which is based on the reference to the principles of cellpsilas mutation, evaluation and the quadratic response abilities, as well as simulation on the antibody-antigen identification mechanism. Theoretical analysis and simulations both show that the model can not only increasing the recall ratio and matching speed, but also realizing the function that deriving similar service request from known service request and then searching the best matching service. Furthermore, this service matching model is able to improve systempsilas adaptive learning, memorizing and dynamic evaluating abilities in service matching process.
14748707
Training One-class Support Vector Machines in the Primal Space
In this paper, we proposed a novel Newton-type solver for one-class support vector machines in the primal space directly. Firstly, utilizing reproducing property of kernel and Huber regression function, original constrained quadratic programming is transformed into approximate unconstrained one, which is continuous and twice differentiable. Then, we give a Newton-type training algorithm to solve it. Further analysis shows the computation complexity of our algorithm is identical with theoretical lower bound for solving one-class support vector machines. In the end, experiments on 9 UCI datasets are done to validate the affectivity of proposed algorithm, and when comparing with dual method (LIBSVM),its produces comparative testing accuracy, better training speed, and less support vectors.
15937993
The Design and Optimization of H.264 Encoder Based on the Nexperia Platform
The Nexperia PNX1501 Media Processor is a complete Audio/Video/Graphics system on a chip that contains a high-performance 32-bit VLIW processor, capable of high quality software video, audio signal processing. Based on Philips Semiconductor's multimedia processing chip Nexperia PNX1501, designs a new H.264 encoder with high performance for real time signal processing. Chooses the rapid integral discrete cosine translation and the advanced Hexagon searching algorithm, accomplishes the intelligent optimization and comprehensive debugging for codes. The results of experiments indicate that the encoder can encode all kinds of video data rapidly, and can realize the real time processing for all kinds of video signals.