<commit_before># The Minos Deploy Client
This is the client for the Minos deploy system, users will use this client
to perform the deployment works. Currently, this client support deploying
zookeeper, hdfs, hbase, yarn and impala. And it's very easy to extend
this client to support deploying other services.

## Prerequisites
In order to run the deploy client, we need the following prerequisites:

    1. python 2.6 or later from <http://www.python.org>
    2. pexpect (latest) from <http://www.noah.org/wiki/pexpect>
    3. JDK 1.6 from <http://www.oracle.com/technetwork/java/javase/downloads/index.html>

## A Simple Tutorial
Here we will give a simple example of deploying a hdfs service to show how
to use this deploy client.

As we all known, an hdfs service requires a zookeeper service, so we need to
deploy a zookeeper service at first.

Before starting to deploy the zookeeper and hdfs services, we will define
some conventions:

* **The cluster type**: we define three type of clusters, tst for testing, prc
for offline processing and srv for online serving
* **The zookeeper cluster name**: we define the zookeeper cluster name use the
IDC short name and the cluster type, such as dptst stands for testing cluster
at dp IDC.
* **Other services cluster name**: we define other services cluster name use
the corresponding zookeeper cluster name and the name of the business for which
the service is intended to serve. For example, the dptst-example cluster stands
for a testing cluster used to do example tests.
* **Config file name**: all the services will have a corresponding config files,
the name of a specified service config file will be ${service}-${cluster}.cfg,
for example, the dptst zookeeper service's config file will be named
zookeeper-dptst.cfg, and the dptst example hdfs service's config file will be
named hdfs-dptst-example.cfg.

### Deploy Tank
Tank, the package server, is required by our deploy system. So when a cluster
is setup for the first time, users should setup a tank server first, this only
needs to do once.
<commit_msg>format README.md<commit_after># The Minos Deploy Client
This is the client for the Minos deploy system, users will use this client
to perform the deployment works. Currently, this client support deploying
zookeeper, hdfs, hbase, yarn and impala. And it's very easy to extend
this client to support deploying other services.

## Prerequisites
In order to run the deploy client, we need the following prerequisites:

    1. python 2.6 or later from <http://www.python.org>
    2. pexpect (latest) from <http://www.noah.org/wiki/pexpect>
    3. JDK 1.6 from <http://www.oracle.com/technetwork/java/javase/downloads/index.html>

## A Simple Tutorial
Here we will give a simple example of deploying a hdfs service to show how
to use this deploy client.

As we all known, an hdfs service requires a zookeeper service, so we need to
deploy a zookeeper service at first.

Before starting to deploy the zookeeper and hdfs services, we will define
some conventions:

* **The cluster type**: we define three type of clusters, tst for testing, prc  
for offline processing and srv for online serving
* **The zookeeper cluster name**: we define the zookeeper cluster name use the  
IDC short name and the cluster type, such as dptst stands for testing cluster  
at dp IDC.
* **Other services cluster name**: we define other services cluster name use  
the corresponding zookeeper cluster name and the name of the business for which  
the service is intended to serve. For example, the dptst-example cluster stands  
for a testing cluster used to do example tests.
* **Config file name**: all the services will have a corresponding config files,  
the name of a specified service config file will be ${service}-${cluster}.cfg,  
for example, the dptst zookeeper service's config file will be named  
zookeeper-dptst.cfg, and the dptst example hdfs service's config file will be  
named hdfs-dptst-example.cfg.

### Deploy Tank
Tank, the package server, is required by our deploy system. So when a cluster
is setup for the first time, users should setup a tank server first, this only
needs to do once.

{'fraction_non_alphanumeric': 0.058993498675656154, 'fraction_numerical': 0.0033710570671803513, 'mean_word_length': 4.26489226869455, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 0, 'lorem ipsum': 0, 'www.': 6, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5347728', 'n_tokens_mistral': 1155, 'n_tokens_neox': 1114, 'n_words': 627}