<commit_before># Parameter Server

The parameter server is a distributed machine learning framework scaling to
industrial-level problems. It is a joint project by
[CMU SML-Lab](http://sml-lab.com), [Baidu IDL](http://idl.baidu.com/en/), and [Google](http://research.google.com).

## How to install

### Requirements:
- Compiler: gcc >= 4.7.2 (prefer >=4.9) or llvm >= 3.4
- OS: tested on Ubuntu 12.10, 13.10, 14.04, RHEL 4U3, Mac OS X 10.9
- Dependent libraries: [zeromq](http://zeromq.org/),
  [gflags](https://code.google.com/p/gflags/),
  [glogs](https://code.google.com/p/google-glog/),
  [gtest](https://code.google.com/p/googletest/),
  [protobuf](https://code.google.com/p/protobuf/), [zlib](), [snappy](),
  [eigen3](). We provide
  [install.sh](https://github.com/mli/parameter_server_third_party) to build
  them from sources automatically.

### Build the system
```
git clone https://github.com/mli/parameter_server
cd parameter_server
git clone https://github.com/mli/third_party
cd third_party && ./install.sh
cd .. && make -j8
```

Several options are available for building:

- depended libraries are available in other place
```
export THIRD=/usr/local && make -j8
```

- statically linking all libraries:
```
export STATIC=1 && make -j8
```
<commit_msg>minor<commit_after># Parameter Server

The parameter server is a distributed machine learning framework scaling to
industrial-level problems. It is a joint project by
[CMU SML-Lab](http://sml-lab.com), [Baidu IDL](http://idl.baidu.com/en/), and [Google](http://research.google.com).

## How to install

### Requirements
- Compiler: gcc >= 4.7.2 (prefer >=4.9) or llvm >= 3.4
- OS: tested on Ubuntu 12.10, 13.10, 14.04, RHEL 4U3, Mac OS X 10.9
- Dependent libraries: [zeromq](http://zeromq.org/),
  [gflags](https://code.google.com/p/gflags/),
  [glogs](https://code.google.com/p/google-glog/),
  [gtest](https://code.google.com/p/googletest/),
  [protobuf](https://code.google.com/p/protobuf/), [zlib](), [snappy](),
  [eigen3](). You can use
  [install.sh](https://github.com/mli/parameter_server_third_party) to build
  them from sources.

### Build the system
```
git clone https://github.com/mli/parameter_server
cd parameter_server
git clone https://github.com/mli/third_party
cd third_party && ./install.sh
cd .. && make -j8
```

Options for building:

- depended libraries are available in somewhere
```
export THIRD=/usr/local && make -j8
```

- statical linking
```
export STATIC=1 && make -j8
```

{'fraction_non_alphanumeric': 0.17521194993944286, 'fraction_numerical': 0.023415421881308032, 'mean_word_length': 4.04684317718941, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 9, 'https://': 14, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6551196', 'n_tokens_mistral': 932, 'n_tokens_neox': 862, 'n_words': 222}