<commit_before>fteproxy Build Instructions
===========================

Ubuntu 10.04+
-------------

```
sudo apt-get install python-dev libgmp-dev python-crypto python-twisted python-pip upx
sudo pip install pyptlib obfsproxy
git clone https://github.com/kpdyer/fteproxy.git
cd fteproxy
make
make test
make dist
```

OSX 10.6+
---------

Install homebrew: http://brew.sh/

```
ruby -e "$(curl -fsSL https://raw.github.com/Homebrew/homebrew/go/install)"```

```
brew install --build-from-source python gmp git upx
git clone https://github.com/kpdyer/fteproxy.git
cd fteproxy
make
make test
make dist
```
<commit_msg>Update to formatting<commit_after>fteproxy Build Instructions
===========================

Ubuntu 10.04+
-------------

```
sudo apt-get install python-dev libgmp-dev python-crypto python-twisted python-pip upx
sudo pip install pyptlib obfsproxy
git clone https://github.com/kpdyer/fteproxy.git
cd fteproxy
make
make test
make dist
```

OSX 10.6+
---------

Install homebrew: http://brew.sh/

```
ruby -e "$(curl -fsSL https://raw.github.com/Homebrew/homebrew/go/install)"
```

```
brew install --build-from-source python gmp git upx
git clone https://github.com/kpdyer/fteproxy.git
cd fteproxy
make
make test
make dist
```

{'fraction_non_alphanumeric': 0.1935483870967742, 'fraction_numerical': 0.01129032258064516, 'mean_word_length': 3.7007575757575757, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2296251', 'n_tokens_mistral': 451, 'n_tokens_neox': 401, 'n_words': 114}