<commit_before># Wercker devbox

## How to install ##

### Ubuntu ###

1. Install Berkshelf (http://berkshelf.com/)

        gem install berkshelf
2. Run vagrant up (http://www.vagrantup.com/)

        vagrant up


### OS X ###
Using berkshelf and vagrant on OS X is exactly the same as on Ubuntu, however, there are can be some complications:
* you might not have a recent version of ruby installed (>1.9.1) you will have to take some additional steps.
* you might have vagrant installed via the installer and might not have installed berkshelf via the bundled ruby gem installer. To avoid this last problem, we'll install vagrant via ruby gems and not use the packaged vagrant installer.

Note: The next steps assume you have homebrew installed.


1. Install ruby:

	brew install ruby


2. Make sure the ruby you've just installed is being used. Try: 

	ruby -v

This should result in something like:
ruby 1.9.3p374 (2013-01-15 revision 38858) [x86_64-darwin12.2.1]

If not, your paths are probably not setup correctly. Run the follow for diagnostics:

	brew doctor

3. You might want to create a symbolic link to vagrant for easier use:

	cd /usr/local/bin
	ln -s ../Cellar/ruby/1.9.3-p374/bin/vagrant

After this you can follow the Ubuntu instructions. That's it!
<commit_msg>tabs to 8 spaces<commit_after># Wercker devbox

## How to install ##

### Ubuntu ###

1. Install Berkshelf (http://berkshelf.com/)

        gem install berkshelf
2. Run vagrant up (http://www.vagrantup.com/)

        vagrant up


### OS X ###
Using berkshelf and vagrant on OS X is exactly the same as on Ubuntu, however, there are can be some complications:
* you might not have a recent version of ruby installed (>1.9.1) you will have to take some additional steps.
* you might have vagrant installed via the installer and might not have installed berkshelf via the bundled ruby gem installer. To avoid this last problem, we'll install vagrant via ruby gems and not use the packaged vagrant installer.

Note: The next steps assume you have homebrew installed.


1. Install ruby:

        brew install ruby


2. Make sure the ruby you've just installed is being used. Try: 

        ruby -v

This should result in something like:
ruby 1.9.3p374 (2013-01-15 revision 38858) [x86_64-darwin12.2.1]

If not, your paths are probably not setup correctly. Run the follow for diagnostics:

        brew doctor

3. You might want to create a symbolic link to vagrant for easier use:

        cd /usr/local/bin
        ln -s ../Cellar/ruby/1.9.3-p374/bin/vagrant

After this you can follow the Ubuntu instructions. That's it!

{'fraction_non_alphanumeric': 0.0731331793687452, 'fraction_numerical': 0.03194765204003079, 'mean_word_length': 3.3101160862354893, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4273269', 'n_tokens_mistral': 868, 'n_tokens_neox': 743, 'n_words': 377}