<commit_before>Testing and experimenting with a full yar deployment
is done by creating a series of
[Docker](https://www.docker.io/) containers to run
instances of the various yar services. The number, type
and size of these containers can be varied to validate
yar's operation in various deployment configurations.

Creating a Box with Correct Linux Kernel
----------------------------------------

The primary development environment for yar is
[Mac OS X](http://www.apple.com/ca/osx/).
[Docker](https://www.docker.io/) doesn't support
[Mac OS X](http://www.apple.com/ca/osx/)
so a [Vagrant](http://www.vagrantup.com/) provisioned
[VirtualBox](https://www.virtualbox.org/)
VM running [Ubuntu 12.04](http://releases.ubuntu.com/12.04/) is
used as the [Docker](https://www.docker.io/) container host. 
There's one little gotcha to address = the default
[Ubuntu 12.04](http://releases.ubuntu.com/12.04/)
[box](http://docs.vagrantup.com/v2/boxes.html)
runs the 3.2 Linux kernel but 
[Docker requires](http://docs.docker.io/en/latest/installation/ubuntulinux/)
version 3.8 of the Linux kernel. So, we need create a local
[Ubuntu 12.04](http://releases.ubuntu.com/12.04/)
[box](http://docs.vagrantup.com/v2/boxes.html)
with the 3.8 Linux kernel.

* [these instructions](precise64-3.8-kernel/README.md) describe how to create
a [box](http://docs.vagrantup.com/v2/boxes.html) called *precise64-3.8-kernel*
and make the [box](http://docs.vagrantup.com/v2/boxes.html)
available in the local [box](http://docs.vagrantup.com/v2/boxes.html) repo

> NOTE - creating the [box](http://docs.vagrantup.com/v2/boxes.html)
with the right kernel version is a one time operation - you don't have
to do this before running each load test - create the<commit_msg>start of fixing testing documenation<commit_after>Testing against and experimenting with a full yar deployment
is done by creating a series of
[Docker](https://www.docker.io/) containers which run
instances of the various yar services. The number, type
and size of these containers can be varied when the deployment
is spun up to validate yar's operation in a variety of
deployment configurations. Also, after initial deployment
is up and running, it is also possible to add and remove
services to understand and verify a broad set of
operational scenarios.

* spin up a [VirtualBox](https://www.virtualbox.org/)
VM running [Ubuntu 12.04](http://releases.ubuntu.com/12.04/)
and version 3.8 of the Linux kernel

Creating a Box with Correct Linux Kernel
----------------------------------------

The primary development environment for yar is
[Mac OS X](http://www.apple.com/ca/osx/).
[Docker](https://www.docker.io/) doesn't support
[Mac OS X](http://www.apple.com/ca/osx/)
so a [Vagrant](http://www.vagrantup.com/) provisioned
[VirtualBox](https://www.virtualbox.org/)
VM running [Ubuntu 12.04](http://releases.ubuntu.com/12.04/) is
used as the [Docker](https://www.docker.io/) container host. 
There's one little gotcha to address = the default
[Ubuntu 12.04](http://releases.ubuntu.com/12.04/)
[box](http://docs.vagrantup.com/v2/boxes.html)
runs the 3.2 Linux kernel but 
[Docker requires](http://docs.docker.io/en/latest/installation/ubuntulinux/)
version 3.8 of the Linux kernel. So, we need create a local
[Ubuntu 12.04](http://releases.ubuntu.com/12.04/)
[box](http://docs.vagrantup.com/v2/boxes.html)
with the 3.8 Linux kernel.

* [these instructions](precise64-3.8-kernel/README.md) describe how to create
a [box](http://docs.vagrantup.com/v2/boxes.html) called *precise64-3.8-kernel*
and make the [box](http://docs.vagrantup.com/v2/boxes.html)
available in the local [box](http://docs.vagrantup.com/v2/boxes.html) repo

> NOTE - creating the [box](http://docs.vagrantup.com/v2/boxes.html)
with the right kernel version is a one time operation - you don't have
to do this before running each load test - create the
{'fraction_non_alphanumeric': 0.1506991196271362, 'fraction_numerical': 0.025375453133091662, 'mean_word_length': 3.9335887611749683, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 5, 'https://': 9, 'lorem ipsum': 0, 'www.': 15, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5347220', 'n_tokens_mistral': 1332, 'n_tokens_neox': 1211, 'n_words': 392}