<commit_before>## setup

Create a virtualenv outside the repo, install packages from `requirements.txt`
for Python 2, or `p3req.txt` for Python 3, into it.  I haven't picked a Python
version (yet); if I haven't messed up, 2.7 and 3.4 should both work.  Trying to
stay compatible with both.

## running

(from virtualenv)

    python run.py

## testing

    python -m unittest discover [<package path>]
<commit_msg>README now mentions JS tests<commit_after>## setup

Create a virtualenv outside the repo, install packages from `requirements.txt`
for Python 2, or `p3req.txt` for Python 3, into it.  I haven't picked a Python
version (yet); if I haven't messed up, 2.7 and 3.4 should both work.  Trying to
stay compatible with both.

## running

(from virtualenv)

    python run.py

## testing

### Python code

    python -m unittest discover [<package path>]

Omit the package path to run all Python tests.  (Please run this before each
commit.  Committing with expected failures is OK, but do check there are no
unexpected failures.)

### Javascript code

Open `app/static/tests/tests.html` in your browser.

{'fraction_non_alphanumeric': 0.08378378378378379, 'fraction_numerical': 0.012612612612612612, 'mean_word_length': 3.851528384279476, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2783319', 'n_tokens_mistral': 352, 'n_tokens_neox': 322, 'n_words': 158}