<commit_before>https-happiness
===============

Goal is to add all Australian government sites to [HTTPS Everywhere](https://www.eff.org/https-everywhere).

Status
-------

3/11 chunks merged with HTTPS Everywhere (Each chunk has 10 rules)

Setup
--------

* I used [Digital Ocean](https://www.digitalocean.com/?refcode=2f68bde48289)'s 512mb droplet with Ubuntu 14.04 x64.
* `apt-get install nodejs npm php5`
* `npm install cheerio request`

Production Quality?
-------------------
These are quick and dirty scripts to get the job done! The data ends up being reviewed manually.<commit_msg>Updated status of project<commit_after>https-happiness
===============

Goal is to add all Australian government sites to [HTTPS Everywhere](https://www.eff.org/https-everywhere).

Status
-------

5/11 chunks merged with HTTPS Everywhere (Each chunk has 10 rules)

Setup
--------

* I used [Digital Ocean](https://www.digitalocean.com/?refcode=2f68bde48289)'s 512mb droplet with Ubuntu 14.04 x64.
* `apt-get install nodejs npm php5`
* `npm install cheerio request`

Production Quality?
-------------------
These are quick and dirty scripts to get the job done! The data ends up being reviewed manually.
{'fraction_non_alphanumeric': 0.15771812080536912, 'fraction_numerical': 0.03859060402684564, 'mean_word_length': 3.5884615384615386, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5226927', 'n_tokens_mistral': 389, 'n_tokens_neox': 334, 'n_words': 130}