<commit_before># dissecting-unicorns
visualization of how people become data scientists


## development

1. fork and clone this repo

1. provision your development environment
   ```sh
   mkvirtualenv dissecting-unicorns
   pip install -r requirements/python
   ```

1. go into the `web/` directory and run your flask server
    ```sh
    cd web
    export FLASK_APP=app.py
    export FLASK_DEBUG=1
    flask run
    ```

1. open http://localhost:5000 :tada:<commit_msg>updated readme for deployment instructions<commit_after># dissecting-unicorns
visualization of how people become data scientists


## development

1. fork and clone this repo

1. provision your development environment
   ```sh
   mkvirtualenv dissecting-unicorns
   pip install -r requirements/python
   ```

1. go into the `web/` directory and run your flask server
    ```sh
    cd web
    export FLASK_APP=app.py
    export FLASK_DEBUG=1
    flask run
    ```

1. open http://localhost:5000 :tada:


## deployment

This uses [gunicorn to deploy the flask app on digital
ocean](https://www.digitalocean.com/community/tutorials/how-to-serve-flask-applications-with-gunicorn-and-nginx-on-ubuntu-16-04).

1. `ssh dissecting-unicorns`

1. `cd /srv/www/dissecting-unicorns`

1. `git pull origin master`

1. `sudo systemctl restart dissecting-unicorns && sudo systemctl restart nginx`
{'fraction_non_alphanumeric': 0.09104367135455219, 'fraction_numerical': 0.01924500370096225, 'mean_word_length': 3.6301369863013697, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 1, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2154853', 'n_tokens_mistral': 451, 'n_tokens_neox': 423, 'n_words': 139}