<commit_before># Overview



#System requirements

This Django project has been tested on Windows 10 x64, MAC OS 10.7 and CentOS 7

* Django 1.9
* Python 2.7
* PostgreSQL 9.4
* Apache 2.4

#Quick Start Guide
1. Create database structures
    `./manage.py migrate`

2. Check if there are database migrations by reviewing the list of known migrations:
    `./manage.py migrate --list`

3. Create an admin user
   `./manage.py createsuperuser`

# Using docker-compose
Run `docker-compose` up in the project's root
directory to quickly start development without having to setup a 
specific dev environment first.

By default, the web interface is reachable at 'http://127.0.0.1:8001',
while the database is listening on port 5433.


#Using Vagrant

1. Create Virtualbox VM `vagrant up`. It may take a while when starting VM for the first time

2. Login to VM using `vagrant ssh` command or your favorite ssh client. Login: vagrant, password <PASSWORD>

3. Switch to /vagrant directory `cd /vagrant`

4. Start django server `python manage.py runserver 0.0.0.0:8000`
Note you have to use 0.0.0.0 as server address, otherwise port forwarding may not work
<commit_msg>Update README with csv upload details<commit_after># Overview



#System requirements

This Django project has been tested on Windows 10 x64, MAC OS 10.7 and CentOS 7

* Django 1.9
* Python 2.7
* PostgreSQL 9.4
* Apache 2.4

#Quick Start Guide
1. Create database structures
    `./manage.py migrate`

2. Check if there are database migrations by reviewing the list of known migrations:
    `./manage.py migrate --list`

3. Create an admin user
   `./manage.py createsuperuser`

# Using docker-compose
Run `docker-compose` up in the project's root
directory to quickly start development without having to setup a 
specific dev environment first.

By default, the web interface is reachable at 'http://127.0.0.1:8001',
while the database is listening on port 5433.

4. Upload simulation data
   Click the 'Upload Simulation' link.
   Select this file: website/apps/simulation/data/data_cases_combo_new.csv
   Click Upload. There will now be data to visualize in charts and maps.

#Using Vagrant

1. Create Virtualbox VM `vagrant up`. It may take a while when starting VM for the first time

2. Login to VM using `vagrant ssh` command or your favorite ssh client. Login: vagrant, password vagrant

3. Switch to /vagrant directory `cd /vagrant`

4. Start django server `python manage.py runserver 0.0.0.0:8000`
Note you have to use 0.0.0.0 as server address, otherwise port forwarding may not work

{'fraction_non_alphanumeric': 0.07126076742364917, 'fraction_numerical': 0.03876272513703994, 'mean_word_length': 3.7490706319702602, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 6, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2511122', 'n_tokens_mistral': 830, 'n_tokens_neox': 752, 'n_words': 367}