<commit_before>Neotext
===============

An API server that computes the context surrounding quotations on a submitted URL.
  * accepts quote POST requests from the client, of the form:
     * url
     * quote
  * looks up the cited URL's html
  * calculates the context surrounding the quote
  * saves the contextual data to a Postgres database
  * uploads the quote-context json file to Amazon S3.

## Setup ##
  * Python 3.4 or higher is required
  * Clone the Git Repository:
    - git clone https://github.com/neotext/neotext-django-server.git
  * Setup Virtual Environment:
      1. pip install virtualenv
      2. virtualenv venv
      3. source venv/bin/activate
  * In main folder containing requirements.txt:
      - pip install -r requirements.txt
  * Add your own neotext folder to the python path
	 - export PYTHONPATH="$PYTHONPATH:/home/timlangeman/webapps/neotext/neotext"
   - [view python path](http://stackoverflow.com/questions/1489599/how-do-i-find-out-my-python-path-using-python)
  * Setup your own Database & AWS Credentials in settings.py
  * Create Postgres Database:
    - python manage.py syncdb


## Dependencies ##
  * [Python](https://www.python.org/) 3.4,
  * [Postgres](https://www.postgresql.org/)
  * [django](https://www.djangoproject.com/),
  * [psycopg2](http://initd.org/psycopg/)
  * [bs4](https://www.crummy.com/software/BeautifulSoup/)
  * [tinys3](https://www.smore.com/labs/tinys3/)
  * [gevent](http://www.gevent.org/)
  * [django-cors-headers](https://github.com/ottoyiu/django-cors-headers/)  
  * [django_extensions](https://github.com/django-extensions/django-extensions)

## Changelog ##

v0.01 - initial release

## Credits ##
Created by <NAME>.  Inspired by <NAME>.

Be the first contributor.  Your name here!
<commit_msg>Add separate Windows Installation Instructions<commit_after>Neotext
===============

An API server that computes the context surrounding quotations on a submitted URL.
  * accepts quote POST requests from the client, of the form:
     * url
     * quote
  * looks up the cited URL's html
  * calculates the context surrounding the quote
  * saves the contextual data to a Postgres database
  * uploads the quote-context json file to Amazon S3.

## Setup/Installation ##
  * Python 3.4 or higher is required

### Windows Installation Instructions: ###
  * Clone the Git Repository (with GitHub Client):
    - Download the GitHub Desktop Client if you don't have it already.
    - Make sure you're logged in when using the client
  * Setup Virtual Environment:
      1. pip install virtualenv
        - If you get a Permission Denied Error when installing Virtual Environment
          PermissionError: [Errno 13] Permission denied: 'c:\\program files\\python36\\Lib\\site-packages\\virtualenv.py'

        - You have to be able to write to the folder that you're installing it to
            http://stackoverflow.com/questions/31172719/pip-install-access-denied-on-windows

      2. virtualenv neotextEnv
      3. [Activate the Virtual Environment](http://stackoverflow.com/questions/8921188/issue-with-virtualenv-cannot-activate
) on Windows:
        - neotextEnv\Scripts\activate.bat

  * In main folder containing requirements.txt:
      - pip install -r requirements.txt
  * Add your own neotext folder to the python path
	 - export PYTHONPATH="$PYTHONPATH:/home/timlangeman/webapps/neotext/neotext"
   - [view python path](http://stackoverflow.com/questions/1489599/how-do-i-find-out-my-python-path-using-python)
  * Setup your own Database & AWS Credentials in settings.py
  * Create Postgres Database:
    - python manage.py syncdb

### Mac/Linux Installation Instructions ###
* Clone the Git Repository:
  - git clone https://github.com/neotext/neotext-django-server.git
* Setup Virtual Environment:
    1. pip install virtualenv
    2. virtualenv venv
    3. source venv/bin/activate
* In main folder containing requirements.txt:
    - pip install -r requirements.txt
* Add your own neotext folder to the python path
 - export PYTHONPATH="$PYTHONPATH:/home/timlangeman/webapps/neotext/neotext"
 - [view python path](http://stackoverflow.com/questions/1489599/how-do-i-find-out-my-python-path-using-python)
* Setup your own Database & AWS Credentials in settings.py
* Create Postgres Database:
  - python manage.py syncdb



## Dependencies ##
  * [Python](https://www.python.org/) 3.4,
  * [Postgres](https://www.postgresql.org/)
  * [django](https://www.djangoproject.com/),
  * [psycopg2](http://initd.org/psycopg/)
  * [bs4](https://www.crummy.com/software/BeautifulSoup/)
  * [tinys3](https://www.smore.com/labs/tinys3/)
  * [gevent](http://www.gevent.org/)
  * [django-cors-headers](https://github.com/ottoyiu/django-cors-headers/)  
  * [django_extensions](https://github.com/django-extensions/django-extensions)

## Changelog ##

v0.01 - initial release

## Credits ##
Created by <NAME>.  Inspired by <NAME>.

Be the first contributor.  Your name here!

{'fraction_non_alphanumeric': 0.12206477732793522, 'fraction_numerical': 0.014777327935222672, 'mean_word_length': 3.516453382084095, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 16, 'lorem ipsum': 0, 'www.': 12, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7160571', 'n_tokens_mistral': 1600, 'n_tokens_neox': 1513, 'n_words': 420}