<commit_before>Open Mining
===========

.. image:: https://raw.github.com/avelino/mining/master/mining/assets/image/openmining.io.png
    :alt: OpenMining

.. image:: https://travis-ci.org/avelino/mining.png?branch=master
    :target: https://travis-ci.org/avelino/mining
    :alt: Build Status - Travis CI

Business Intelligence (BI) Application Server written in Python 


Contribute
----------

Join us on IRC at **#openmining** on freenode (`web access <http://webchat.freenode.net/?channels=openmining>`_).

.. code:: bash

	pip install -r requirements_dev.txt


Requirements
------------

* MongoDB (Admin)
* Redis (Queue and DataWarehouse)
* Bower (Install frontend libs, nodejs depends)


Install
-------

**Make a new project directory to host the mining repository**

.. code:: bash
    $ mkdir openmining

**Change into new directory**

.. code:: bash
    $ cd openmining

**Create a new virtual environment**

.. code:: bash
    $ virtualenv env

**Clone the repository into the current directory**

.. code:: bash
    $ git clone <repo>

**Change directory into new repo**

.. code:: bash
    $ cd mining

**Run pip on project requirements**

.. code:: bash
    $ pip install -r requirements.txt

**Should end successfully with**

*Successfully installed numpy pandas ipython SQLAlchemy bottle bottle-mongo bottle-websocket bottle-auth bottle-beaker beaker pymongo python-dateutil nose redis rq openpyxl xlwt gevent schedule requests pytz gevent-websocket webob six greenlet*

**Install numexpr**

.. code:: bash
    $ pip install numexpr==2.3

**Copy the sample ini file to mining.ini**

.. code:: bash
    $ cp mining/mining.sample.ini ../env/local/lib/python2.7/site-packages/mining-0.2.0-py2.7.egg/mining/mining.ini

**Install JS**

.. code:: bash
    $ bower install

**FAQ**

**If mongodb or redis-server problems**<commit_msg>fix code<commit_after>Open Mining
===========

.. image:: https://raw.github.com/avelino/mining/master/mining/assets/image/openmining.io.png
    :alt: OpenMining

.. image:: https://travis-ci.org/avelino/mining.png?branch=master
    :target: https://travis-ci.org/avelino/mining
    :alt: Build Status - Travis CI

Business Intelligence (BI) Application Server written in Python 


Contribute
----------

Join us on IRC at **#openmining** on freenode (`web access <http://webchat.freenode.net/?channels=openmining>`_).

.. code:: bash

	pip install -r requirements_dev.txt


Requirements
------------

* MongoDB (Admin)
* Redis (Queue and DataWarehouse)
* Bower (Install frontend libs, nodejs depends)


Install
-------

**Make a new project directory to host the mining repository**

.. code:: bash

    $ mkdir openmining

**Change into new directory**

.. code:: bash

    $ cd openmining

**Create a new virtual environment**

.. code:: bash

    $ virtualenv env

**Clone the repository into the current directory**

.. code:: bash

    $ git clone <repo>

**Change directory into new repo**

.. code:: bash

    $ cd mining

**Run pip on project requirements**

.. code:: bash

    $ pip install -r requirements.txt

**Should end successfully with**

*Successfully installed numpy pandas ipython SQLAlchemy bottle bottle-mongo bottle-websocket bottle-auth bottle-beaker beaker pymongo python-dateutil nose redis rq openpyxl xlwt gevent schedule requests pytz gevent-websocket webob six greenlet*

**Install numexpr**

.. code:: bash

    $ pip install numexpr==2.3

**Copy the sample ini file to mining.ini**

.. code:: bash

    $ cp mining/mining.sample.ini ../env/local/lib/python2.7/site-packages/mining-0.2.0-py2.7.egg/mining/mining.ini

**Install JS**

.. code:: bash

    $ bower install

**FAQ**

**If mongodb or redis-server problems**
{'fraction_non_alphanumeric': 0.14015151515151514, 'fraction_numerical': 0.00487012987012987, 'mean_word_length': 3.406436233611442, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '850203', 'n_tokens_mistral': 1233, 'n_tokens_neox': 1135, 'n_words': 360}