<commit_before>Bamboo
======


.. image:: https://secure.travis-ci.org/modilabs/bamboo.png?branch=master
  :target: http://travis-ci.org/modilabs/bamboo

Dependencies
------------

* python
* mongodb

Installation
============
    
    ./bin/install.sh

Running
=======

    [start mongodb on localhost and standard port]

    ``python bamboo.py``

Testing
=======

    [install nose testing requirements]
    
    ``pip install -r requirements-test.pip``

    [run tests]

    ``nosetests --with-progressive --with-cov``

Building Documentation
======================

    pip install -r requirements-docs.pip
    cd doc
    make html

Contributing Code
=================

To work on the code:

1. fork this github project
2. add tests for your new feature
3. add the code for your new feature
4. ensure all existing tests and your new tests are passing
5. submit a pull request

Example Usage
=============

    ``curl -X POST -d "url=http://formhub.org/mberg/forms/good_eats/data.csv" http://localhost:8080/datasets``<commit_msg>cleanup, link to rdd<commit_after>Bamboo
======


.. image:: https://secure.travis-ci.org/modilabs/bamboo.png?branch=master
  :target: http://travis-ci.org/modilabs/bamboo

Dependencies
------------

* python
* mongodb

Installation
------------
    
    ``./bin/install.sh``

Running
-------

    start mongodb on localhost and standard port

    ``python bamboo.py``

Testing
-------

    install nose testing requirements
    
    ``pip install -r requirements-test.pip``

    run tests

    ``nosetests --with-progressive --with-cov``

Documentation
-------------

Viewing Documentation
^^^^^^^^^^^^^^^^^^^^^

    The latest docs are available at http://readthedocs.org/docs/bamboo/en/latest/
    
Building Documentation
^^^^^^^^^^^^^^^^^^^^^^

    ``pip install -r requirements-docs.pip``

    ``cd doc``

    ``make html``

Contributing Code
-----------------

To work on the code:

1. fork this github project
2. add tests for your new feature
3. add the code for your new feature
4. ensure all existing tests and your new tests are passing
5. submit a pull request

Example Usage
-------------

    ``curl -X POST -d "url=http://formhub.org/mberg/forms/good_eats/data.csv" http://localhost:8080/datasets``
{'fraction_non_alphanumeric': 0.19242761692650334, 'fraction_numerical': 0.008017817371937639, 'mean_word_length': 2.793918918918919, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1908379', 'n_tokens_mistral': 730, 'n_tokens_neox': 664, 'n_words': 202}