<commit_before>Widukind - dlstats
==================

|Build Status| |Build Doc| |Coveralls|

**This is a database of international macroeconomic data collected on public web servers of statistical offices worldwide.**

Requires
--------

- MongoDB 3+
- Python 3.4
- `Widukind Common`_
- `Widukind Web`_ for WebUI (Optional)

Installation with Python
------------------------

See Dockerfile for installation example.

Installation with Docker
------------------------

Use `Widukind Docker`_ project with docker-compose or manual installation:

**Requires:**

* Docker 1.9+
* docker-compose 1.5+
* sudo right or root access

::

    docker run -d --name mongodb mongo \
      mongod --bind_ip 0.0.0.0 --smallfiles --noauth --directoryperdb
     
    git clone https://github.com/Widukind/dlstats.git
    
    cd dlstats
    
    docker build -t widukind/cli .    
    
    docker run -it --rm --link mongodb:mongodb \
      -e WIDUKIND_MONGODB_URL=mongodb://mongodb/widukind \
      widukind/cli dlstats --help

    # Tips: run dlstats client with alias
    alias dlstats="docker run -it --rm --link mongodb:mongodb -e WIDUKIND_MONGODB_URL=mongodb://mongodb/widukind widukind/cli dlstats"
    dlstats --help


.. |Build Status| image:: https://travis-ci.org/Widukind/dlstats.svg?branch=master
   :target: https://travis-ci.org/Widukind/dlstats
   :alt: Travis Build Status
   
.. |Build Doc| image:: https://readthedocs.org/projects/widukind-dlstats/badge/?version=latest
   :target: http://widukind-dlstats.readthedocs.org/en/latest/?badge=latest
   :alt: Documentation Status   
   
.. |Coveralls| image:: https://coveralls.io/repos/Widukind/dlstats/badge.svg?branch=master&service=github
   :target: https://coveralls.io/github/Widukind/dlstats?branch=master
   :alt: Coverage   

LICENSE
-------

GNU Affero General Public License version 3


.. _`Widukind Web`: https://github.com/Widukind/widukind-web
.. _`Widukind Docker`: https://github.com/Widukind/widukind-docker
.. _`Widukind Common`: https://github.com/Widukind/widukind-common<commit_msg>Add gitter link and update README<commit_after>Widukind - dlstats
==================

|Build Status| |Build Doc| |Coveralls| |Gitter|

**This is a database of international macroeconomic data collected on public web servers of statistical offices worldwide.**

Requires
--------

- MongoDB 3+
- Python 3.4
- `Widukind Common`_
- `Widukind Web`_ for WebUI (Optional)
- `Widukind Api`_ Rest API (Optional)

Installation with Python
------------------------

See Dockerfile for installation example.

Installation with Docker
------------------------

Use `Widukind Docker`_ project with docker-compose or manual installation:

**Requires:**

* Docker 1.9+
* docker-compose 1.5+
* sudo right or root access

::

    docker run -d --name mongodb mongo \
      mongod --bind_ip 0.0.0.0 --smallfiles --noauth --directoryperdb
     
    git clone https://github.com/Widukind/dlstats.git
    
    cd dlstats
    
    docker build -t widukind/cli .    
    
    docker run -it --rm --link mongodb:mongodb \
      -e WIDUKIND_MONGODB_URL=mongodb://mongodb/widukind \
      widukind/cli dlstats --help

    # Tips: run dlstats client with alias
    alias dlstats="docker run -it --rm --link mongodb:mongodb -e WIDUKIND_MONGODB_URL=mongodb://mongodb/widukind widukind/cli dlstats"
    dlstats --help


.. |Build Status| image:: https://travis-ci.org/Widukind/dlstats.svg?branch=master
   :target: https://travis-ci.org/Widukind/dlstats
   :alt: Travis Build Status
   
.. |Build Doc| image:: https://readthedocs.org/projects/widukind-dlstats/badge/?version=latest
   :target: http://widukind-dlstats.readthedocs.org/en/latest/?badge=latest
   :alt: Documentation Status   
   
.. |Coveralls| image:: https://coveralls.io/repos/Widukind/dlstats/badge.svg?branch=master&service=github
   :target: https://coveralls.io/github/Widukind/dlstats?branch=master
   :alt: Coverage
   
.. |Gitter| image:: https://badges.gitter.im/Widukind/dlstats.svg
   :alt: Join the chat at https://gitter.im/Widukind/dlstats
   :target: https://gitter.im/Widukind/dlstats?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge      

LICENSE
-------

GNU Affero General Public License version 3


.. _`Widukind Web`: https://github.com/Widukind/widukind-web
.. _`Widukind Api`: https://github.com/Widukind/widukind-api
.. _`Widukind Docker`: https://github.com/Widukind/widukind-docker
.. _`Widukind Common`: https://github.com/Widukind/widukind-common
{'fraction_non_alphanumeric': 0.15408594967713204, 'fraction_numerical': 0.005344021376085505, 'mean_word_length': 3.1324747010119594, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 22, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 2, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5229461', 'n_tokens_mistral': 1612, 'n_tokens_neox': 1521, 'n_words': 344}