<commit_before>azure-datalake-store
====================

.. image:: https://travis-ci.org/Azure/azure-data-lake-store-python.svg?branch=dev
    :target: https://travis-ci.org/Azure/azure-data-lake-store-python

azure-datalake-store is a file-system management system in python for the
Azure Data-Lake Store.

To install from source instead of pip (for local testing and development):

.. code-block:: bash

    > pip install -r dev_requirements.txt
    > python setup.py develop


To run tests, you are required to set the following environment variables:
azure_tenant_id, azure_username, azure_password, azure_data_lake_store_name

To play with the code, here is a starting point:

.. code-block:: python

    from azure.datalake.store import core, lib, multithread
    token = lib.auth(tenant_id, username, password)
    adl = core.AzureDLFileSystem(store_name, token)

    # typical operations
    adl.ls('')
    adl.ls('tmp/', detail=True)
    adl.cat('littlefile')
    adl.head('gdelt20150827.csv')
<commit_msg>Update README.rst to add coveralls badge.<commit_after>azure-datalake-store
====================

.. image:: https://travis-ci.org/Azure/azure-data-lake-store-python.svg?branch=dev
    :target: https://travis-ci.org/Azure/azure-data-lake-store-python
.. image:: https://coveralls.io/repos/github/Azure/azure-data-lake-store-python/badge.svg?branch=master
    :target: https://coveralls.io/github/Azure/azure-data-lake-store-python?branch=master

azure-datalake-store is a file-system management system in python for the
Azure Data-Lake Store.

To install from source instead of pip (for local testing and development):

.. code-block:: bash

    > pip install -r dev_requirements.txt
    > python setup.py develop


To run tests, you are required to set the following environment variables:
azure_tenant_id, azure_username, azure_password, azure_data_lake_store_name

To play with the code, here is a starting point:

.. code-block:: python

    from azure.datalake.store import core, lib, multithread
    token = lib.auth(tenant_id, username, password)
    adl = core.AzureDLFileSystem(store_name, token)

    # typical operations
    adl.ls('')
    adl.ls('tmp/', detail=True)
    adl.cat('littlefile')
    adl.head('gdelt20150827.csv')

{'fraction_non_alphanumeric': 0.12810283687943264, 'fraction_numerical': 0.0070921985815602835, 'mean_word_length': 4.106334841628959, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 7, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6379289', 'n_tokens_mistral': 743, 'n_tokens_neox': 715, 'n_words': 183}