<commit_before>Dask
====

A minimal task scheduling abstraction.

See Dask documentation at http://dask.readthedocs.org

LICENSE
-------

New BSD. See `License File <https://github.com/ContinuumIO/dask/blob/master/LICENSE.txt>`__.

Install
-------

``dask`` is on the Python Package Index (PyPI):

::

    pip install dask

Example
-------

.. image:: docs/source/_static/dask-simple.png
   :height: 400px
   :alt: A simple dask dictionary
   :align: right


Consider the following simple program

.. code-block:: python

   def inc(i):
       return i + 1

   def add(a, b):
       return a + b

   x = 1
   y = inc(x)
   z = add(y, 10)

We encode this as a dictionary in the following way

.. code-block:: python

   d = {'x': 1,
        'y': (inc, 'x'),
        'z': (add, 'y', 10)}

Dependencies
------------

``dask.core`` supports Python 2.6+ and Python 3.2+ with a common codebase.  It<commit_msg>edit readme<commit_after>Dask
====

A minimal task scheduling abstraction.

See Dask documentation at http://dask.readthedocs.org

LICENSE
-------

New BSD. See `License File <https://github.com/ContinuumIO/dask/blob/master/LICENSE.txt>`__.

Install
-------

``dask`` is on the Python Package Index (PyPI):

::

    pip install dask

Example
-------

Consider the following simple program

.. code-block:: python

   def inc(i):
       return i + 1

   def add(a, b):
       return a + b

   x = 1
   y = inc(x)
   z = add(y, 10)

We encode this as a dictionary in the following way

.. code-block:: python

   d = {'x': 1,
        'y': (inc, 'x'),
        'z': (add, 'y', 10)}

While less aesthetically pleasing this dictionary may now be analyzed,
optimized, and computed on by other Python code, not just the Python
interpreter.

.. image:: docs/source/_static/dask-simple.png
   :height: 400px
   :alt: A simple dask dictionary
   :align: right


Dependencies
------------

``dask.core`` supports Python 2.6+ and Python 3.2+ with a common codebase.  It
{'fraction_non_alphanumeric': 0.15306122448979592, 'fraction_numerical': 0.014285714285714285, 'mean_word_length': 2.52064631956912, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '554328', 'n_tokens_mistral': 695, 'n_tokens_neox': 642, 'n_words': 227}