<commit_before>==================
Developer Workflow 
==================

Blaze is being developed as an open source project by
`Continuum Analytics`_. This page describes the basic workflow
that development follows, and may be used as a guide for how
to contribute to the project.

.. _Continuum Analytics: http://continuum.io/

Source code and issue management are hosted in `this github page`_,
and usage of git roughly follows `GitHub Flow`_. What this means
is that the `master` branch is generally expected to be stable,
with tests passing on all platforms, and features are developed in
descriptively named feature branches and merged via github's
Pull Requests.

.. _this github page: https://github.com/ContinuumIO/blaze
.. _GitHub Flow: http://scottchacon.com/2011/08/31/github-flow.html

<commit_msg>Add some info about the python 2/3 unified source tree<commit_after>==================
Developer Workflow 
==================

Blaze is being developed as an open source project by
`Continuum Analytics`_. This page describes the basic workflow
that development follows, and may be used as a guide for how
to contribute to the project.

.. _Continuum Analytics: http://continuum.io/

GitHub Flow
~~~~~~~~~~~

Source code and issue management are hosted in `this github page`_,
and usage of git roughly follows `GitHub Flow`_. What this means
is that the `master` branch is generally expected to be stable,
with tests passing on all platforms, and features are developed in
descriptively named feature branches and merged via github's
Pull Requests.

.. _this github page: https://github.com/ContinuumIO/blaze
.. _GitHub Flow: http://scottchacon.com/2011/08/31/github-flow.html

Unified Python 2 and 3 Codebase
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Blaze is being developed with one codebase that simultaneously
supports both Python 2 and Python 3. To make this manageable,
just Python 2.6, 2.7, and >= 3.3 are being supported.

To support this, all .py files must begin with a few `__future__`
imports, as follows.::

    from __future__ import absolute_import, division, print_function

Additionally, there is a helper submodule `blaze.py2help` including
a number of utilities to smooth the differences between Python versions.
Please browse the source file to see what is there, and read the
documentation for the `six library`_ for details on this style of
unified codebase.

.. _six library: http://pythonhosted.org/six/

Testing
~~~~~~~


{'fraction_non_alphanumeric': 0.1058438904781365, 'fraction_numerical': 0.011851246424192888, 'mean_word_length': 4.666666666666667, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 4, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2461112', 'n_tokens_mistral': 683, 'n_tokens_neox': 624, 'n_words': 320}