<commit_before># utlz

A Python utils library

## Installation

Install latest version of `utlz` from pypi (https://pypi.python.org/pypi/utlz):
```shell
pip install utlz
```

## Development

Clone the source code [repository](https://github.com/theno/utlz):

```bash
git clone https://github.com/theno/utlz.git
```

Run unit tests with pytest

```bash
pip install --user  pytest
PYTHONPATH=".:$PYTHONPATH"  python -m pytest
```

Build package and run tests against several pythons with tox:

```bash
# install tox
pip install tox

# install and activate different python versions
fab setup.pyenv -H localhost
pyenv install  2.6.9  2.7.13  3.3.6  3.4.6  3.5.3  3.6.0
pyenv local  system  2.6.9  2.7.13  3.3.6  3.4.6  3.5.3  3.6.0

# build and run tests
python -m tox
```<commit_msg>add packaging commands<commit_after># utlz

A Python utils library

## Installation

Install latest version of `utlz` from pypi (https://pypi.python.org/pypi/utlz):
```shell
pip install utlz
```

## Development

Clone the source code [repository](https://github.com/theno/utlz):

```bash
git clone https://github.com/theno/utlz.git
```

Run unit tests with pytest

```bash
pip install --user  pytest
PYTHONPATH=".:$PYTHONPATH"  python -m pytest
```

Build package and run tests against several pythons with tox:

```bash
# install tox
pip install tox

# install and activate different python versions
fab setup.pyenv -H localhost
pyenv install  2.6.9  2.7.13  3.3.6  3.4.6  3.5.3  3.6.0
pyenv local  system  2.6.9  2.7.13  3.3.6  3.4.6  3.5.3  3.6.0

# build and run tests
python -m tox
```

Build and publish package:
```bash
# install pypandoc and twine
pip install  pypandoc  twine

# build package
python setup.py sdist

# upload to pypi.org
twine  upload  dist/utlz-<VERSION>.tar.gz


# usefull oneliners
rm -rf .tox/; python3.6 -m tox
rm -rf dist/; python3.6 setup.py sdist; ls -hal dist/
python3.6 -m twine  upload  dist/utlz*
```
{'fraction_non_alphanumeric': 0.1256517205422315, 'fraction_numerical': 0.04275286757038582, 'mean_word_length': 3.391304347826087, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '275790', 'n_tokens_mistral': 787, 'n_tokens_neox': 740, 'n_words': 234}