<commit_before>Homura
======

|Build| |PyPI version|

Homura (ほむら) is a Python downloader with progress, which can be used to download large files.

It is named after `Homura Akemi <http://ja.wikipedia.org/wiki/%E6%9A%81%E7%BE%8E%E3%81%BB%E3%82%80%E3%82%89>`_.

Features
========

* PycURL based
* Resume downloads (if server supports `byte ranges <http://en.wikipedia.org/wiki/Byte_serving>`_ on the resource)
* Support for requests.Session


Installation
------------
Homura depends on `PycURL <http://pycurl.sourceforge.net/>`_. Install dependencies before installing the python package:

Ubuntu

.. code-block:: bash

    $ sudo apt-get install libcurl4-openssl-dev python-dev

Fedora

.. code-block:: bash

    $ sudo yum groupinstall "Development Tools"
    $ sudo yum install libcurl libcurl-devel python-devel

Then, install homura

.. code-block:: bash

    $ pip install homura

Usage
-----

The simplest usage is to import the utility function ``download``:
<commit_msg>Added build-essential to Ubuntu dependencies<commit_after>Homura
======

|Build| |PyPI version|

Homura (ほむら) is a Python downloader with progress, which can be used to download large files.

It is named after `Homura Akemi <http://ja.wikipedia.org/wiki/%E6%9A%81%E7%BE%8E%E3%81%BB%E3%82%80%E3%82%89>`_.

Features
========

* PycURL based
* Resume downloads (if server supports `byte ranges <http://en.wikipedia.org/wiki/Byte_serving>`_ on the resource)
* Support for requests.Session


Installation
------------
Homura depends on `PycURL <http://pycurl.sourceforge.net/>`_. Install dependencies before installing the python package:

Ubuntu

.. code-block:: bash

    $ sudo apt-get install build-essential libcurl4-openssl-dev python-dev

Fedora

.. code-block:: bash

    $ sudo yum groupinstall "Development Tools"
    $ sudo yum install libcurl libcurl-devel python-devel

Then, install homura

.. code-block:: bash

    $ pip install homura

Usage
-----

The simplest usage is to import the utility function ``download``:

{'fraction_non_alphanumeric': 0.13140866102538576, 'fraction_numerical': 0.019910403185664508, 'mean_word_length': 3.9507389162561575, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 10, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4243850', 'n_tokens_mistral': 705, 'n_tokens_neox': 625, 'n_words': 201}