<commit_before>'''
The :class:`TaskBackend` is at the hart of the
:ref:`task queue application <apps-taskqueue>`. It exposes
all the functionalities for running new tasks, scheduling periodic tasks
and retrieving task information. Pulsar ships with two backends, one which uses
pulsar internals and store tasks in the arbiter domein and onther with store
tasks in redis.


get backend
~~~~~~~~~~~~~~~~~~
A :class:`TaskBackend` is never initialised directly, instead it is created using
the :func:`getbe` function

.. autofunction:: getbe

Task
~~~~~~~~~~~~~

.. autoclass:: Task
   :members:
   :member-order: bysource
   
   
   
TaskBackend
~~~~~~~~~~~~~

.. autoclass:: TaskBackend
   :members:
   :member-order: bysource
   
   
Scheduler Entry
~~~~~~~~~~~~~~~~~~~
<commit_msg>adjusted test app to use the task application<commit_after>'''
The :class:`TaskBackend` is at the hart of the
:ref:`task queue application <apps-taskqueue>`. It exposes
all the functionalities for running new tasks, scheduling periodic tasks
and retrieving task information. Pulsar ships with two backends, one which uses
pulsar internals and store tasks in the arbiter domein and onther with store
tasks in redis.


Get backend
~~~~~~~~~~~~~~~~~~
A :class:`TaskBackend` is never initialised directly, instead it is created using
the :func:`getbe` function::

    backend = getbe('local://', **params)
    
get the pulsar *local* backend.

    backend = getbe('redis://localhost:6379&db=1', **params)
    
get a redis backend.

.. autofunction:: getbe

Task
~~~~~~~~~~~~~

.. autoclass:: Task
   :members:
   :member-order: bysource
   
   
   
TaskBackend
~~~~~~~~~~~~~

.. autoclass:: TaskBackend
   :members:
   :member-order: bysource
   
   
Scheduler Entry
~~~~~~~~~~~~~~~~~~~

{'fraction_non_alphanumeric': 0.14909297052154194, 'fraction_numerical': 0.002834467120181406, 'mean_word_length': 4.268656716417911, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5614105', 'n_tokens_mistral': 524, 'n_tokens_neox': 504, 'n_words': 192}