<commit_before>birding: streamparse/kafka demo
===============================

`birding` is an `open source project`__ to produce a stream of recent twitter_
activity based on a sequence of search terms, using only `twitter's public
APIs`_. It serves as both a standalone project and a demo of distributed
real-time computing with Python_ using Storm_/streamparse_ and Kafka_/pykafka_.

__ https://github.com/Parsely/birding

.. toctree::
   :maxdepth: 2

.. _twitter: https://twitter.com
.. _`twitter's public APIs`: https://api.twitter.com
.. _Storm: http://storm.apache.org
.. _Python: http://python.org
.. _Kafka: http://kafka.apache.org
.. _streamparse: https://github.com/Parsely/streamparse
.. _pykafka: https://github.com/Parsely/pykafka
<commit_msg>Add link to user group for help & discussion.<commit_after>birding: streamparse/kafka demo
===============================

`birding` is an `open source project`__ to produce a stream of recent twitter_
activity based on a sequence of search terms, using only `twitter's public
APIs`_. It serves as both a standalone project and a demo of distributed
real-time computing with Python_ using Storm_/streamparse_ and Kafka_/pykafka_.

__ https://github.com/Parsely/birding

.. toctree::
   :maxdepth: 2

To discuss this project, join the `streamparse user group`_.

:ref:`Documentation Index <genindex>`

.. _twitter: https://twitter.com
.. _`twitter's public APIs`: https://api.twitter.com
.. _Storm: http://storm.apache.org
.. _Python: http://python.org
.. _Kafka: http://kafka.apache.org
.. _streamparse: https://github.com/Parsely/streamparse
.. _pykafka: https://github.com/Parsely/pykafka
.. _`streamparse user group`: https://github.com/Parsely/streamparse#user-group

{'fraction_non_alphanumeric': 0.15309069901790873, 'fraction_numerical': 0.0011554015020219526, 'mean_word_length': 4.4125, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 11, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4067143', 'n_tokens_mistral': 548, 'n_tokens_neox': 516, 'n_words': 161}