<commit_before>Sitebucket: Twitter Site Streams Consumer
=========================================

Installation
------------

Before continuing, you should make sure you have sitebucket installed. Sitebucket isn't currently listed in PyPI, though it can still be easily installed via setuptools or pip.

setuptools::

    > git clone git://github.com/thomasw/sitebucket.git
    > cd sitebucket
    > sudo python setup.py install

pip::

    > pip install -e git://github.com/thomasw/sitebucket.git#egg=sitebucket

You'll also want to make sure that you have requested that Twitter white list your app for Site Streams access and that they have granted that request. The Site Streams API is currently in beta and you will not be able to use this library until they have granted your app access to the Site Streams endpoint.

Finally, be sure to read through Twitter's Site Streams documentation. That's it. Happy streaming!

* `Site Streams Beta Signup Form <https://spreadsheets.google.com/viewform?hl=en&formkey=dFBTbHZIMVhseUtqS2NkT283RTluX3c6MQ&ndplr=1#gid=0>`_
* `Site Streams Documetnation <http://dev.twitter.com/pages/site_streams>`_

Contents:
---------

.. toctree::
   :maxdepth: 2
   
   streams.rst
   monitor.rst
   parsing.rst
   changelog.rst
   todo.rst

Indices and tables
==================
<commit_msg>Fixed some documentation formatting.<commit_after>Sitebucket: Twitter Site Streams Consumer
=========================================

Installation
------------

Before continuing, you should make sure you have sitebucket installed. Sitebucket isn't currently listed in PyPI, though it can still be easily installed via setuptools or pip.

setuptools::

    > git clone git://github.com/thomasw/sitebucket.git
    > cd sitebucket
    > sudo python setup.py install

pip::

    > pip install -e git://github.com/thomasw/sitebucket.git#egg=sitebucket

You'll also want to make sure that you have requested that Twitter white list your app for Site Streams access and that they have granted that request. The Site Streams API is currently in beta and you will not be able to use this library until they have granted your app access to the Site Streams endpoint.

Finally, be sure to read through Twitter's Site Streams documentation. That's it. Happy streaming!

* `Site Streams Beta Signup Form <https://spreadsheets.google.com/viewform?hl=en&formkey=dFBTbHZIMVhseUtqS2NkT283RTluX3c6MQ&ndplr=1#gid=0>`_
* `Site Streams Documetnation <http://dev.twitter.com/pages/site_streams>`_

Contents
--------

.. toctree::
   
   streams.rst
   monitor.rst
   parsing.rst
   changelog.rst
   todo.rst

Indices and tables
==================

{'fraction_non_alphanumeric': 0.12495281238203096, 'fraction_numerical': 0.006417516043790109, 'mean_word_length': 4.08637236084453, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 15, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3983210', 'n_tokens_mistral': 806, 'n_tokens_neox': 755, 'n_words': 283}