<commit_before>Grab
====

.. image:: https://travis-ci.org/lorien/grab.png?branch=master
    :target: https://travis-ci.org/lorien/grab?branch=master

.. image:: https://coveralls.io/repos/lorien/grab/badge.svg?branch=master
    :target: https://coveralls.io/r/lorien/grab?branch=master

.. image:: https://pypip.in/download/grab/badge.svg?period=month
    :target: https://pypi.python.org/pypi/grab

.. image:: https://pypip.in/version/grab/badge.svg
    :target: https://pypi.python.org/pypi/grab

.. image:: https://landscape.io/github/lorien/grab/master/landscape.png
   :target: https://landscape.io/github/lorien/grab/master

.. image:: https://readthedocs.org/projects/grab/badge/?version=latest
    :target: https://docs.grablib.org/en/latest/


What is Grab?
-------------

Grab is a python web scraping framework. Grab provides tons of helpful methods
to scrape web sites and to process the scraped content:

* Automatic cookies (session) support
* HTTP and SOCKS proxy with and without authorization
* Keep-Alive support
* IDN support
* Tools to work with web forms
* Easy multipart file uploading
* Flexible customization of HTTP requests<commit_msg>Update docs link in README<commit_after>Grab
====

.. image:: https://travis-ci.org/lorien/grab.png?branch=master
    :target: https://travis-ci.org/lorien/grab?branch=master

.. image:: https://coveralls.io/repos/lorien/grab/badge.svg?branch=master
    :target: https://coveralls.io/r/lorien/grab?branch=master

.. image:: https://pypip.in/download/grab/badge.svg?period=month
    :target: https://pypi.python.org/pypi/grab

.. image:: https://pypip.in/version/grab/badge.svg
    :target: https://pypi.python.org/pypi/grab

.. image:: https://landscape.io/github/lorien/grab/master/landscape.png
   :target: https://landscape.io/github/lorien/grab/master

.. image:: https://readthedocs.org/projects/grab/badge/?version=latest
    :target: http://docs.grablib.org/en/latest/


What is Grab?
-------------

Grab is a python web scraping framework. Grab provides tons of helpful methods
to scrape web sites and to process the scraped content:

* Automatic cookies (session) support
* HTTP and SOCKS proxy with and without authorization
* Keep-Alive support
* IDN support
* Tools to work with web forms
* Easy multipart file uploading
* Flexible customization of HTTP requests
{'fraction_non_alphanumeric': 0.1506849315068493, 'fraction_numerical': 0.0, 'mean_word_length': 3.8385093167701863, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 23, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1108262', 'n_tokens_mistral': 801, 'n_tokens_neox': 775, 'n_words': 167}