<commit_before># tumblr-downloader

A tumblr scraper, designed to download all the images from the blogs that you want.

##Features

* **Iterative downloading** -- If you download from a blog, the run it again, only the missing images will be downloaded the second time.
* **Complete downloading** -- Will scan the entire blog for images, not just the first X pages.
* **Rate limiting**

## Download

Latest releases can be found [here](https://github.com/Liru/tumblr-downloader/releases/latest).

###Windows
[64 bit](https://github.com/Liru/tumblr-downloader/releases/download/v1.2.0/tumblr-downloader-windows.zip)

###Mac
[64 bit](https://github.com/Liru/tumblr-downloader/releases/download/v1.2.0/tumblr-downloader-mac.zip)

###Linux
[64 bit](https://github.com/Liru/tumblr-downloader/releases/download/v1.2.0/tumblr-downloader-linux.zip)

## Usage
###Simple
Make a text file called `download.txt` with each tumblr blog you want to download on a separate line:
```
nature-pics
sunsets
chickenpictures
```

Run `tumblr-downloader` once it's complete.  It'll download all the pictures from the blog and save it in a `downloads/<username>` folder for each user.

You can also download a single tag for a blog, if you only want specific content. For example, you can have the following:
```
nature-pics forests
sunsets
chickenpictures funny faces
```

If your tag has spaces in it, just type the tag normally after the blog name. For instance, in the above example, `chickenpictures` will download anything tagged with `funny faces`. (Note that it will NOT download `funny` and `faces` separately like this.)

### Command line

Run `tumblr-downloader` as such, appending the usernames you want to download after the executable:<commit_msg>Updated README.md to v1.3.0<commit_after># tumblr-downloader

A tumblr scraper, designed to download all the images from the blogs that you want.

##Features

* **Iterative downloading** -- If you download from a blog, the run it again, only the missing images will be downloaded the second time.
* **Complete downloading** -- Will scan the entire blog for images, not just the first X pages.
* **Rate limiting**

## Download

Latest releases can be found [here](https://github.com/Liru/tumblr-downloader/releases/latest).

###Windows
[64 bit](https://github.com/Liru/tumblr-downloader/releases/download/v1.3.0/tumblr-downloader-windows.zip)

###Mac
[64 bit](https://github.com/Liru/tumblr-downloader/releases/download/v1.3.0/tumblr-downloader-mac.zip)

###Linux
[64 bit](https://github.com/Liru/tumblr-downloader/releases/download/v1.3.0/tumblr-downloader-linux.zip)

## Usage
###Simple
Make a text file called `download.txt` with each tumblr blog you want to download on a separate line:
```
nature-pics
sunsets
chickenpictures
```

Run `tumblr-downloader` once it's complete.  It'll download all the pictures from the blog and save it in a `downloads/<username>` folder for each user.

You can also download a single tag for a blog, if you only want specific content. For example, you can have the following:
```
nature-pics forests
sunsets
chickenpictures funny faces
```

If your tag has spaces in it, just type the tag normally after the blog name. For instance, in the above example, `chickenpictures` will download anything tagged with `funny faces`. (Note that it will NOT download `funny` and `faces` separately like this.)

### Command line

Run `tumblr-downloader` as such, appending the usernames you want to download after the executable:
{'fraction_non_alphanumeric': 0.10458452722063037, 'fraction_numerical': 0.009455587392550143, 'mean_word_length': 4.639741518578353, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 8, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 54, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '691555', 'n_tokens_mistral': 1126, 'n_tokens_neox': 1025, 'n_words': 414}