<commit_before>Multi-threaded-downloader
=================================

This is a multi threaded downloader which is made in nodejs. It is highly configurable and extremely efficient.

Features
--------
1. Supports virtually unlimited number of threads.
2. Supports restarting of failed downloads (Downloads only the parts that were not downloaded).
3. Supports checksum verification of file download.


How to use
----------
1. Install [nodejs](http://nodejs.org/) (skip if already done).
2. Install mt-downloader globally.

	```bash
	npm install -g mt-downloader
	```
3. Start using eg.

	```bash
	mtd -u "http://mirror.switch.ch/ftp/mirror/videolan/vlc/2.0.6/macosx/vlc-2.0.6.dmg" -f "vlc-2.0.6.dmg"
	```

Upcoming features!
-------------------
1. Have a user interface.

2. Have different video download algorithms to boost up video download performance.

3. Work as a proxy with video sites such as youtube so that buffering is completely removed.

4. Will be able to restart abruptly terminated threads.

5. Able to install through node package manager.

6. Supports partial downloads for eg - downloading from 30 to 70% of the complete file.<commit_msg>Readme updated<commit_after>Multi-threaded-downloader
=================================

This is a multi threaded downloader which is made in nodejs. It is highly configurable and extremely efficient.

Features
--------
1. Supports virtually unlimited number of threads.
2. Supports restarting of failed downloads (Downloads only the parts that were not downloaded).
3. Supports checksum verification of file download.


How to use
----------
1. Install [nodejs](http://nodejs.org/) (skip if already done).
2. Install mt-downloader globally.

	```bash
	npm install -g mt-downloader
	```
3. Start using eg.

	```bash
	mtd -u "http://mirror.switch.ch/ftp/mirror/videolan/vlc/2.0.6/macosx/vlc-2.0.6.dmg" -f "vlc-2.0.6.dmg"
	```

Note: I face issues while installing as the 'wordwrap' package doesnt get installed on its own. In case you also face the same issue install wordwrap globally.

	```bash
	npm install -g wordwrap
	```

Upcoming features!
-------------------
1. Have a user interface.

2. Have different video download algorithms to boost up video download performance.

3. Work as a proxy with video sites such as youtube so that buffering is completely removed.

4. Will be able to restart abruptly terminated threads.

5. Able to install through node package manager.

6. Supports partial downloads for eg - downloading from 30 to 70% of the complete file.
{'fraction_non_alphanumeric': 0.13122529644268774, 'fraction_numerical': 0.019762845849802372, 'mean_word_length': 3.4171029668411865, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 24, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1100457', 'n_tokens_mistral': 769, 'n_tokens_neox': 706, 'n_words': 322}