<commit_before># Harvest

[![Build Status](https://img.shields.io/travis/diogoazevedos/harvest/master.svg)](https://travis-ci.org/diogoazevedos/harvest)
[![Dependency Status](https://img.shields.io/david/diogoazevedos/harvest.svg)](https://david-dm.org/diogoazevedos/harvest)
[![devDependency Status](https://img.shields.io/david/dev/diogoazevedos/harvest.svg)](https://david-dm.org/diogoazevedos/harvest#info=devDependencies)

```javascript
import harvest from '@diogoazevedos/harvest'

const url = 'https://github.com/diogoazevedos'
const payload = {
  name: '.vcard-fullname',
  repos: [{
    $root: '.popular-repos .source',
    name: '.repo'
  }]
}

harvest(url, payload)
  .then(response => console.log(response))
  .catch(error => console.log(error))
```

### Installation
```shell
$ npm install @diogoazevedos/harvest --save
```

### License

MIT<commit_msg>docs(readme): Create requirement topic<commit_after># Harvest

[![Build Status](https://img.shields.io/travis/diogoazevedos/harvest/master.svg)](https://travis-ci.org/diogoazevedos/harvest)
[![Dependency Status](https://img.shields.io/david/diogoazevedos/harvest.svg)](https://david-dm.org/diogoazevedos/harvest)
[![devDependency Status](https://img.shields.io/david/dev/diogoazevedos/harvest.svg)](https://david-dm.org/diogoazevedos/harvest#info=devDependencies)

```javascript
import harvest from '@diogoazevedos/harvest'

const url = 'https://github.com/diogoazevedos'
const payload = {
  name: '.vcard-fullname',
  repos: [{
    $root: '.popular-repos .source',
    name: '.repo'
  }]
}

harvest(url, payload)
  .then(response => console.log(response))
  .catch(error => console.log(error))
```

### Requirement

Harvest uses PhantomJS behind the scenes, because of this you need to install it
globally.

```shell
$ npm install -g phantomjs 
```

### Getting started

Just install as a dependency to your project.

```shell
$ npm install @diogoazevedos/harvest --save
```

### License

MIT
{'fraction_non_alphanumeric': 0.17508933129147525, 'fraction_numerical': 0.0, 'mean_word_length': 5.049382716049383, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 7, 'https://': 14, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6997990', 'n_tokens_mistral': 746, 'n_tokens_neox': 711, 'n_words': 112}