<commit_before># Stop Words

[![Latest Version](https://img.shields.io/github/release/axisofstevil/stop-words.svg?style=flat-square)](https://github.com/axisofstevil/stop-words/releases)
[![Software License](https://img.shields.io/badge/license-MIT-brightgreen.svg?style=flat-square)](LICENSE.md)
[![Build Status](https://img.shields.io/travis/axisofstevil/stop-words/master.svg?style=flat-square)](https://travis-ci.org/axisofstevil/stop-words)
[![Coverage Status](https://img.shields.io/scrutinizer/coverage/g/axisofstevil/stop-words.svg?style=flat-square)](https://scrutinizer-ci.com/g/axisofstevil/stop-words/code-structure)
[![Quality Score](https://img.shields.io/scrutinizer/g/axisofstevil/stop-words.svg?style=flat-square)](https://scrutinizer-ci.com/g/axisofstevil/stop-words)
[![Total Downloads](https://img.shields.io/packagist/dt/axisofstevil/stop-words.svg?style=flat-square)](https://packagist.org/packages/axisofstevil/stop-words)

This is where your description should go. Try and limit it to a paragraph or two, and maybe throw in a mention of what
PSRs you support to avoid any confusion with users and contributors.

## Install

Via Composer

``` bash
$ composer require axisofstevil/stop-words
```

## Usage

``` php
$filter = new Axisofstevil\StopWords\Filter();
echo $filter->cleanText('A Walk to Remember'); // 'Walk Remember'
$filter->setWords(array('a','walk','to'));
echo $filter->cleanText('A Walk to Remember'); // 'Remember'
```

## Testing

``` bash
$ phpunit
```

## Contributing

Please see [CONTRIBUTING](https://github.com/axisofstevil/stop-words/blob/master/CONTRIBUTING.md) for details.

## Credits

- [<NAME>](https://github.com/stevenmaguire)
- [All Contributors](https://github.com/axisofstevil/stop-words/contributors)

## License

The MIT License (MIT). Please see [License File](LICENSE.md) for more information.<commit_msg>usage examples<commit_after># Stop Words

[![Latest Version](https://img.shields.io/github/release/axisofstevil/stop-words.svg?style=flat-square)](https://github.com/axisofstevil/stop-words/releases)
[![Software License](https://img.shields.io/badge/license-MIT-brightgreen.svg?style=flat-square)](LICENSE.md)
[![Build Status](https://img.shields.io/travis/axisofstevil/stop-words/master.svg?style=flat-square)](https://travis-ci.org/axisofstevil/stop-words)
[![Coverage Status](https://img.shields.io/scrutinizer/coverage/g/axisofstevil/stop-words.svg?style=flat-square)](https://scrutinizer-ci.com/g/axisofstevil/stop-words/code-structure)
[![Quality Score](https://img.shields.io/scrutinizer/g/axisofstevil/stop-words.svg?style=flat-square)](https://scrutinizer-ci.com/g/axisofstevil/stop-words)
[![Total Downloads](https://img.shields.io/packagist/dt/axisofstevil/stop-words.svg?style=flat-square)](https://packagist.org/packages/axisofstevil/stop-words)

This is where your description should go. Try and limit it to a paragraph or two, and maybe throw in a mention of what
PSRs you support to avoid any confusion with users and contributors.

## Install

Via Composer

``` bash
$ composer require axisofstevil/stop-words
```

## Usage

``` php
$filter = new Axisofstevil\StopWords\Filter();
echo $filter->cleanText('A Walk to Remember'); // 'Walk Remember'

$filter->setWords(array('a','walk','to'));
echo $filter->cleanText('A Walk to Remember'); // 'Remember'

$filter->mergeWords(array('remember'));
echo $filter->cleanText('A Walk to Remember'); // ''
```

## Testing

``` bash
$ phpunit
```

## Contributing

Please see [CONTRIBUTING](https://github.com/axisofstevil/stop-words/blob/master/CONTRIBUTING.md) for details.

## Credits

- [<NAME>](https://github.com/stevenmaguire)
- [All Contributors](https://github.com/axisofstevil/stop-words/contributors)

## License

The MIT License (MIT). Please see [License File](LICENSE.md) for more information.
{'fraction_non_alphanumeric': 0.17345872518286312, 'fraction_numerical': 0.0, 'mean_word_length': 5.647569444444445, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 13, 'https://': 28, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '391659', 'n_tokens_mistral': 1385, 'n_tokens_neox': 1280, 'n_words': 208}