<commit_before># laravel-normalizer

[![Latest Version on Packagist](https://img.shields.io/packagist/v/nwidart/laravel-normalizer.svg?style=flat-square)](https://packagist.org/packages/nwidart/laravel-normalizer)
[![Software License](https://img.shields.io/badge/license-MIT-brightgreen.svg?style=flat-square)](LICENSE.md)
[![Build Status](https://img.shields.io/travis/nWidart/laravel-normalizer/master.svg?style=flat-square)](https://travis-ci.org/nWidart/laravel-normalizer)
[![Scrutinizer Coverage](https://img.shields.io/scrutinizer/coverage/g/nWidart/laravel-normalizer.svg?maxAge=2592000&style=flat-square)](https://scrutinizer-ci.com/g/nWidart/laravel-normalizer/?branch=master)
[![SensioLabsInsight](https://img.shields.io/sensiolabs/i/0de1cad9-eca9-4907-9466-d4b943ab5183.svg?style=flat-square)](https://insight.sensiolabs.com/projects/0de1cad9-eca9-4907-9466-d4b943ab5183)
[![Quality Score](https://img.shields.io/scrutinizer/g/nWidart/laravel-normalizer.svg?style=flat-square)](https://scrutinizer-ci.com/g/nWidart/laravel-normalizer)
[![Total Downloads](https://img.shields.io/packagist/dt/nwidart/laravel-normalizer.svg?style=flat-square)](https://packagist.org/packages/nwidart/laravel-normalizer)

This package helps you normalize your data in order to save them into the database. The Goal is to having separate classes that handle the data normalization, and thus can be tested independently.

## Install

Via Composer

``` bash
$ composer require nwidart/laravel-normalizer
```<commit_msg>Set max age of a day<commit_after># laravel-normalizer

[![Latest Version on Packagist](https://img.shields.io/packagist/v/nwidart/laravel-normalizer.svg?style=flat-square)](https://packagist.org/packages/nwidart/laravel-normalizer)
[![Software License](https://img.shields.io/badge/license-MIT-brightgreen.svg?style=flat-square)](LICENSE.md)
[![Build Status](https://img.shields.io/travis/nWidart/laravel-normalizer/master.svg?style=flat-square)](https://travis-ci.org/nWidart/laravel-normalizer)
[![Scrutinizer Coverage](https://img.shields.io/scrutinizer/coverage/g/nWidart/laravel-normalizer.svg?maxAge=86400&style=flat-square)](https://scrutinizer-ci.com/g/nWidart/laravel-normalizer/?branch=master)
[![SensioLabsInsight](https://img.shields.io/sensiolabs/i/0de1cad9-eca9-4907-9466-d4b943ab5183.svg?style=flat-square)](https://insight.sensiolabs.com/projects/0de1cad9-eca9-4907-9466-d4b943ab5183)
[![Quality Score](https://img.shields.io/scrutinizer/g/nWidart/laravel-normalizer.svg?style=flat-square)](https://scrutinizer-ci.com/g/nWidart/laravel-normalizer)
[![Total Downloads](https://img.shields.io/packagist/dt/nwidart/laravel-normalizer.svg?style=flat-square)](https://packagist.org/packages/nwidart/laravel-normalizer)

This package helps you normalize your data in order to save them into the database. The Goal is to having separate classes that handle the data normalization, and thus can be tested independently.

## Install

Via Composer

``` bash
$ composer require nwidart/laravel-normalizer
```
{'fraction_non_alphanumeric': 0.15944426066821038, 'fraction_numerical': 0.030433344359907376, 'mean_word_length': 6.522388059701493, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 26, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5023342', 'n_tokens_mistral': 1196, 'n_tokens_neox': 1100, 'n_words': 119}