<commit_before># Changelog
All notable changes to this project will be documented in this file.

The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/)
and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.html).

## [1.2.2] - Unreleased
### Fixed
  - Remove schema ambiguity #204

## [1.2.1] - 2018-05-14<commit_msg>Fix lidf typo in readme #217<commit_after># Changelog
All notable changes to this project will be documented in this file.

The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/)
and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.html).

## [1.2.2] - Unreleased
### Fixed
  - Remove schema ambiguity #204
  - lidf typo in readme #217

## [1.2.1] - 2018-05-14
{'fraction_non_alphanumeric': 0.14010282776349614, 'fraction_numerical': 0.06683804627249357, 'mean_word_length': 3.721212121212121, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2425558', 'n_tokens_mistral': 306, 'n_tokens_neox': 277, 'n_words': 85}