<commit_before>Changelog
=========

3.5.0
-----

Release date TBD.

This is a maintenance release that includes most of the bugfixes and features
that have been contributed since 3.4.0, which could be cherry-picked on top of
3.4.0. Some other contributions with more far-reaching changes remain unreleased
as of yet.

**Compatibility**:

 * Ensures compatibility with Rust 1.16 through 1.63 stable. Previously the
   minimum supported Rust version was 1.4. Cargo from 1.4 is no longer
   compatible with the current crates.io registry, and Rustup fails signature
   verification for these binaries, so it is infeasible to continue to support
   it.

New features:
<commit_msg>Update 3.5.0 release date<commit_after>Changelog
=========

3.5.0
-----

Release date 2022-09-09.

This is a maintenance release that includes most of the bugfixes and features
that have been contributed since 3.4.0, which could be cherry-picked on top of
3.4.0. Some other contributions with more far-reaching changes remain unreleased
as of yet.

**Compatibility**:

 * Ensures compatibility with Rust 1.16 through 1.63 stable. Previously the
   minimum supported Rust version was 1.4. Cargo from 1.4 is no longer
   compatible with the current crates.io registry, and Rustup fails signature
   verification for these binaries, so it is infeasible to continue to support
   it.

New features:

{'fraction_non_alphanumeric': 0.0700218818380744, 'fraction_numerical': 0.03574033552151714, 'mean_word_length': 3.8309859154929575, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3160754', 'n_tokens_mistral': 414, 'n_tokens_neox': 373, 'n_words': 187}