<commit_before>### 1.2.3.1 TBD

* Make `decodeUtf8With` fail explicitly for unsupported non-BMP
  replacement characters instead silent undefined behaviour (gh-213)

### 1.2.3.0

* Spec compliance: `toCaseFold` now follows the Unicode 9.0 spec
  (updated from 8.0).

* Bug fix: the lazy `takeWhileEnd` function violated the
  [lazy text invariant](https://github.com/bos/text/blob/1.2.3.0/Data/Text/Internal/Lazy.hs#L51)
  (gh-184).

* Bug fix: Fixed usage of size hints causing incorrect behavior (gh-197).

* New function: `unsnoc` (gh-173).

* Reduce memory overhead in `encodeUTF8` (gh-194).

* Improve UTF-8 decoder error-recovery (gh-182).

* Minor documentation improvements (`@since` annotations, more
  examples, clarifications).
<commit_msg>Add changelog entry for #223 / #226<commit_after>### 1.2.3.1 TBD

* Make `decodeUtf8With` fail explicitly for unsupported non-BMP
  replacement characters instead silent undefined behaviour (gh-213)

* Fix termination condition for file reads via `Data.Text.IO`
  operations (gh-223)

### 1.2.3.0

* Spec compliance: `toCaseFold` now follows the Unicode 9.0 spec
  (updated from 8.0).

* Bug fix: the lazy `takeWhileEnd` function violated the
  [lazy text invariant](https://github.com/bos/text/blob/1.2.3.0/Data/Text/Internal/Lazy.hs#L51)
  (gh-184).

* Bug fix: Fixed usage of size hints causing incorrect behavior (gh-197).

* New function: `unsnoc` (gh-173).

* Reduce memory overhead in `encodeUTF8` (gh-194).

* Improve UTF-8 decoder error-recovery (gh-182).

* Minor documentation improvements (`@since` annotations, more
  examples, clarifications).

{'fraction_non_alphanumeric': 0.127408328154133, 'fraction_numerical': 0.054070851460534496, 'mean_word_length': 4.176848874598071, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 6, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6017308', 'n_tokens_mistral': 589, 'n_tokens_neox': 527, 'n_words': 167}