<commit_before>numerals
========

Number representation as text.

This will be a successor gem to Nio.

Roadmap:
1. Port tests and code from Nio
2. Refactor foundation classes (RepDec, NeutralNum, etc.) using Flt
3. Refactor to replace RepDec, NeutralNum by Numeral
4. Design new API<commit_msg>Fix markdown formatting<commit_after>numerals
========

Number representation as text.

This will be a successor gem to Nio.

Roadmap:

1. Port tests and code from Nio
2. Refactor foundation classes (RepDec, NeutralNum, etc.) using Flt
3. Refactor to replace RepDec, NeutralNum by Numeral
4. Design new API
{'fraction_non_alphanumeric': 0.07986688851913477, 'fraction_numerical': 0.013311148086522463, 'mean_word_length': 4.574074074074074, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1474880', 'n_tokens_mistral': 192, 'n_tokens_neox': 180, 'n_words': 85}