<commit_before>TODO before merging

- [ ] fix tests
- [ ] fix linting errors
- [ ] fast-specific .gitignore
- [ ] YAML samples thingy
- [ ] stages README
- [ ] proper docstring on new tools
- [ ] modify github actions for different fast tfdoc usage
- [ ] add roadmap to top-level fast README<commit_msg>TODO list<commit_after>TODO before merging

- [ ] fix tests
- [ ] fix linting errors
- [ ] fast-specific .gitignore
- [ ] YAML samples thingy
- [ ] stages README
- [ ] proper docstring on new tools
- [ ] modify github actions for different fast tfdoc usage
- [ ] add roadmap to top-level fast README
- [ ] update modules references to local paths (ludo:0+2sec, julio:1, simo:2net+3)
{'fraction_non_alphanumeric': 0.10510948905109489, 'fraction_numerical': 0.0072992700729927005, 'mean_word_length': 3.4836601307189543, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '52388', 'n_tokens_mistral': 222, 'n_tokens_neox': 216, 'n_words': 77}