<commit_before># CherokeeAffixSplitter
Utility to guess some affix splits on Cherokee texts. Developed to use with the Moses Machine Translation software.

Install Gradle 2.10 or better.

Clone the Simple UI project next to this project.

cd CherokeeAffixSplitter/CherokeeAffixSplitter
gradle clean build fatjar

the result should show up in build/libs/CherokeeAffixSplitter.jar<commit_msg>jitpack.io<commit_after># CherokeeAffixSplitter
Utility to guess some affix splits on Cherokee texts. Developed to use with the Moses Machine Translation software.

run:
```
gradle clean build fatjar
```

the result should show up as build/libs/CherokeeAffixSplitter.jar
{'fraction_non_alphanumeric': 0.045454545454545456, 'fraction_numerical': 0.004545454545454545, 'mean_word_length': 5.544554455445544, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6550127', 'n_tokens_mistral': 205, 'n_tokens_neox': 179, 'n_words': 78}