<commit_before># TODO

- Where the identity block doesn't align with the filename, sort it out, putting extra info into sil:identity
- Remove redundant empty collations elements
- Can we assume layout/characterOrder is left-to-right?
- If there is a digraph in main, should the sort order also have one?
- Give every file a localeNames/special/sil:name for english
- Fill out autonyms from Ethnologue
- remove all suspect data (if there is something better)
- fixup fontroles, causing ~20 validation failures

# Issues

- is the sil:identity/@defaultRegion really the defaultRegion?<commit_msg>More todo<commit_after># TODO

- Where the identity block doesn't align with the filename, sort it out, putting extra info into sil:identity
- Remove redundant empty collations elements
- Can we assume layout/characterOrder is left-to-right?
- If there is a digraph in main, should the sort order also have one?
- Give every file a localeNames/special/sil:name for english
- Fill out autonyms from Ethnologue
- remove all suspect data (if there is something better)
- fixup fontroles, causing ~20 validation failures
- create a test to ensure all collation elements are in an exemplar.

# Issues

- is the sil:identity/@defaultRegion really the defaultRegion?
{'fraction_non_alphanumeric': 0.05746209098164405, 'fraction_numerical': 0.0031923383878691143, 'mean_word_length': 4.524229074889868, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4279781', 'n_tokens_mistral': 337, 'n_tokens_neox': 322, 'n_words': 168}