<commit_before>#telegramAnalysis
Made for dealing with the output of https://github.com/tvdstaaij/telegram-history-dump

Common usage:

`./getalltextfromuser.py json/chat_name.jsonl username_without_at_sign | ./mostcommonphrases.py | less`

Gives an output like: ![example of most common phrases output](/examples/phrases.jpg?raw=true)

`./phraseovertime.py chat_name.jsonl phrase`

Gives an output of a graph (made by using matplotlib)<commit_msg>update readme.md again because markdown is hard<commit_after>#telegramAnalysis
Made for dealing with the output of https://github.com/tvdstaaij/telegram-history-dump

Common usage:

`./getalltextfromuser.py json/chat_name.jsonl username_without_at_sign | ./mostcommonphrases.py | less`

Gives an output like:
![example of most common phrases output](/examples/phrases.jpg?raw=true)

`./phraseovertime.py chat_name.jsonl phrase`

Gives an output of a graph (made by using matplotlib)
{'fraction_non_alphanumeric': 0.0956989247311828, 'fraction_numerical': 0.0, 'mean_word_length': 5.556338028169014, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6448952', 'n_tokens_mistral': 303, 'n_tokens_neox': 296, 'n_words': 83}