<commit_before><commit_msg>Add a README.txt to inform user to set new config files.<commit_after>How to set a user configuration file ?

1) Copy and paste a default YAML configuration file in the same folder.

2) Rename this new YAML file by replacing 'default' by your username.
In Matlab, type getenv('USERNAME') for windows machine or getenv('USER') for Mac, to get your username.


3) Then, change the default configuration without modifying fieldnames !

N.B.: YAML configuration files of user have to be in the same folder as default YAML configuration files !


{'fraction_non_alphanumeric': 0.058098591549295774, 'fraction_numerical': 0.00528169014084507, 'mean_word_length': 4.633663366336633, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5689858', 'n_tokens_mistral': 153, 'n_tokens_neox': 145, 'n_words': 84}