<commit_before><commit_msg>Add readme<commit_after>CSV Template
===

Process CSV files through a template in desired format

1) Open CSV file via File->Open
2) In the Mappings dialog rename any fields you want
3) Check the header box if necessary, and click OK
4) Write your template in the top box
5) Select all and any rows you need by holding down Ctrl key
6) Right-click the rows and select "Copy to clipboard"

Variables in the template are the mapped names prefixed with $.

<img src="http://i.imgur.com/IbrTsCK.png"> 
{'fraction_non_alphanumeric': 0.06679389312977099, 'fraction_numerical': 0.011450381679389313, 'mean_word_length': 4.46875, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1477567', 'n_tokens_mistral': 153, 'n_tokens_neox': 147, 'n_words': 80}