<commit_before># Neville JS

## Version 0.1.1

*** Very Much a Work in Progess ***
*** TESTING ***

### TODO:

 - [x] Remove Blanks
 - [x] Remove Invalid function
 - [x] Reomove Dups Functions
 - [x] Progress Bar
 - [x] Display Art
 - [x] Grab CSV file
 - [x] Record Class
 - [x] Style Icons
 - [x] Output to CSV File
 - [ ] Have output files go to an particular folder??
 - [x] Flags
 - [ ] Make NPM package
 - [x] Give simple global comand
 - [ ] Make Help Page<commit_msg>adjusting readme<commit_after># Neville JS

## Version 0.1.1

*** Very Much a Work in Progess ***
*** TESTING ***

### TODO:

 - [x] Remove Blanks
 - [x] Remove Invalid function
 - [x] Reomove Dups Functions
 - [x] Progress Bar
 - [x] Display Art
 - [x] Grab CSV file
 - [x] Record Class
 - [x] Style Icons
 - [x] Output to CSV File
 - [x] Flags
 - [x] Make NPM package
 - [x] Give simple global comand
 - [ ] Make Help Page
 - [ ] Work on Readme
 - [ ] Write tests
 
{'fraction_non_alphanumeric': 0.1454352441613588, 'fraction_numerical': 0.006369426751592357, 'mean_word_length': 2.6980392156862747, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2577198', 'n_tokens_mistral': 340, 'n_tokens_neox': 328, 'n_words': 130}