<commit_before>


### Future

- [ ] Dupe Replacement feature. (See issues #5)
- [ ] Add feature to load exclude-lists from files. Use build in rsync functionality for that. (See issues #4)

### v2.0

- [x] Complete rewrite of the code in a more *functional* style (no global state, more purity)
- [x] Add Type annotations via *typing* module.
- [x] Updated to Python3.6
- [x] Publish vhpi on PyPi. (package name: vhpi)
- [x] Add Creation Timestamp to each Snapshot directory.
- [x] Beautify log output.
- [x] Improve logging for subprocess output (more performant and less buggy). 
- [x] Change config dir to `~/.config/vhpi/`.
- [x] Remove log cfg file.
- [x] Generate default config file (`~/config/vhpi/vhpi_cfg.yaml`) on startup.
- [x] Provide a simple command line interface to run vhpi. (see `vhpi --help`)
- [x] Fix a bunch of bugs.
- [x] Improve test strategy.
- [x] Add Tutorial on how to install Python3.x from source. (see wiki)
- [x] Add Tutorial on how to share sources with the pi via NFS. (see wiki)
- [x] Use AGPL (license).

### v1.0
Initial release.
Version history starts here...<commit_msg>Adjust CHANGELOG<commit_after>


### Future

- [] Create webserver/interface to show log files and basic health status.
- [] Dupe Replacement feature. (See issues #5)
- [] Add feature to load exclude-lists from files. Use build in rsync functionality for that. (See issues #4)

### v2.0

- [x] Complete rewrite of the code in a more *functional* style (no global state, more purity)
- [x] Add Type annotations via *typing* module.
- [x] Updated to Python3.6
- [x] Publish vhpi on PyPi. (package name: vhpi)
- [x] Add Creation Timestamp to each Snapshot directory.
- [x] Beautify log output.
- [x] Improve logging for subprocess output (more performant and less buggy). 
- [x] Change config dir to `~/.config/vhpi/`.
- [x] Remove log cfg file.
- [x] Generate default config file (`~/config/vhpi/vhpi_cfg.yaml`) on startup.
- [x] Provide a simple command line interface to run vhpi. (see `vhpi --help`)
- [x] Fix a bunch of bugs.
- [x] Improve test strategy.
- [x] Add Tutorial on how to install Python3.x from source. (see wiki)
- [x] Add Tutorial on how to share sources with the pi via NFS. (see wiki)
- [x] Use AGPL (license).

### v1.0
Initial release.
Version history starts here...
{'fraction_non_alphanumeric': 0.12238675958188153, 'fraction_numerical': 0.0078397212543554, 'mean_word_length': 3.4775828460038984, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '559654', 'n_tokens_mistral': 770, 'n_tokens_neox': 739, 'n_words': 338}