<commit_before>2012-10-12:
	CHANGED: submodule setup
		setup will now ask which submodules shall be installed, this will
		create a commit which must NOT be pushed back to the development
		repository as this will break existing installs for others
		UPDATE INSTRUCTIONS: please remove the libbvs, bvsd and the
		overlapping submodule directories so setup can properly add them as
		git submodules

2012-10-02:
	NEW: cmake->BVS_GCC_VISIBILITY
		uses gcc's visibility feature for dynamic library symbol exports (read
		cmake info)
	NEW: cmake->BVS_LOG_SYSTEM
		now the log system can be enabled in cmake, if disabled, the log
		system's backend won't even be compiled and the created logger
		instances will have no functionality

2012-10-01:
	NEW: cmake->BVS_THREAD_NAMES
		allows threads to set names (read cmake info)

2012-09-30:
	NEW: module pools
		allow to setup module pools, meaning that a number of modules are
		executed by one single thread
		WARNING: not yet thoroughly tested, but should work fine

2012-09-28:
	NEW: ./run --update function to update without loosing local changes
	CHANGED: config usage
		please read the Readme.txt:USAGE, to migrate to the new system, please<commit_msg>changelog: update last entry to contain update instructions<commit_after>2012-10-12:
	CHANGED: submodule setup
		setup will now ask which submodules shall be installed, this will
		create a commit which must NOT be pushed back to the development
		repository as this will break existing installs for others

2012-10-02:
	NEW: cmake->BVS_GCC_VISIBILITY
		uses gcc's visibility feature for dynamic library symbol exports (read
		cmake info)
	NEW: cmake->BVS_LOG_SYSTEM
		now the log system can be enabled in cmake, if disabled, the log
		system's backend won't even be compiled and the created logger
		instances will have no functionality

2012-10-01:
	NEW: cmake->BVS_THREAD_NAMES
		allows threads to set names (read cmake info)

2012-09-30:
	NEW: module pools
		allow to setup module pools, meaning that a number of modules are
		executed by one single thread
		WARNING: not yet thoroughly tested, but should work fine

2012-09-28:
	NEW: ./run --update function to update without loosing local changes
	CHANGED: config usage
		please read the Readme.txt:USAGE, to migrate to the new system, please
{'fraction_non_alphanumeric': 0.04654197477163984, 'fraction_numerical': 0.034797738147020446, 'mean_word_length': 4.2631578947368425, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 9, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '51447', 'n_tokens_mistral': 747, 'n_tokens_neox': 643, 'n_words': 321}