<commit_before># Flowfairy

This project aims to make it easier to create neural networks by magically creating the flow of data in the graph so you can focus more on creating the neural networks and less on how the data enters the graph. 

This is done by making it possible to specify what data should be collected and then doing all the boring stuff, rather than what and how the data should be sent through the graph.<commit_msg>Added some doc to readme<commit_after># Flowfairy

This project aims to make it easier to create neural networks by magically creating the flow of data in the graph so you can focus more on creating the neural networks and less on how the data enters the graph. 

This is done by making it possible to specify what data should be collected and then doing all the boring stuff, rather than what and how the data should be sent through the graph.

-------------------------------------------------------------------------------

To run the network, simply `cd` to a folder (or subfolder) that contains a `settings.py` for your network, and 
execute `fairy run`.

Some of the files, such as `stages.py` are asumed to be in the same folder as `settings.py` and are imported 
automatically.

See the examples to get a feel for how the framework is set up.
{'fraction_non_alphanumeric': 0.08885424785658613, 'fraction_numerical': 0.0, 'mean_word_length': 3.089171974522293, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7159851', 'n_tokens_mistral': 293, 'n_tokens_neox': 290, 'n_words': 212}