<commit_before>sjsu-298-experiment
===================

This code is required for an experiment at SJSU



    Copyright (C) 2014 <EMAIL>

<commit_msg>Updated the info about the project.<commit_after>sjsu-298-experiment
===================

This is an alpha code created for an experiment at San Jose State University. This is an extremely early version of the product, so please reach out to me if you see something that you like and I will make it presentable for forking.

Carry on!
-veestr



    Copyright (C) 2014 <EMAIL>


{'fraction_non_alphanumeric': 0.11720226843100189, 'fraction_numerical': 0.026465028355387523, 'mean_word_length': 4.247524752475248, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4566140', 'n_tokens_mistral': 162, 'n_tokens_neox': 141, 'n_words': 71}