<commit_before>stata-reader-writer
======================

Program to read and write Stata files
<commit_msg>some changes to the documentation<commit_after>stata-reader-writer
======================

Program to read and write Stata files

What I am working on is a library that will let me read and write Stata files to and from SQLite files.
All the solutions I have seen usually use just CSV files for import and output. Unfortunately you lose a lot 
of the richness that is provided by a full Stata dataset.

Currently it is just reading R117, but I am working on R118/R119. 

Writing output files is not started yet, I will focus on SQLite first.
{'fraction_non_alphanumeric': 0.09538461538461539, 'fraction_numerical': 0.013846153846153847, 'mean_word_length': 4.564102564102564, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6212899', 'n_tokens_mistral': 176, 'n_tokens_neox': 160, 'n_words': 98}