<commit_before># mysql-variables-parser
A program to parse http://dev.mysql.com/doc/refman/X/en/server-system-variables.html output

This program was built to try to collect a definition of the MySQL
variables from the documentation at the URL above.  It would be nice if mysqld would
actually allow you to query this information dynamically but that is not currently possible.

Example of how to use:

```
$ sh sql_generator.sh 
```

More work is needed but this is a starting point.<commit_msg>Adjust README.md<commit_after># mysql-variables-parser
A program to parse http://dev.mysql.com/doc/refman/X/en/server-system-variables.html output

This program was built to try to collect a definition of the MySQL
variables from the documentation at the URL above.  It would be nice if mysqld would
actually allow you to query this information dynamically but that is not currently possible.

Example of how to use:

```
$ sh sql_generator.sh 
```

This will generate the sysvarXX.sql files for MySQL versions 5.0 to 5.7.

More work is needed but this is a starting point.
{'fraction_non_alphanumeric': 0.0626753975678204, 'fraction_numerical': 0.0037418147801683817, 'mean_word_length': 4.194174757281553, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1101487', 'n_tokens_mistral': 300, 'n_tokens_neox': 284, 'n_words': 146}