<commit_before>RandomIntFile
=============

Small utility to generate a file with randomly generated integers
<commit_msg>updated docco<commit_after>RandomIntFile
=============

Small utility to generate a file with randomly generated integers.


Usage
-----

You can run this utility in 2 ways:

* Via maven
* Using the "executable" jara (`java -jar`)


Running it via java -jar
------------------------

`java -jar random-int-file.jar OutputFile.txt [number of integers [min] [max]]`

* if `number of integers` is not specified, then it is assumed to be 1,000,000 (1 mil)
* if `min` and `max` are not specified (they need to be specified together) the following values are assumed:
** `min` = 0
** `max` = `Integer.MAX_INT`


Running it via maven
--------------------

`mvn exec:java`

This assumes the 3 parameters above to have the following values:

* `min` = 0
* `max` = `Integer.MAX_INT`
* `number of integers` = 1,0000,000
* `output file` = `random.txt`


{'fraction_non_alphanumeric': 0.16926272066458983, 'fraction_numerical': 0.020768431983385256, 'mean_word_length': 3.4220183486238533, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3152615', 'n_tokens_mistral': 312, 'n_tokens_neox': 283, 'n_words': 120}