<commit_before>## Newton
Version of JSON, with readability in mind.

It is based on YAML and is built using ANTLR with java bindings. Built upon the listener architecture.

## How to Use
First install ANTLR jar file.

	$ cd /usr/local/lib
	$ sudo curl -O http://www.antlr.org/download/antlr-4.5.3-complete.jar

Then, if your are on macOs or Linux , you can use ```sh automate.sh``` to run the build process. This will generate the ```lexer``` and ```parser``` from the specified grammar and then it will compile those classes into the gen folder, and use those classes to run the parser on the example file provided in the example folder.

An update is coming that will create gen folder , when ```automate.sh``` is run for the first time.

For windows , to install ANTLR

	Download http://antlr.org/download/antlr-4.5.3-complete.jar.
	Add antlr4-complete.jar to CLASSPATH, either:<commit_msg>desc update<commit_after>## Newton
Version of JSON, with readability in mind.

It is based on YAML and is built using ANTLR with java bindings. Built upon the listener architecture.

## How to Use
First install ANTLR.

	$ cd /usr/local/lib
	$ sudo curl -O http://www.antlr.org/download/antlr-4.5.3-complete.jar

Then, if your are on macOs or Linux , you can use ```sh automate.sh``` to run the build process. This will generate the ```lexer``` and ```parser``` from the specified grammar and then it will compile those classes into the gen folder, and use those classes to run the parser on the example file provided in the example folder.

An update is coming that will create gen folder , when ```automate.sh``` is run for the first time.

For windows , to install ANTLR

	Download http://antlr.org/download/antlr-4.5.3-complete.jar.
	Add antlr4-complete.jar to CLASSPATH, either:
{'fraction_non_alphanumeric': 0.09014084507042254, 'fraction_numerical': 0.007887323943661971, 'mean_word_length': 3.933333333333333, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4678954', 'n_tokens_mistral': 528, 'n_tokens_neox': 517, 'n_words': 252}