<commit_before>Noise
=====

Nested Object Inverted Search Engine

This is a native library meant to be linked into other projects and will
expose a C API.

It's a full text index and query system that understands the semi structured
nature of JSON, and will allow:

 * Stemmed word/fuzzy match
 * Case sensitive exact word and sentence match
 * Arbitrary boolean nesting
 * Greater than/less Than matching
 
[Query Langauge Reference here](https://github.com/pipedown/noise/blob/master/query_language_reference.md)


Installation
------------<commit_msg>Change 'langauge' to 'language' in README.md<commit_after>Noise
=====

Nested Object Inverted Search Engine

This is a native library meant to be linked into other projects and will
expose a C API.

It's a full text index and query system that understands the semi structured
nature of JSON, and will allow:

 * Stemmed word/fuzzy match
 * Case sensitive exact word and sentence match
 * Arbitrary boolean nesting
 * Greater than/less than matching
 
[Query Language Reference here](https://github.com/pipedown/noise/blob/master/query_language_reference.md)


Installation
------------
{'fraction_non_alphanumeric': 0.08165057067603161, 'fraction_numerical': 0.0, 'mean_word_length': 4.205479452054795, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '271438', 'n_tokens_mistral': 320, 'n_tokens_neox': 294, 'n_words': 135}