<commit_before>A Note is an array of bytes/characters(hereafter abbreviated as chars).
This sequence of chars represents a hash table. There are two special
chars in Note which turn an otherwise unstructured linear sequence of
chars into a structured recursive hash table. Those two chars are:

Space char
Keyboard: Space Key
Binary: 00100000
Hex: 20
Decimal: 32

Newline char
Keyboard: Enter Key
Binary: 00001010
Hex: 0A
Decimal: 10

The higher level structures of Note are the two structures of a hash
table: keys and values.

A key is an array of any chars other than Space or Newline. A key is
terminated by a Space or Newline. A key terminated by a Space has a
value of type "array of chars" (string). A key terminated by a Newline
has a value of type Note. A key terminated by an End of File char has
a value of type Note, consisting of an empty Note.

A value is an array of chars (string). Values can contain any char, but
Newline chars must be escaped. To escape a newline char in a value, precede
the Newline char with a Newline char + N Space chars, where N is equal to the number of spaces preceding the key + 1. A value is terminated by an unescaped Newline char. A value can also be terminated by an End of File char.

This is the full spec of Note.<commit_msg>Line length of spec<commit_after>A Note is an array of bytes/characters(hereafter abbreviated as chars).
This sequence of chars represents a hash table. There are two special
chars in Note which turn an otherwise unstructured linear sequence of
chars into a structured recursive hash table. Those two chars are:

Space char
Keyboard: Space Key
Binary: 00100000
Hex: 20
Decimal: 32

Newline char
Keyboard: Enter Key
Binary: 00001010
Hex: 0A
Decimal: 10

The higher level structures of Note are the two structures of a hash
table: keys and values.

A key is an array of any chars other than Space or Newline. A key is
terminated by a Space or Newline. A key terminated by a Space has a
value of type "array of chars" (string). A key terminated by a Newline
has a value of type Note. A key terminated by an End of File char has
a value of type Note, consisting of an empty Note.

A value is an array of chars (string). Values can contain any char, but
Newline chars must be escaped. To escape a newline char in a value, precede
the Newline char with a Newline char + N Space chars, where N is equal to the
number of spaces preceding the key + 1. A value is terminated by an unescaped
Newline char. A value can also be terminated by an End of File char.

This is the full spec of Note.
{'fraction_non_alphanumeric': 0.033646322378716745, 'fraction_numerical': 0.018779342723004695, 'mean_word_length': 3.994140625, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7067934', 'n_tokens_mistral': 745, 'n_tokens_neox': 664, 'n_words': 464}