<commit_before>
This file adheres to the [Backus–Naur Form](https://en.wikipedia.org/wiki/Backus%E2%80%93Naur_Form) and [Extended Backus–Naur Form](https://en.wikipedia.org/wiki/Extended_Backus%E2%80%93Naur_Form). Angular braces are replaced with Curly Braces due to the issues with Markdown preview.



```

{eolc} ::= End of Line Character

{indent} ::= Two white spaces or a tab character. Depending on the first indent encountered in the input

{s} ::= A Space Character

{t} ::= A Tab Character

{ws} ::= ({s}*{t}*)*

{statement} ::= {indent}*{tag}{eolc}

{tag} ::= {tag-head}{ws}{tag-tail}

{tag-head} ::= {tag-name}|


```<commit_msg>Updated grammar.md<commit_after>
This file adheres to the [Backus–Naur Form](https://en.wikipedia.org/wiki/Backus%E2%80%93Naur_Form) and [Extended Backus–Naur Form](https://en.wikipedia.org/wiki/Extended_Backus%E2%80%93Naur_Form). Angular braces are replaced with Curly Braces due to the issues with Markdown preview.



```

{statement} ::= {indent}*{tag}{ws}{eolc}

{tag} ::= {tag-head}{ws}{tag-tail}[{scope}]

{tag-head} ::= {tag-name}[${tag-id}][(.{tag-class})+]

{tag-name} ::= {identifier}

{tag-id} ::= {identifier}

{tag-class} ::= {identifier}

{tag-tail} ::= ({tag-attribute}[="{tag-attribute-value}"])*[|{inline-text}]

{tag-attribute} ::= {identifier}

{tag-attribute-value} ::= Anything but "

{inline-text} ::= Anything but {eolc}

{identifier} ::= {alphanumeric}+[{alphanumeric}*[-*{alphanumeric}*]]

{alphanumeric} ::= ((A|B|...|Z)*(a|b|...|z)*(0|1|...|9)*)*

{eolc} ::= End of Line Character

{indent} ::= Two white spaces or a tab character. Depending on the first indent encountered in the input

{ws} ::= ({s}*{t}*)*

{s} ::= A Space Character

{t} ::= A Tab Character


```
{'fraction_non_alphanumeric': 0.21498559077809798, 'fraction_numerical': 0.013256484149855908, 'mean_word_length': 5.244604316546763, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5868053', 'n_tokens_mistral': 685, 'n_tokens_neox': 653, 'n_words': 150}