<commit_before>jabberwocky.txt:

.. literalinclude:: jabberwocky.txt
   :encoding: latin-1


jabberwocky with 4-space tabs:

.. literalinclude:: jabberwocky.txt
   :encoding: latin-1
   :tab-width: 4
<commit_msg>Better test case for Issue 254<commit_after>jabberwocky.txt:

.. literalinclude:: jabberwocky.txt
   :encoding: latin-1


jabberwocky with 4-space tabs:

.. include:: jabberwocky.txt
   :encoding: latin-1
   :tab-width: 4
   :literal:

{'fraction_non_alphanumeric': 0.11790393013100436, 'fraction_numerical': 0.024017467248908297, 'mean_word_length': 3.4563106796116503, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '926026', 'n_tokens_mistral': 203, 'n_tokens_neox': 178, 'n_words': 36}