<commit_before>1. Arabic numerals.

   a) lower alpha

      (i) lower roman

          A. upper alpha.

             I) upper roman

2. Lists that don't start at 1:

   3. Three

   4. Four

   C. C

   D. D

   iii. iii

   iv. iv

#. List items may also be auto-enumerated.

#. An item with more than one paragraph

   The second paragraph
<commit_msg>Added test for issue 67<commit_after>1. Arabic numerals.

   a) lower alpha

      (i) lower roman

          A. upper alpha.

             I) upper roman

2. Lists that don't start at 1:

   3. Three

   4. Four

   C. C

   D. D

   iii. iii

   iv. iv

#. List items may also be auto-enumerated.

#. An item with more than one paragraph

   The second paragraph


#. And now a list item with lots of text in more than one paragraph:
   Lorem  ipsum dolor  sit  amet, consectetur
   adipisicing  elit,  sed  do  eiusmod  tempor
   incididunt ut labore et dolore magna aliqua.
   Ut  enim  ad   minim  veniam,  quis  nostrud
   exercitation ullamco laboris nisi ut aliquip
   ex ea commodo consequat.

   Duis aute irure dolor in reprehenderit in
   voluptate  velit  esse  cillum dolore  eu
   fugiat  nulla  pariatur.  Excepteur  sint
   occaecat cupidatat  non proident, sunt in
   culpa qui officia deserunt mollit anim id
   est laborum."

{'fraction_non_alphanumeric': 0.04923076923076923, 'fraction_numerical': 0.009230769230769232, 'mean_word_length': 2.061176470588235, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 3, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5404614', 'n_tokens_mistral': 489, 'n_tokens_neox': 445, 'n_words': 187}