<commit_before>===
Toc
===<commit_msg>Document Toc transform<commit_after>===
Toc
===

.. list-table::

   * - Input

     - Output

   * - ``ref-toc-<filename>.yaml``

     - | ``source/includes/toc/table-<filename>.rst``
       | ``source/includes/toc/<filename>.rst``

   * - ``toc-<filename>.yaml``

     - | ``source/includes/toc/dfn-list-<filename>.rst``
       | ``source/includes/toc/<filename>.rst``

   * - ``ref-spec-<filename>.yaml``

     - ``source/includes/toc/table-spec-<filename>.rst``

   * - ``toc-spec-<filename>.yaml``

     - ``source/includes/toc/dfn-list-<filename>.rst``

YAML Format
-----------

Spec
~~~~

.. code-block:: yaml

   name: <string>
   file: <path>
   description: <string>
   ...

The ``name`` value should be a link to a relevant section within the given
``file``.

Non-Spec
~~~~~~~~

.. code-block:: yaml

   level: <int>
   source:
     file: <path>
     ref: <string>
   ...
{'fraction_non_alphanumeric': 0.23043478260869565, 'fraction_numerical': 0.0, 'mean_word_length': 2.449438202247191, 'pattern_counts': {'":': 0, '<': 19, '<?xml version=': 0, '>': 19, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '491022', 'n_tokens_mistral': 350, 'n_tokens_neox': 319, 'n_words': 55}