<commit_before>CSS classes reference
=====================

This is a full list of available classes corresponding to languages'
syntactic structures. The parentheses after language name contain identifiers
used as class names in ``<code>`` element.

Python ("python", "py", "gyp")
------------------------------

* ``keyword``:          keyword
* ``built_in``:         built-in objects (None, False, True and Ellipsis)
* ``number``:           number
* ``string``:           string (of any type)
* ``comment``:          comment
* ``decorator``:        @-decorator for functions
* ``function``:         function header "def some_name(...):"
* ``class``:            class header "class SomeName(...):"
* ``title``:            name of a function or a class inside a header
* ``params``:           everything inside parentheses in a function's or class' header

Python profiler results ("profile")
-----------------------------------

* ``number``:           number
* ``string``:           string
* ``built_in``:         built-in function entry
* ``filename``:         filename in an entry
* ``summary``:          profiling summary
* ``header``:           header of table of results
* ``keyword``:          column header
* ``function``:         function name in an entry (including parentheses)
* ``title``:            actual name of a function in an entry (excluding parentheses)
* ``prompt``:           interpreter prompt (>>> or ...)

Ruby ("ruby", "rb", "gemspec", "podspec", "thor", "irb")
--------------------------------------------------------

* ``keyword``:          keyword
* ``string``:           string
* ``subst``:            in-string substitution (#{...})
* ``comment``:          comment
* ``yardoctag``:        YARD tag
* ``function``:         function header "def some_name(...):"
* ``class``:            class header "class SomeName(...):"
* ``title``:            name of a function or a class inside a header
* ``parent``:           name of a parent class
* ``symbol``:           symbol
* ``input``:            complete input line (interpreter)
* ``output``:           complete output line  (interpreter)
* ``prompt``:           interpreter prompt (>>)
* ``status``:           interpreter response (=>)

Haml ("haml")
-------------

* ``tag``:              any tag starting with "%"
* ``title``:            tag's name
* ``attribute``:        tag's attribute
* ``keyword``:          tag's attribute that is a keyword
* ``string``:           attribute's value that is a string
* ``value``:            attribute's value, shorthand id or class for tag
* ``comment``:          comment
* ``doctype``:          !!! declaration
* ``bullet``:           line defined by variable

Perl ("perl", "pl")
-------------------

* ``keyword``:          keyword
* ``comment``:          comment
* ``number``:           number
* ``string``:           string
* ``regexp``:           regular expression
* ``sub``:              subroutine header (from "sub" till "{")
* ``variable``:         variable starting with "$", "%", "@"
* ``operator``:         operator
* ``pod``:              plain old doc

PHP ("php", "php3", "php4", "php5", "php6")
-------------------------------------------

* ``keyword``:          keyword
* ``number``:           number
* ``string``:           string (of any type)
* ``comment``:          comment
* ``phpdoc``:           phpdoc params in comments
* ``variable``:         variable starting with "$"
* ``preprocessor``:     preprocessor marks: "<?php" and "?>"

Scala ("scala")
---------------

* ``keyword``:          keyword
* ``number``:           number
* ``string``:           string
* ``comment``:          comment
* ``annotation``:       annotation
* ``javadoc``:          javadoc comment
* ``javadoctag``:       @-tag in javadoc
* ``class``:            class header
* ``title``:            class name inside a header
* ``params``:           everything in parentheses inside a class header
* ``inheritance``:      keywords "extends" and "with" inside class header

Groovy ("groovy)
----------------

* ``keyword``:          keyword
* ``number``:           number
* ``string``:           string, map string keys and named argument labels
* ``regex``:            regular expression
* ``comment``:          comment
* ``annotation``:       annotation
* ``javadoc``:          javadoc comment
* ``javadoctag``:       @-tag in javadoc
* ``class``:            class header
* ``title``:            class name inside a header
* ``label``:            label
* ``shebang``:          Groovy shell script header

Go ("go", "golang")
-------------------

* ``comment``:          comment
* ``string``:           string constant
* ``number``:           number
* ``keyword``:          language keywords
* ``constant``:         true false nil iota
* ``typename``:         built-in plain types (int, string etc.)
* ``built_in``:         built-in functions

Gradle ("gradle")
-----------------

* ``keyword``:          keyword
* ``number``:           number
* ``string``:           string and character
* ``comment``:          comment
* ``regexp``:           regular expression


HTML, XML ("xml", "html", "xhtml", "rss", "atom", "xsl", "plist")
-----------------------------------------------------------------

* ``tag``:              any tag from "<" till ">"
* ``attribute``:        tag's attribute with or without value
* ``value``:            attribute's value
* ``comment``:          comment
* ``pi``:               processing instruction (<? ... ?>)
* ``doctype``:          <!DOCTYPE ... > declaration
* ``cdata``:            CDATA section

Lasso ("lasso", "ls", "lassoscript")
------------------------------------

* ``preprocessor``:     delimiters and interpreter flags
* ``shebang``:          Lasso 9 shell script header
* ``comment``:          single- or multi-line comment
* ``javadoc``:          doc comment
* ``keyword``:          keyword
* ``literal``:          keyword representing a value
* ``built_in``:         built-in types and variables
* ``number``:           number
* ``string``:           string
* ``variable``:         variable reference starting with "#" or "$"
* ``tag``:              tag literal
* ``attribute``:        named or rest parameter in method signature
* ``subst``:            unary/binary/ternary operator symbols
* ``class``:            type, trait, or method header
* ``title``:            name following "define" inside a header

CSS ("css")
-----------

* ``tag``:              tag in selectors
* ``id``:               #some_name in selectors
* ``class``:            .some_name in selectors
* ``at_rule``:          @-rule till first "{" or ";"
* ``attr_selector``:    attribute selector (square brackets in a[href^=http://])
* ``pseudo``:           pseudo classes and elements (:after, ::after etc.)
* ``comment``:          comment
* ``rules``:            everything from "{" till "}"
* ``attribute``:        property name inside a rule
* ``value``:            property value inside a rule, from ":" till ";" or till the end of rule block
* ``number``:           number within a value
* ``string``:           string within a value
* ``hexcolor``:         hex color (#FFFFFF) within a value
* ``function``:         CSS function within a value
* ``important``:        "!important" symbol

SCSS ("scss")
-------------

* ``tag``:              tag in selectors
* ``id``:               #some_name in selectors
* ``class``:            .some_name in selectors
* ``at_rule``:          @-rule till first "{" or ";"
* ``attr_selector``:    attribute selector (square brackets in a[href^=http://])
* ``pseudo``:           pseudo classes and elements (:after, ::after etc.)
* ``comment``:          comment
* ``rules``:            everything from "{" till "}"
* ``attribute``:        property name inside a rule
* ``value``:            property value inside a rule, from ":" till ";" or till the end of rule block
* ``number``:           number within a value
* ``string``:           string within a value
* ``hexcolor``:         hex color (#FFFFFF) within a value
* ``function``:         CSS function within a value
* ``important``:        "!important" symbol
* ``variable``:         variable starting with "$"
* ``preprocessor``:     keywords after @

Less ("less")
-------------

* ``comment``:          comment
* ``number``:           number
* ``string``:           string
* ``attribute``:        property name
* ``variable``:         @var, @@var or @{var}
* ``keyword``:          Less keywords (when, extend etc.)
* ``function``:         Less and CSS functions (rgba, unit etc.)
* ``tag``:              tag
* ``id``:               #id
* ``class``:            .class
* ``at_rule``:          at-rule keyword (@media, @keyframes etc.)
* ``attr_selector``:    attribute selector (e.g. [href^=http://])
* ``pseudo``:           pseudo classes and elements (:hover, ::before etc.)
* ``hexcolor``:         hex color (#FFF)
* ``built_in``:         inline javascript (or whatever host language) string

Stylus ("stylus", "styl")
-------------

* ``at_rule``:          @-rule till first "{" or ";"
* ``attribute``:        property name inside a rule
* ``class``:            .some_name in selectors
* ``comment``:          comment
* ``function``:         Stylus function
* ``hexcolor``:         hex color (#FFFFFF) within a value
* ``id``:               #some_name in selectors
* ``number``:           number within a value
* ``pseudo``:           pseudo classes and elements (:after, ::after etc.)
* ``string``:           string within a value
* ``tag``:              tag in selectors
* ``variable``:         variable starting with "$"

Markdown ("markdown", "md", "mkdown", "mkd")
--------------------------------------------

* ``header``:            header
* ``bullet``:            list bullet
* ``emphasis``:          emphasis
* ``strong``:            strong emphasis
* ``blockquote``:        blockquote
* ``code``:              code
* ``horizontal_rule``:   horizontal rule
* ``link_label``:        link label
* ``link_url``:          link url
* ``link_reference``:    link reference

AsciiDoc ("asciidoc")
---------------------

* ``header``:            heading
* ``bullet``:            list or labeled bullet
* ``emphasis``:          emphasis
* ``strong``:            strong emphasis
* ``blockquote``:        blockquote
* ``code``:              inline or block code
* ``horizontal_rule``:   horizontal rule
* ``link_label``:        link or image label
* ``link_url``:          link or image url
* ``comment``:           comment
* ``attribute``:         document attribute, block attributes
* ``label``:             admonition label

Django ("django", "jinja")
--------------------------

* ``keyword``:          HTML tag in HTML, default tags and default filters in templates
* ``tag``:              any tag from "<" till ">"
* ``comment``:          comment
* ``doctype``:          <!DOCTYPE ... > declaration
* ``attribute``:        tag's attribute with or without value
* ``value``:            attribute's value
* ``template_tag``:     template tag {% .. %}
* ``variable``:         template variable {{ .. }}
* ``template_comment``: template comment, both {# .. #} and {% comment %}
* ``filter``:           filter from "|" till the next filter or the end of tag
* ``argument``:         filter argument

Handlebars ("handlebars", "hbs", "html.hbs", "html.handlebars")
---------------------------------------------------------------

* ``expression``:       expression to be evaluated
* ``variable``:         variable
* ``begin-block``:      the beginning of a block
* ``end-block``:        the ending of a block
* ``string``:           string

Dust ("dust", "dst")
--------------------

* ``expression``:       expression to be evaluated
* ``variable``:         variable
* ``begin-block``:      the beginning of a block
* ``end-block``:        the ending of a block
* ``string``:           string

JSON ("json")
-------------

* ``number``:           number
* ``literal``:          "true", "false" and "null"
* ``string``:           string value
* ``attribute``:        name of an object property
* ``value``:            value of an object property

Mathematica ("mathematica", "mma")
----------------------------------

* ``keyword``:          keyword
* ``number``:           number
* ``comment``:          comment
* ``string``:           string
* ``list``:             a list { .. } - the basic Mma structure

JavaScript ("javascript", "js")
-------------------------------

* ``keyword``:          keyword
* ``comment``:          comment
* ``number``:           number
* ``literal``:          special literal: "true", "false" and "null"
* ``string``:           string
* ``regexp``:           regular expression
* ``function``:         header of a function
* ``title``:            name of a function inside a header
* ``params``:           parentheses and everything inside them in a function's header
* ``pi``:               'use strict' processing instruction

TypeScript ("typescript", "ts")
-------------------------------

* ``keyword``:          keyword
* ``comment``:          comment
* ``number``:           number
* ``literal``:          special literal: "true", "false" and "null"
* ``string``:           string
* ``regexp``:           regular expression
* ``function``:         header of a function
* ``title``:            name of a function inside a header
* ``params``:           parentheses and everything inside them in a function's header
* ``pi``:               'use strict' processing instruction

CoffeeScript ("coffeescript", "coffee", "cson", "iced")
-------------------------------------------------------

* ``keyword``:          keyword
* ``comment``:          comment
* ``number``:           number
* ``literal``:          special literal: "true", "false" and "null"
* ``built_in``:         built-in objects and functions ("window", "console", "require", etc...)
* ``string``:           string
* ``subst``:            #{ ... } interpolation in double-quoted strings
* ``regexp``:           regular expression
* ``function``:         header of a function
* ``class``:            header of a class
* ``title``:            name of a function variable inside a header
* ``params``:           parentheses and everything inside them in a function's header
* ``property``:         @-property within class and functions

Dart ("dart")
--------------------

* ``keyword``:          keyword
* ``literal``:          keyword that can be uses as identifier but have special meaning in some cases
* ``built_in``:         some of basic built in classes and function
* ``number``:           number
* ``string``:           string
* ``subst``:            in-string substitution (${...})
* ``comment``:          commment
* ``annotaion``:        annotation<commit_msg>Fix small typo<commit_after>CSS classes reference
=====================

This is a full list of available classes corresponding to languages'
syntactic structures. The parentheses after language name contain identifiers
used as class names in ``<code>`` element.

Python ("python", "py", "gyp")
------------------------------

* ``keyword``:          keyword
* ``built_in``:         built-in objects (None, False, True and Ellipsis)
* ``number``:           number
* ``string``:           string (of any type)
* ``comment``:          comment
* ``decorator``:        @-decorator for functions
* ``function``:         function header "def some_name(...):"
* ``class``:            class header "class SomeName(...):"
* ``title``:            name of a function or a class inside a header
* ``params``:           everything inside parentheses in a function's or class' header

Python profiler results ("profile")
-----------------------------------

* ``number``:           number
* ``string``:           string
* ``built_in``:         built-in function entry
* ``filename``:         filename in an entry
* ``summary``:          profiling summary
* ``header``:           header of table of results
* ``keyword``:          column header
* ``function``:         function name in an entry (including parentheses)
* ``title``:            actual name of a function in an entry (excluding parentheses)
* ``prompt``:           interpreter prompt (>>> or ...)

Ruby ("ruby", "rb", "gemspec", "podspec", "thor", "irb")
--------------------------------------------------------

* ``keyword``:          keyword
* ``string``:           string
* ``subst``:            in-string substitution (#{...})
* ``comment``:          comment
* ``yardoctag``:        YARD tag
* ``function``:         function header "def some_name(...):"
* ``class``:            class header "class SomeName(...):"
* ``title``:            name of a function or a class inside a header
* ``parent``:           name of a parent class
* ``symbol``:           symbol
* ``input``:            complete input line (interpreter)
* ``output``:           complete output line  (interpreter)
* ``prompt``:           interpreter prompt (>>)
* ``status``:           interpreter response (=>)

Haml ("haml")
-------------

* ``tag``:              any tag starting with "%"
* ``title``:            tag's name
* ``attribute``:        tag's attribute
* ``keyword``:          tag's attribute that is a keyword
* ``string``:           attribute's value that is a string
* ``value``:            attribute's value, shorthand id or class for tag
* ``comment``:          comment
* ``doctype``:          !!! declaration
* ``bullet``:           line defined by variable

Perl ("perl", "pl")
-------------------

* ``keyword``:          keyword
* ``comment``:          comment
* ``number``:           number
* ``string``:           string
* ``regexp``:           regular expression
* ``sub``:              subroutine header (from "sub" till "{")
* ``variable``:         variable starting with "$", "%", "@"
* ``operator``:         operator
* ``pod``:              plain old doc

PHP ("php", "php3", "php4", "php5", "php6")
-------------------------------------------

* ``keyword``:          keyword
* ``number``:           number
* ``string``:           string (of any type)
* ``comment``:          comment
* ``phpdoc``:           phpdoc params in comments
* ``variable``:         variable starting with "$"
* ``preprocessor``:     preprocessor marks: "<?php" and "?>"

Scala ("scala")
---------------

* ``keyword``:          keyword
* ``number``:           number
* ``string``:           string
* ``comment``:          comment
* ``annotation``:       annotation
* ``javadoc``:          javadoc comment
* ``javadoctag``:       @-tag in javadoc
* ``class``:            class header
* ``title``:            class name inside a header
* ``params``:           everything in parentheses inside a class header
* ``inheritance``:      keywords "extends" and "with" inside class header

Groovy ("groovy)
----------------

* ``keyword``:          keyword
* ``number``:           number
* ``string``:           string, map string keys and named argument labels
* ``regex``:            regular expression
* ``comment``:          comment
* ``annotation``:       annotation
* ``javadoc``:          javadoc comment
* ``javadoctag``:       @-tag in javadoc
* ``class``:            class header
* ``title``:            class name inside a header
* ``label``:            label
* ``shebang``:          Groovy shell script header

Go ("go", "golang")
-------------------

* ``comment``:          comment
* ``string``:           string constant
* ``number``:           number
* ``keyword``:          language keywords
* ``constant``:         true false nil iota
* ``typename``:         built-in plain types (int, string etc.)
* ``built_in``:         built-in functions

Gradle ("gradle")
-----------------

* ``keyword``:          keyword
* ``number``:           number
* ``string``:           string and character
* ``comment``:          comment
* ``regexp``:           regular expression


HTML, XML ("xml", "html", "xhtml", "rss", "atom", "xsl", "plist")
-----------------------------------------------------------------

* ``tag``:              any tag from "<" till ">"
* ``attribute``:        tag's attribute with or without value
* ``value``:            attribute's value
* ``comment``:          comment
* ``pi``:               processing instruction (<? ... ?>)
* ``doctype``:          <!DOCTYPE ... > declaration
* ``cdata``:            CDATA section

Lasso ("lasso", "ls", "lassoscript")
------------------------------------

* ``preprocessor``:     delimiters and interpreter flags
* ``shebang``:          Lasso 9 shell script header
* ``comment``:          single- or multi-line comment
* ``javadoc``:          doc comment
* ``keyword``:          keyword
* ``literal``:          keyword representing a value
* ``built_in``:         built-in types and variables
* ``number``:           number
* ``string``:           string
* ``variable``:         variable reference starting with "#" or "$"
* ``tag``:              tag literal
* ``attribute``:        named or rest parameter in method signature
* ``subst``:            unary/binary/ternary operator symbols
* ``class``:            type, trait, or method header
* ``title``:            name following "define" inside a header

CSS ("css")
-----------

* ``tag``:              tag in selectors
* ``id``:               #some_name in selectors
* ``class``:            .some_name in selectors
* ``at_rule``:          @-rule till first "{" or ";"
* ``attr_selector``:    attribute selector (square brackets in a[href^=http://])
* ``pseudo``:           pseudo classes and elements (:after, ::after etc.)
* ``comment``:          comment
* ``rules``:            everything from "{" till "}"
* ``attribute``:        property name inside a rule
* ``value``:            property value inside a rule, from ":" till ";" or till the end of rule block
* ``number``:           number within a value
* ``string``:           string within a value
* ``hexcolor``:         hex color (#FFFFFF) within a value
* ``function``:         CSS function within a value
* ``important``:        "!important" symbol

SCSS ("scss")
-------------

* ``tag``:              tag in selectors
* ``id``:               #some_name in selectors
* ``class``:            .some_name in selectors
* ``at_rule``:          @-rule till first "{" or ";"
* ``attr_selector``:    attribute selector (square brackets in a[href^=http://])
* ``pseudo``:           pseudo classes and elements (:after, ::after etc.)
* ``comment``:          comment
* ``rules``:            everything from "{" till "}"
* ``attribute``:        property name inside a rule
* ``value``:            property value inside a rule, from ":" till ";" or till the end of rule block
* ``number``:           number within a value
* ``string``:           string within a value
* ``hexcolor``:         hex color (#FFFFFF) within a value
* ``function``:         CSS function within a value
* ``important``:        "!important" symbol
* ``variable``:         variable starting with "$"
* ``preprocessor``:     keywords after @

Less ("less")
-------------

* ``comment``:          comment
* ``number``:           number
* ``string``:           string
* ``attribute``:        property name
* ``variable``:         @var, @@var or @{var}
* ``keyword``:          Less keywords (when, extend etc.)
* ``function``:         Less and CSS functions (rgba, unit etc.)
* ``tag``:              tag
* ``id``:               #id
* ``class``:            .class
* ``at_rule``:          at-rule keyword (@media, @keyframes etc.)
* ``attr_selector``:    attribute selector (e.g. [href^=http://])
* ``pseudo``:           pseudo classes and elements (:hover, ::before etc.)
* ``hexcolor``:         hex color (#FFF)
* ``built_in``:         inline javascript (or whatever host language) string

Stylus ("stylus", "styl")
-------------

* ``at_rule``:          @-rule till first "{" or ";"
* ``attribute``:        property name inside a rule
* ``class``:            .some_name in selectors
* ``comment``:          comment
* ``function``:         Stylus function
* ``hexcolor``:         hex color (#FFFFFF) within a value
* ``id``:               #some_name in selectors
* ``number``:           number within a value
* ``pseudo``:           pseudo classes and elements (:after, ::after etc.)
* ``string``:           string within a value
* ``tag``:              tag in selectors
* ``variable``:         variable starting with "$"

Markdown ("markdown", "md", "mkdown", "mkd")
--------------------------------------------

* ``header``:            header
* ``bullet``:            list bullet
* ``emphasis``:          emphasis
* ``strong``:            strong emphasis
* ``blockquote``:        blockquote
* ``code``:              code
* ``horizontal_rule``:   horizontal rule
* ``link_label``:        link label
* ``link_url``:          link url
* ``link_reference``:    link reference

AsciiDoc ("asciidoc")
---------------------

* ``header``:            heading
* ``bullet``:            list or labeled bullet
* ``emphasis``:          emphasis
* ``strong``:            strong emphasis
* ``blockquote``:        blockquote
* ``code``:              inline or block code
* ``horizontal_rule``:   horizontal rule
* ``link_label``:        link or image label
* ``link_url``:          link or image url
* ``comment``:           comment
* ``attribute``:         document attribute, block attributes
* ``label``:             admonition label

Django ("django", "jinja")
--------------------------

* ``keyword``:          HTML tag in HTML, default tags and default filters in templates
* ``tag``:              any tag from "<" till ">"
* ``comment``:          comment
* ``doctype``:          <!DOCTYPE ... > declaration
* ``attribute``:        tag's attribute with or without value
* ``value``:            attribute's value
* ``template_tag``:     template tag {% .. %}
* ``variable``:         template variable {{ .. }}
* ``template_comment``: template comment, both {# .. #} and {% comment %}
* ``filter``:           filter from "|" till the next filter or the end of tag
* ``argument``:         filter argument

Handlebars ("handlebars", "hbs", "html.hbs", "html.handlebars")
---------------------------------------------------------------

* ``expression``:       expression to be evaluated
* ``variable``:         variable
* ``begin-block``:      the beginning of a block
* ``end-block``:        the ending of a block
* ``string``:           string

Dust ("dust", "dst")
--------------------

* ``expression``:       expression to be evaluated
* ``variable``:         variable
* ``begin-block``:      the beginning of a block
* ``end-block``:        the ending of a block
* ``string``:           string

JSON ("json")
-------------

* ``number``:           number
* ``literal``:          "true", "false" and "null"
* ``string``:           string value
* ``attribute``:        name of an object property
* ``value``:            value of an object property

Mathematica ("mathematica", "mma")
----------------------------------

* ``keyword``:          keyword
* ``number``:           number
* ``comment``:          comment
* ``string``:           string
* ``list``:             a list { .. } - the basic Mma structure

JavaScript ("javascript", "js")
-------------------------------

* ``keyword``:          keyword
* ``comment``:          comment
* ``number``:           number
* ``literal``:          special literal: "true", "false" and "null"
* ``string``:           string
* ``regexp``:           regular expression
* ``function``:         header of a function
* ``title``:            name of a function inside a header
* ``params``:           parentheses and everything inside them in a function's header
* ``pi``:               'use strict' processing instruction

TypeScript ("typescript", "ts")
-------------------------------

* ``keyword``:          keyword
* ``comment``:          comment
* ``number``:           number
* ``literal``:          special literal: "true", "false" and "null"
* ``string``:           string
* ``regexp``:           regular expression
* ``function``:         header of a function
* ``title``:            name of a function inside a header
* ``params``:           parentheses and everything inside them in a function's header
* ``pi``:               'use strict' processing instruction

CoffeeScript ("coffeescript", "coffee", "cson", "iced")
-------------------------------------------------------

* ``keyword``:          keyword
* ``comment``:          comment
* ``number``:           number
* ``literal``:          special literal: "true", "false" and "null"
* ``built_in``:         built-in objects and functions ("window", "console", "require", etc...)
* ``string``:           string
* ``subst``:            #{ ... } interpolation in double-quoted strings
* ``regexp``:           regular expression
* ``function``:         header of a function
* ``class``:            header of a class
* ``title``:            name of a function variable inside a header
* ``params``:           parentheses and everything inside them in a function's header
* ``property``:         @-property within class and functions

Dart ("dart")
--------------------

* ``keyword``:          keyword
* ``literal``:          keyword that can be uses as identifier but have special meaning in some cases
* ``built_in``:         some of basic built in classes and function
* ``number``:           number
* ``string``:           string
* ``subst``:            in-string substitution (${...})
* ``comment``:          commment
* ``annotation``:       annotation
{'fraction_non_alphanumeric': 0.21040116851795237, 'fraction_numerical': 0.000339685451272122, 'mean_word_length': 1.9056454796683775, 'pattern_counts': {'":': 4, '<': 17, '<?xml version=': 0, '>': 29, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 2}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6621004', 'n_tokens_mistral': 7782, 'n_tokens_neox': 7573, 'n_words': 2593}