<commit_before>Searching in the data
=====================

.. list-table::
   :header-rows: 1

   * * Search for records
     * Query
     * Example (based on ods-api-monitoring dataset)
   * * containing a value
     * value
     * ``explore``

       returns every record containing the string explore
   * * containing a value in a specific field
     * id_field:value
     * ``action:explore``

       returns every record containing the string explore in the column named action
   * * containing several values
     * value1 AND value2
     * ``explore AND search``

       returns every record containing both explore and search
   * * containing at least one of the values
     * value1 OR value2
     * ``action OR explore``

       returns every record containing either explore or search
   * * not containing a value
     * NOT value
     * ``NOT anonymous``

       returns every record which does not contain the string anonymous
   * * containing an exact value in a field
     * #exact(id_field,"value")
     * ``#exact(user_id,"anonymous")``

       returns every record containing the exact string anonymous in the column named user_id
   * * if a field is empty
     * #null(id_field)
     * ``#null(referer)``

       returns every record which has no value in the column named referer
   * * containing a value that starts with the specified string, in the specified field
     * #startswith(id_field,string)

       .. note::
          ``#startswith`` queries are case sensitive.
     * ``#startswith(user_id,anon)``

       returns every record containing a value that starts with ``anon`` in the column named ``user_id``
   * * where a date's field is anterior to a value<commit_msg>Edited the docs for #startswith based on PR review<commit_after>Searching in the data
=====================

.. list-table::
   :header-rows: 1

   * * Search for records
     * Query
     * Example (based on ods-api-monitoring dataset)
   * * containing a value
     * value
     * ``explore``

       returns every record containing the string explore
   * * containing a value in a specific field
     * id_field:value
     * ``action:explore``

       returns every record containing the string explore in the column named action
   * * containing several values
     * value1 AND value2
     * ``explore AND search``

       returns every record containing both explore and search
   * * containing at least one of the values
     * value1 OR value2
     * ``action OR explore``

       returns every record containing either explore or search
   * * not containing a value
     * NOT value
     * ``NOT anonymous``

       returns every record which does not contain the string anonymous
   * * containing an exact value in a field
     * #exact(id_field,"value")
     * ``#exact(user_id,"anonymous")``

       returns every record containing the exact string anonymous in the column named user_id
   * * if a field is empty
     * #null(id_field)
     * ``#null(referer)``

       returns every record which has no value in the column named referer
   * * containing a value that starts with the specified string, in the specified field
     * #startswith(id_field,"string")
     * ``#startswith(user_id,"anon")``

       returns every record containing a value that starts with ``anon`` in the column named ``user_id``
   * * where a date's field is anterior to a value
{'fraction_non_alphanumeric': 0.0895125553914328, 'fraction_numerical': 0.0029542097488921715, 'mean_word_length': 2.8697142857142857, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1695371', 'n_tokens_mistral': 891, 'n_tokens_neox': 860, 'n_words': 383}