<commit_before>.. _datasets:

===========================
Test Datasets
===========================

.. currentmodule:: skvideo.datasets

`skvideo.datasets` provides several test videos for benchmarking, testing, and example code.

Big Buck Bunny sequence
-----------------------

The full absolute path to bigbuckbunny comes bundled with the skvideo install and can be found using :func:`skvideo.datasets.bigbuckbunny`

TODO add video to doc

.. youtube:: uIH7mRUruoM
    :width: 640
    :height: 480


Carphone pristine and distorted sequences
-----------------------

The path to the carphone pristine and distorted sequences come bundled with the skvideo install and can be found using :func:`skvideo.datasets.fullreferencepair`

.. youtube:: BqjEcVduul0
    :width: 640
    :height: 480

.. youtube:: 8TUA4cMN41s
    :width: 640
    :height: 480

.. toctree::
    :hidden:<commit_msg>Fixed video layout<commit_after>.. _datasets:

===========================
Test Datasets
===========================

.. currentmodule:: skvideo.datasets

`skvideo.datasets` provides several test videos for benchmarking, testing, and example code.

Big Buck Bunny sequence
-----------------------

The full absolute path to bigbuckbunny comes bundled with the skvideo install and can be found using :func:`skvideo.datasets.bigbuckbunny`

.. youtube:: uIH7mRUruoM
    :width: 50%


Carphone pristine and distorted sequences
-----------------------

The path to the carphone pristine and distorted sequences come bundled with the skvideo install and can be found using :func:`skvideo.datasets.fullreferencepair`

Pristine:

.. youtube:: 8TUA4cMN41s
    :width: 50%

Distorted:

.. youtube:: BqjEcVduul0
    :width: 50%

.. toctree::
    :hidden:
{'fraction_non_alphanumeric': 0.18302540415704388, 'fraction_numerical': 0.020785219399538105, 'mean_word_length': 3.432225063938619, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2831601', 'n_tokens_mistral': 563, 'n_tokens_neox': 480, 'n_words': 172}