region:us
---
pretty_name: Evaluation run of 3050
dataset_summary: "Dataset automatically created during the evaluation run of model\
  \ [3050](https://huggingface.co/3050) on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).\n\
  \nThe dataset is composed of 406 configuration, each one coresponding to one of\
  \ the evaluated task.\n\nThe dataset has been created from 116 run(s). Each run\
  \ can be found as a specific split in each configuration, the split being named\
  \ using the timestamp of the run.The \"train\" split is always pointing to the latest\
  \ results.\n\nAn additional configuration \"results\" store all the aggregated results\
  \ of the run (and is used to compute and display the agregated metrics on the [Open\
  \ LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).\n\
  \nTo load the details from a run, you can for instance do the following:\n```python\n\
  from datasets import load_dataset\ndata = load_dataset(\"HuggingFaceBR4/thomwolf-small-llama\"\
  ,\n\t\"harness_winogrande_0_small_llama_1p82G_the_pile_eval_3050_parquet\",\n\t\
  split=\"train\")\n```\n\n## Latest results\n\nThese are the [latest results from\
  \ run ](https://huggingface.co/datasets/HuggingFaceBR4/thomwolf-small-llama/blob/main/0/results_small-llama-1p82G-the-pile_eval.json)(note\
  \ that their might be results for other tasks in the repos if successive evals didn't\
  \ cover the same tasks. You find each in the results and the \"latest\" split for\
  \ each eval):\n\n```python\n{\n    \"all\": {\n        \"acc\": 0.3484644210447005,\n\
  \        \"acc_stderr\": 0.011027112856079687,\n        \"acc_norm\": 0.31556595066284593,\n\
  \        \"acc_norm_stderr\": 0.0116539643464742\n    },\n    \"harness|arc:challenge|0\"\
  : {\n        \"acc\": 0.2167235494880546,\n        \"acc_stderr\": 0.012040156713481189,\n\
  \        \"acc_norm\": 0.2645051194539249,\n        \"acc_norm_stderr\": 0.01288927294931337\n\
  \    },\n    \"harness|arc:easy|0\": {\n        \"acc\": 0.25126262626262624,\n\
  \        \"acc_stderr\": 0.008900141191221627,\n        \"acc_norm\": 0.24621212121212122,\n\
  \        \"acc_norm_stderr\": 0.008839902656771871\n    },\n    \"harness|hellaswag|0\"\
  : {\n        \"acc\": 0.25343557060346544,\n        \"acc_stderr\": 0.0043408916733205065,\n\
  \        \"acc_norm\": 0.25731925911173076,\n        \"acc_norm_stderr\": 0.00436263363737448\n\
  \    },\n    \"harness|openbookqa|0\": {\n        \"acc\": 0.188,\n        \"acc_stderr\"\
  : 0.017490678880346222,\n        \"acc_norm\": 0.3,\n        \"acc_norm_stderr\"\
  : 0.02051442622562805\n    },\n    \"harness|piqa|0\": {\n        \"acc\": 0.5380848748639826,\n\
  \        \"acc_stderr\": 0.011631933367846709,\n        \"acc_norm\": 0.5097932535364527,\n\
  \        \"acc_norm_stderr\": 0.011663586263283223\n    },\n    \"harness|super_glue:boolq|0\"\
  : {\n        \"acc\": 0.4795107033639144,\n        \"acc_stderr\": 0.008737709345935943\n\
  \    },\n    \"harness|winogrande|0\": {\n        \"acc\": 0.5122336227308603,\n\
  \        \"acc_stderr\": 0.014048278820405621\n    }\n}\n```"
repo_url: https://huggingface.co/3050
leaderboard_url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
point_of_contact: clementine@hf.co
configs:
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1000
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1000.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval100
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval100.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1050
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1050.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1100
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1100.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1150
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1150.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1200
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1200.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1250
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1250.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1300
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1300.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1350
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1350.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1400
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1400.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1450
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1450.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1500
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1500.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval150
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval150.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval1550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1550
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval1550.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval200
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval200.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval250
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval250.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval300
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval300.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval350
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval350.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval400
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval400.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval450
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval450.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval500
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval500.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval50_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval50
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval50.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval550
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval550.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval600
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval600.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval650
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval650.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval700
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval700.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval750
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval750.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval800
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval800.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval850
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval850.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval900
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval900.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval950
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval950.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_1600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1600
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_1600.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_1650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1650
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_1650.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_1700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1700
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_1700.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_1750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1750
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_1750.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_1800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1800
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_1800.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_1850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1850
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_1850.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_1900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1900
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_1900.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_1950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1950
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_1950.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2000
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2000.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2050
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2050.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2100
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2100.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2150
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2150.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2200
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2200.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2250
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2250.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2300
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2300.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2350
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2350.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2400
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2400.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2450
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2450.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2500
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2500.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2750
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2750.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2800
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2800.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2850
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2850.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2900
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2900.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_2950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2950
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_2950.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_3000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3000
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_3000.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_3050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3050
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval_3050.parquet'
- config_name: harness_arc_challenge_0_small_llama_1p82G_the_pile_eval_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval
    path:
    - '**/details_harness|arc:challenge|0_small-llama-1p82G-the-pile_eval.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1000
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1000.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval100
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval100.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1050
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1050.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1100
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1100.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1150
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1150.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1200
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1200.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1250
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1250.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1300
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1300.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1350
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1350.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1400
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1400.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1450
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1450.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1500
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1500.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval150
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval150.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval1550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1550
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval1550.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval200
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval200.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval250
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval250.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval300
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval300.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval350
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval350.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval400
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval400.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval450
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval450.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval500
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval500.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval50_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval50
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval50.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval550
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval550.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval600
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval600.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval650
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval650.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval700
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval700.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval750
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval750.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval800
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval800.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval850
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval850.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval900
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval900.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval950
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval950.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_1600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1600
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_1600.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_1650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1650
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_1650.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_1700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1700
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_1700.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_1750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1750
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_1750.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_1800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1800
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_1800.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_1850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1850
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_1850.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_1900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1900
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_1900.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_1950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1950
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_1950.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2000
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2000.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2050
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2050.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2100
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2100.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2150
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2150.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2200
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2200.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2250
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2250.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2300
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2300.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2350
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2350.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2400
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2400.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2450
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2450.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2500
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2500.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2750
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2750.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2800
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2800.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2850
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2850.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2900
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2900.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_2950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2950
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_2950.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_3000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3000
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_3000.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_3050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3050
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval_3050.parquet'
- config_name: harness_arc_easy_0_small_llama_1p82G_the_pile_eval_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval
    path:
    - '**/details_harness|arc:easy|0_small-llama-1p82G-the-pile_eval.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1000
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1000.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval100
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval100.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1050
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1050.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1100
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1100.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1150
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1150.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1200
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1200.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1250
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1250.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1300
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1300.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1350
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1350.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1400
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1400.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1450
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1450.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1500
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1500.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval150
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval150.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval1550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1550
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval1550.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval200
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval200.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval250
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval250.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval300
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval300.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval350
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval350.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval400
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval400.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval450
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval450.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval500
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval500.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval50_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval50
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval50.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval550
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval550.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval600
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval600.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval650
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval650.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval700
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval700.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval750
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval750.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval800
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval800.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval850
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval850.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval900
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval900.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval950
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval950.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_1600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1600
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_1600.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_1650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1650
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_1650.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_1700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1700
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_1700.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_1750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1750
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_1750.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_1800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1800
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_1800.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_1850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1850
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_1850.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_1900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1900
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_1900.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_1950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1950
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_1950.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2000
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2000.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2050
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2050.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2100
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2100.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2150
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2150.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2200
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2200.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2250
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2250.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2300
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2300.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2350
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2350.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2400
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2400.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2450
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2450.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2500
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2500.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2750
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2750.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2800
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2800.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2850
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2850.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2900
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2900.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_2950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2950
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_2950.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_3000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3000
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_3000.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_3050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3050
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval_3050.parquet'
- config_name: harness_hellaswag_0_small_llama_1p82G_the_pile_eval_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval
    path:
    - '**/details_harness|hellaswag|0_small-llama-1p82G-the-pile_eval.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1000
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1000.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval100
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval100.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1050
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1050.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1100
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1100.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1150
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1150.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1200
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1200.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1250
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1250.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1300
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1300.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1350
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1350.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1400
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1400.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1450
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1450.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1500
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1500.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval150
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval150.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval1550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1550
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval1550.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval200
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval200.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval250
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval250.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval300
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval300.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval350
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval350.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval400
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval400.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval450
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval450.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval500
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval500.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval50_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval50
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval50.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval550
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval550.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval600
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval600.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval650
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval650.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval700
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval700.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval750
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval750.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval800
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval800.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval850
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval850.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval900
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval900.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval950
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval950.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_1600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1600
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_1600.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_1650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1650
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_1650.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_1700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1700
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_1700.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_1750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1750
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_1750.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_1800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1800
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_1800.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_1850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1850
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_1850.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_1900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1900
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_1900.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_1950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1950
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_1950.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2000
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2000.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2050
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2050.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2100
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2100.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2150
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2150.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2200
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2200.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2250
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2250.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2300
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2300.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2350
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2350.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2400
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2400.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2450
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2450.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2500
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2500.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2750
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2750.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2800
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2800.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2850
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2850.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2900
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2900.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_2950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2950
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_2950.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_3000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3000
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_3000.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_3050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3050
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval_3050.parquet'
- config_name: harness_openbookqa_0_small_llama_1p82G_the_pile_eval_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval
    path:
    - '**/details_harness|openbookqa|0_small-llama-1p82G-the-pile_eval.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1000
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1000.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval100
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval100.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1050
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1050.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1100
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1100.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1150
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1150.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1200
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1200.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1250
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1250.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1300
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1300.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1350
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1350.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1400
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1400.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1450
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1450.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1500
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1500.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval150
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval150.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval1550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1550
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval1550.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval200
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval200.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval250
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval250.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval300
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval300.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval350
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval350.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval400
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval400.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval450
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval450.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval500
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval500.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval50_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval50
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval50.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval550
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval550.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval600
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval600.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval650
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval650.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval700
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval700.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval750
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval750.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval800
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval800.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval850
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval850.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval900
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval900.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval950
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval950.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_1600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1600
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_1600.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_1650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1650
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_1650.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_1700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1700
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_1700.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_1750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1750
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_1750.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_1800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1800
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_1800.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_1850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1850
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_1850.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_1900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1900
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_1900.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_1950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1950
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_1950.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2000
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2000.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2050
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2050.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2100
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2100.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2150
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2150.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2200
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2200.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2250
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2250.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2300
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2300.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2350
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2350.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2400
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2400.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2450
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2450.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2500
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2500.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2750
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2750.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2800
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2800.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2850
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2850.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2900
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2900.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_2950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2950
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_2950.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_3000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3000
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_3000.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_3050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3050
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval_3050.parquet'
- config_name: harness_piqa_0_small_llama_1p82G_the_pile_eval_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval
    path:
    - '**/details_harness|piqa|0_small-llama-1p82G-the-pile_eval.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1000
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1000.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval100
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval100.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1050
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1050.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1100
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1100.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1150
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1150.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1200
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1200.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1250
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1250.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1300
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1300.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1350
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1350.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1400
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1400.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1450
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1450.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1500
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1500.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval150
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval150.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval1550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1550
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval1550.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval200
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval200.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval250
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval250.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval300
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval300.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval350
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval350.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval400
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval400.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval450
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval450.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval500
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval500.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval50_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval50
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval50.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval550
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval550.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval600
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval600.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval650
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval650.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval700
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval700.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval750
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval750.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval800
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval800.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval850
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval850.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval900
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval900.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval950
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval950.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_1600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1600
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_1600.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_1650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1650
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_1650.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_1700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1700
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_1700.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_1750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1750
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_1750.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_1800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1800
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_1800.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_1850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1850
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_1850.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_1900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1900
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_1900.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_1950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1950
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_1950.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2000
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2000.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2050
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2050.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2100
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2100.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2150
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2150.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2200
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2200.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2250
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2250.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2300
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2300.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2350
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2350.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2400
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2400.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2450
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2450.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2500
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2500.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2750
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2750.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2800
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2800.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2850
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2850.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2900
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2900.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_2950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2950
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_2950.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_3000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3000
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_3000.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_3050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3050
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval_3050.parquet'
- config_name: harness_super_glue_boolq_0_small_llama_1p82G_the_pile_eval_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval
    path:
    - '**/details_harness|super_glue:boolq|0_small-llama-1p82G-the-pile_eval.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1000
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1000.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval100
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval100.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1050
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1050.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1100
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1100.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1150
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1150.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1200
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1200.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1250
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1250.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1300
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1300.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1350
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1350.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1400
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1400.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1450
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1450.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1500
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1500.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval150
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval150.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval1550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval1550
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval1550.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval200
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval200.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval250
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval250.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval300
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval300.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval350
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval350.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval400
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval400.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval450
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval450.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval500
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval500.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval50_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval50
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval50.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval550_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval550
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval550.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval600
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval600.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval650
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval650.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval700
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval700.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval750
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval750.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval800
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval800.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval850
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval850.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval900
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval900.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval950
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval950.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_1600_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1600
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_1600.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_1650_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1650
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_1650.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_1700_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1700
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_1700.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_1750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1750
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_1750.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_1800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1800
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_1800.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_1850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1850
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_1850.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_1900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1900
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_1900.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_1950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_1950
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_1950.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2000
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2000.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2050
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2050.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2100_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2100
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2100.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2150_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2150
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2150.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2200_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2200
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2200.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2250_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2250
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2250.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2300_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2300
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2300.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2350_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2350
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2350.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2400_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2400
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2400.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2450_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2450
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2450.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2500_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2500
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2500.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2750_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2750
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2750.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2800_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2800
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2800.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2850_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2850
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2850.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2900_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2900
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2900.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_2950_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_2950
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_2950.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_3000_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3000
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_3000.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_3050_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval_3050
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval_3050.parquet'
- config_name: harness_winogrande_0_small_llama_1p82G_the_pile_eval_parquet
  data_files:
  - split: small_llama_1p82G_the_pile_eval
    path:
    - '**/details_harness|winogrande|0_small-llama-1p82G-the-pile_eval.parquet'
- config_name: results
  data_files:
  - split: small_llama_1p82G_the_pile_eval
    path:
    - results_small-llama-1p82G-the-pile_eval.parquet
  - split: small_llama_1p82G_the_pile_eval100
    path:
    - results_small-llama-1p82G-the-pile_eval100.parquet
  - split: small_llama_1p82G_the_pile_eval1000
    path:
    - results_small-llama-1p82G-the-pile_eval1000.parquet
  - split: small_llama_1p82G_the_pile_eval1050
    path:
    - results_small-llama-1p82G-the-pile_eval1050.parquet
  - split: small_llama_1p82G_the_pile_eval1100
    path:
    - results_small-llama-1p82G-the-pile_eval1100.parquet
  - split: small_llama_1p82G_the_pile_eval1150
    path:
    - results_small-llama-1p82G-the-pile_eval1150.parquet
  - split: small_llama_1p82G_the_pile_eval1200
    path:
    - results_small-llama-1p82G-the-pile_eval1200.parquet
  - split: small_llama_1p82G_the_pile_eval1250
    path:
    - results_small-llama-1p82G-the-pile_eval1250.parquet
  - split: small_llama_1p82G_the_pile_eval1300
    path:
    - results_small-llama-1p82G-the-pile_eval1300.parquet
  - split: small_llama_1p82G_the_pile_eval1350
    path:
    - results_small-llama-1p82G-the-pile_eval1350.parquet
  - split: small_llama_1p82G_the_pile_eval1400
    path:
    - results_small-llama-1p82G-the-pile_eval1400.parquet
  - split: small_llama_1p82G_the_pile_eval1450
    path:
    - results_small-llama-1p82G-the-pile_eval1450.parquet
  - split: small_llama_1p82G_the_pile_eval150
    path:
    - results_small-llama-1p82G-the-pile_eval150.parquet
  - split: small_llama_1p82G_the_pile_eval1500
    path:
    - results_small-llama-1p82G-the-pile_eval1500.parquet
  - split: small_llama_1p82G_the_pile_eval1550
    path:
    - results_small-llama-1p82G-the-pile_eval1550.parquet
  - split: small_llama_1p82G_the_pile_eval200
    path:
    - results_small-llama-1p82G-the-pile_eval200.parquet
  - split: small_llama_1p82G_the_pile_eval250
    path:
    - results_small-llama-1p82G-the-pile_eval250.parquet
  - split: small_llama_1p82G_the_pile_eval300
    path:
    - results_small-llama-1p82G-the-pile_eval300.parquet
  - split: small_llama_1p82G_the_pile_eval350
    path:
    - results_small-llama-1p82G-the-pile_eval350.parquet
  - split: small_llama_1p82G_the_pile_eval400
    path:
    - results_small-llama-1p82G-the-pile_eval400.parquet
  - split: small_llama_1p82G_the_pile_eval450
    path:
    - results_small-llama-1p82G-the-pile_eval450.parquet
  - split: small_llama_1p82G_the_pile_eval50
    path:
    - results_small-llama-1p82G-the-pile_eval50.parquet
  - split: small_llama_1p82G_the_pile_eval500
    path:
    - results_small-llama-1p82G-the-pile_eval500.parquet
  - split: small_llama_1p82G_the_pile_eval550
    path:
    - results_small-llama-1p82G-the-pile_eval550.parquet
  - split: small_llama_1p82G_the_pile_eval600
    path:
    - results_small-llama-1p82G-the-pile_eval600.parquet
  - split: small_llama_1p82G_the_pile_eval650
    path:
    - results_small-llama-1p82G-the-pile_eval650.parquet
  - split: small_llama_1p82G_the_pile_eval700
    path:
    - results_small-llama-1p82G-the-pile_eval700.parquet
  - split: small_llama_1p82G_the_pile_eval750
    path:
    - results_small-llama-1p82G-the-pile_eval750.parquet
  - split: small_llama_1p82G_the_pile_eval800
    path:
    - results_small-llama-1p82G-the-pile_eval800.parquet
  - split: small_llama_1p82G_the_pile_eval850
    path:
    - results_small-llama-1p82G-the-pile_eval850.parquet
  - split: small_llama_1p82G_the_pile_eval900
    path:
    - results_small-llama-1p82G-the-pile_eval900.parquet
  - split: small_llama_1p82G_the_pile_eval950
    path:
    - results_small-llama-1p82G-the-pile_eval950.parquet
  - split: small_llama_1p82G_the_pile_eval_1600
    path:
    - results_small-llama-1p82G-the-pile_eval_1600.parquet
  - split: small_llama_1p82G_the_pile_eval_1650
    path:
    - results_small-llama-1p82G-the-pile_eval_1650.parquet
  - split: small_llama_1p82G_the_pile_eval_1700
    path:
    - results_small-llama-1p82G-the-pile_eval_1700.parquet
  - split: small_llama_1p82G_the_pile_eval_1750
    path:
    - results_small-llama-1p82G-the-pile_eval_1750.parquet
  - split: small_llama_1p82G_the_pile_eval_1800
    path:
    - results_small-llama-1p82G-the-pile_eval_1800.parquet
  - split: small_llama_1p82G_the_pile_eval_1850
    path:
    - results_small-llama-1p82G-the-pile_eval_1850.parquet
  - split: small_llama_1p82G_the_pile_eval_1900
    path:
    - results_small-llama-1p82G-the-pile_eval_1900.parquet
  - split: small_llama_1p82G_the_pile_eval_1950
    path:
    - results_small-llama-1p82G-the-pile_eval_1950.parquet
  - split: small_llama_1p82G_the_pile_eval_2000
    path:
    - results_small-llama-1p82G-the-pile_eval_2000.parquet
  - split: small_llama_1p82G_the_pile_eval_2050
    path:
    - results_small-llama-1p82G-the-pile_eval_2050.parquet
  - split: small_llama_1p82G_the_pile_eval_2100
    path:
    - results_small-llama-1p82G-the-pile_eval_2100.parquet
  - split: small_llama_1p82G_the_pile_eval_2150
    path:
    - results_small-llama-1p82G-the-pile_eval_2150.parquet
  - split: small_llama_1p82G_the_pile_eval_2200
    path:
    - results_small-llama-1p82G-the-pile_eval_2200.parquet
  - split: small_llama_1p82G_the_pile_eval_2250
    path:
    - results_small-llama-1p82G-the-pile_eval_2250.parquet
  - split: small_llama_1p82G_the_pile_eval_2300
    path:
    - results_small-llama-1p82G-the-pile_eval_2300.parquet
  - split: small_llama_1p82G_the_pile_eval_2350
    path:
    - results_small-llama-1p82G-the-pile_eval_2350.parquet
  - split: small_llama_1p82G_the_pile_eval_2400
    path:
    - results_small-llama-1p82G-the-pile_eval_2400.parquet
  - split: small_llama_1p82G_the_pile_eval_2450
    path:
    - results_small-llama-1p82G-the-pile_eval_2450.parquet
  - split: small_llama_1p82G_the_pile_eval_2500
    path:
    - results_small-llama-1p82G-the-pile_eval_2500.parquet
  - split: small_llama_1p82G_the_pile_eval_2750
    path:
    - results_small-llama-1p82G-the-pile_eval_2750.parquet
  - split: small_llama_1p82G_the_pile_eval_2800
    path:
    - results_small-llama-1p82G-the-pile_eval_2800.parquet
  - split: small_llama_1p82G_the_pile_eval_2850
    path:
    - results_small-llama-1p82G-the-pile_eval_2850.parquet
  - split: small_llama_1p82G_the_pile_eval_2900
    path:
    - results_small-llama-1p82G-the-pile_eval_2900.parquet
  - split: small_llama_1p82G_the_pile_eval_2950
    path:
    - results_small-llama-1p82G-the-pile_eval_2950.parquet
  - split: small_llama_1p82G_the_pile_eval_3000
    path:
    - results_small-llama-1p82G-the-pile_eval_3000.parquet
  - split: small_llama_1p82G_the_pile_eval_3050
    path:
    - results_small-llama-1p82G-the-pile_eval_3050.parquet
---

# Dataset Card for Evaluation run of 3050

## Dataset Description

- **Homepage:** 
- **Repository:** https://huggingface.co/3050
- **Paper:** 
- **Leaderboard:** https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
- **Point of Contact:** clementine@hf.co

### Dataset Summary

Dataset automatically created during the evaluation run of model [3050](https://huggingface.co/3050) on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).

The dataset is composed of 406 configuration, each one coresponding to one of the evaluated task.

The dataset has been created from 116 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.

An additional configuration "results" store all the aggregated results of the run (and is used to compute and display the agregated metrics on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).

To load the details from a run, you can for instance do the following:
```python
from datasets import load_dataset
data = load_dataset("HuggingFaceBR4/thomwolf-small-llama",
	"harness_winogrande_0_small_llama_1p82G_the_pile_eval_3050_parquet",
	split="train")
```

## Latest results

These are the [latest results from run ](https://huggingface.co/datasets/HuggingFaceBR4/thomwolf-small-llama/blob/main/0/results_small-llama-1p82G-the-pile_eval.json)(note that their might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval):

```python
{
    "all": {
        "acc": 0.3484644210447005,
        "acc_stderr": 0.011027112856079687,
        "acc_norm": 0.31556595066284593,
        "acc_norm_stderr": 0.0116539643464742
    },
    "harness|arc:challenge|0": {
        "acc": 0.2167235494880546,
        "acc_stderr": 0.012040156713481189,
        "acc_norm": 0.2645051194539249,
        "acc_norm_stderr": 0.01288927294931337
    },
    "harness|arc:easy|0": {
        "acc": 0.25126262626262624,
        "acc_stderr": 0.008900141191221627,
        "acc_norm": 0.24621212121212122,
        "acc_norm_stderr": 0.008839902656771871
    },
    "harness|hellaswag|0": {
        "acc": 0.25343557060346544,
        "acc_stderr": 0.0043408916733205065,
        "acc_norm": 0.25731925911173076,
        "acc_norm_stderr": 0.00436263363737448
    },
    "harness|openbookqa|0": {
        "acc": 0.188,
        "acc_stderr": 0.017490678880346222,
        "acc_norm": 0.3,
        "acc_norm_stderr": 0.02051442622562805
    },
    "harness|piqa|0": {
        "acc": 0.5380848748639826,
        "acc_stderr": 0.011631933367846709,
        "acc_norm": 0.5097932535364527,
        "acc_norm_stderr": 0.011663586263283223
    },
    "harness|super_glue:boolq|0": {
        "acc": 0.4795107033639144,
        "acc_stderr": 0.008737709345935943
    },
    "harness|winogrande|0": {
        "acc": 0.5122336227308603,
        "acc_stderr": 0.014048278820405621
    }
}
```

### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

[More Information Needed]

## Dataset Structure

### Data Instances

[More Information Needed]

### Data Fields

[More Information Needed]

### Data Splits

[More Information Needed]

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

[More Information Needed]

### Contributions

[More Information Needed]