region:us
---
pretty_name: Evaluation run of 2200
dataset_summary: "Dataset automatically created during the evaluation run of model\
  \ [2200](https://huggingface.co/2200) on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).\n\
  \nThe dataset is composed of 7 configuration, each one coresponding to one of the\
  \ evaluated task.\n\nThe dataset has been created from 122 run(s). Each run can\
  \ be found as a specific split in each configuration, the split being named using\
  \ the timestamp of the run.The \"train\" split is always pointing to the latest\
  \ results.\n\nAn additional configuration \"results\" store all the aggregated results\
  \ of the run (and is used to compute and display the agregated metrics on the [Open\
  \ LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).\n\
  \nTo load the details from a run, you can for instance do the following:\n```python\n\
  from datasets import load_dataset\ndata = load_dataset(\"HuggingFaceBR4/thomwolf-40B-tokens-llama-seed-7-1p82G\"\
  ,\n\t\"harness_winogrande_0\",\n\tsplit=\"train\")\n```\n\n## Latest results\n\n\
  These are the [latest results from run 2023-10-04T14:58:04.139674](https://huggingface.co/datasets/HuggingFaceBR4/thomwolf-40B-tokens-llama-seed-7-1p82G/blob/main/2200/results_2023-10-04T14-58-04.139674.json)(note\
  \ that their might be results for other tasks in the repos if successive evals didn't\
  \ cover the same tasks. You find each in the results and the \"latest\" split for\
  \ each eval):\n\n```python\n{\n    \"all\": {\n        \"acc\": 0.4034736197157248,\n\
  \        \"acc_stderr\": 0.010961336845565628,\n        \"acc_norm\": 0.38208444366701694,\n\
  \        \"acc_norm_stderr\": 0.011634813232460172\n    },\n    \"harness|arc:challenge|0\"\
  : {\n        \"acc\": 0.18686006825938567,\n        \"acc_stderr\": 0.011391015649694382,\n\
  \        \"acc_norm\": 0.23464163822525597,\n        \"acc_norm_stderr\": 0.012383873560768671\n\
  \    },\n    \"harness|arc:easy|0\": {\n        \"acc\": 0.44907407407407407,\n\
  \        \"acc_stderr\": 0.010206428316323362,\n        \"acc_norm\": 0.40025252525252525,\n\
  \        \"acc_norm_stderr\": 0.010053550119896108\n    },\n    \"harness|hellaswag|0\"\
  : {\n        \"acc\": 0.3066122286397132,\n        \"acc_stderr\": 0.004601446124041564,\n\
  \        \"acc_norm\": 0.34574785899223265,\n        \"acc_norm_stderr\": 0.004746394613384554\n\
  \    },\n    \"harness|openbookqa|0\": {\n        \"acc\": 0.168,\n        \"acc_stderr\"\
  : 0.01673655354154189,\n        \"acc_norm\": 0.272,\n        \"acc_norm_stderr\"\
  : 0.019920483209566065\n    },\n    \"harness|piqa|0\": {\n        \"acc\": 0.6599564744287268,\n\
  \        \"acc_stderr\": 0.011052749414423548,\n        \"acc_norm\": 0.6577801958650707,\n\
  \        \"acc_norm_stderr\": 0.011069764658685456\n    },\n    \"harness|super_glue:boolq|0\"\
  : {\n        \"acc\": 0.5565749235474006,\n        \"acc_stderr\": 0.008688893661318219\n\
  \    },\n    \"harness|winogrande|0\": {\n        \"acc\": 0.4972375690607735,\n\
  \        \"acc_stderr\": 0.014052271211616441\n    }\n}\n```"
repo_url: https://huggingface.co/2200
leaderboard_url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
point_of_contact: clementine@hf.co
configs:
- config_name: harness_arc_challenge_0
  data_files:
  - split: 2023_10_04T11_03_07.216829
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-03-07.216829.parquet'
  - split: 2023_10_04T11_10_27.477524
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-10-27.477524.parquet'
  - split: 2023_10_04T11_18_25.200084
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-18-25.200084.parquet'
  - split: 2023_10_04T11_26_16.947636
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-26-16.947636.parquet'
  - split: 2023_10_04T11_34_11.514796
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-34-11.514796.parquet'
  - split: 2023_10_04T11_42_23.778071
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-42-23.778071.parquet'
  - split: 2023_10_04T11_50_36.694217
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-50-36.694217.parquet'
  - split: 2023_10_04T11_56_18.084271
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-56-18.084271.parquet'
  - split: 2023_10_04T11_57_52.411959
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T11-57-52.411959.parquet'
  - split: 2023_10_04T12_00_31.693249
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-00-31.693249.parquet'
  - split: 2023_10_04T12_04_16.077653
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-04-16.077653.parquet'
  - split: 2023_10_04T12_06_24.996570
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-06-24.996570.parquet'
  - split: 2023_10_04T12_08_56.892900
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-08-56.892900.parquet'
  - split: 2023_10_04T12_12_46.314485
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-12-46.314485.parquet'
  - split: 2023_10_04T12_13_49.777652
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-13-49.777652.parquet'
  - split: 2023_10_04T12_17_02.430342
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-17-02.430342.parquet'
  - split: 2023_10_04T12_21_16.953429
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-21-16.953429.parquet'
  - split: 2023_10_04T12_22_17.423475
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-22-17.423475.parquet'
  - split: 2023_10_04T12_25_30.403700
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-25-30.403700.parquet'
  - split: 2023_10_04T12_29_38.382384
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-29-38.382384.parquet'
  - split: 2023_10_04T12_30_18.370868
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-30-18.370868.parquet'
  - split: 2023_10_04T12_33_58.768124
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-33-58.768124.parquet'
  - split: 2023_10_04T12_37_32.455940
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-37-32.455940.parquet'
  - split: 2023_10_04T12_38_10.233180
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-38-10.233180.parquet'
  - split: 2023_10_04T12_43_01.955381
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-43-01.955381.parquet'
  - split: 2023_10_04T12_46_06.400823
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-46-06.400823.parquet'
  - split: 2023_10_04T12_46_38.799460
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-46-38.799460.parquet'
  - split: 2023_10_04T12_50_58.771429
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-50-58.771429.parquet'
  - split: 2023_10_04T12_53_21.741194
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-53-21.741194.parquet'
  - split: 2023_10_04T12_55_07.255200
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-55-07.255200.parquet'
  - split: 2023_10_04T12_59_58.305535
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T12-59-58.305535.parquet'
  - split: 2023_10_04T13_01_22.880319
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-01-22.880319.parquet'
  - split: 2023_10_04T13_03_36.201302
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-03-36.201302.parquet'
  - split: 2023_10_04T13_08_28.038440
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-08-28.038440.parquet'
  - split: 2023_10_04T13_09_09.810388
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-09-09.810388.parquet'
  - split: 2023_10_04T13_12_09.577587
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-12-09.577587.parquet'
  - split: 2023_10_04T13_16_21.335168
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-16-21.335168.parquet'
  - split: 2023_10_04T13_20_35.263216
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-20-35.263216.parquet'
  - split: 2023_10_04T13_25_23.109399
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-25-23.109399.parquet'
  - split: 2023_10_04T13_29_08.177160
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-29-08.177160.parquet'
  - split: 2023_10_04T13_33_51.287500
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-33-51.287500.parquet'
  - split: 2023_10_04T13_37_35.398465
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-37-35.398465.parquet'
  - split: 2023_10_04T13_42_20.499830
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-42-20.499830.parquet'
  - split: 2023_10_04T13_46_28.038503
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-46-28.038503.parquet'
  - split: 2023_10_04T13_50_47.961393
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-50-47.961393.parquet'
  - split: 2023_10_04T13_54_27.978277
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-54-27.978277.parquet'
  - split: 2023_10_04T13_59_15.434091
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T13-59-15.434091.parquet'
  - split: 2023_10_04T14_02_59.047832
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-02-59.047832.parquet'
  - split: 2023_10_04T14_07_44.870332
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-07-44.870332.parquet'
  - split: 2023_10_04T14_11_29.132402
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-11-29.132402.parquet'
  - split: 2023_10_04T14_16_15.837949
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-16-15.837949.parquet'
  - split: 2023_10_04T14_19_58.918350
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-19-58.918350.parquet'
  - split: 2023_10_04T14_24_46.887823
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-24-46.887823.parquet'
  - split: 2023_10_04T14_28_26.785854
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-28-26.785854.parquet'
  - split: 2023_10_04T14_33_06.913672
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-33-06.913672.parquet'
  - split: 2023_10_04T14_36_58.070222
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-36-58.070222.parquet'
  - split: 2023_10_04T14_41_37.046791
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-41-37.046791.parquet'
  - split: 2023_10_04T14_45_20.150953
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-45-20.150953.parquet'
  - split: 2023_10_04T14_50_07.262615
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-50-07.262615.parquet'
  - split: 2023_10_04T14_54_26.942710
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-54-26.942710.parquet'
  - split: 2023_10_04T14_58_04.139674
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-58-04.139674.parquet'
  - split: latest
    path:
    - '**/details_harness|arc:challenge|0_2023-10-04T14-58-04.139674.parquet'
- config_name: harness_arc_easy_0
  data_files:
  - split: 2023_10_04T11_03_07.216829
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-03-07.216829.parquet'
  - split: 2023_10_04T11_10_27.477524
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-10-27.477524.parquet'
  - split: 2023_10_04T11_18_25.200084
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-18-25.200084.parquet'
  - split: 2023_10_04T11_26_16.947636
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-26-16.947636.parquet'
  - split: 2023_10_04T11_34_11.514796
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-34-11.514796.parquet'
  - split: 2023_10_04T11_42_23.778071
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-42-23.778071.parquet'
  - split: 2023_10_04T11_50_36.694217
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-50-36.694217.parquet'
  - split: 2023_10_04T11_56_18.084271
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-56-18.084271.parquet'
  - split: 2023_10_04T11_57_52.411959
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T11-57-52.411959.parquet'
  - split: 2023_10_04T12_00_31.693249
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-00-31.693249.parquet'
  - split: 2023_10_04T12_04_16.077653
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-04-16.077653.parquet'
  - split: 2023_10_04T12_06_24.996570
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-06-24.996570.parquet'
  - split: 2023_10_04T12_08_56.892900
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-08-56.892900.parquet'
  - split: 2023_10_04T12_12_46.314485
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-12-46.314485.parquet'
  - split: 2023_10_04T12_13_49.777652
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-13-49.777652.parquet'
  - split: 2023_10_04T12_17_02.430342
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-17-02.430342.parquet'
  - split: 2023_10_04T12_21_16.953429
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-21-16.953429.parquet'
  - split: 2023_10_04T12_22_17.423475
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-22-17.423475.parquet'
  - split: 2023_10_04T12_25_30.403700
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-25-30.403700.parquet'
  - split: 2023_10_04T12_29_38.382384
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-29-38.382384.parquet'
  - split: 2023_10_04T12_30_18.370868
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-30-18.370868.parquet'
  - split: 2023_10_04T12_33_58.768124
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-33-58.768124.parquet'
  - split: 2023_10_04T12_37_32.455940
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-37-32.455940.parquet'
  - split: 2023_10_04T12_38_10.233180
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-38-10.233180.parquet'
  - split: 2023_10_04T12_43_01.955381
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-43-01.955381.parquet'
  - split: 2023_10_04T12_46_06.400823
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-46-06.400823.parquet'
  - split: 2023_10_04T12_46_38.799460
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-46-38.799460.parquet'
  - split: 2023_10_04T12_50_58.771429
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-50-58.771429.parquet'
  - split: 2023_10_04T12_53_21.741194
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-53-21.741194.parquet'
  - split: 2023_10_04T12_55_07.255200
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-55-07.255200.parquet'
  - split: 2023_10_04T12_59_58.305535
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T12-59-58.305535.parquet'
  - split: 2023_10_04T13_01_22.880319
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-01-22.880319.parquet'
  - split: 2023_10_04T13_03_36.201302
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-03-36.201302.parquet'
  - split: 2023_10_04T13_08_28.038440
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-08-28.038440.parquet'
  - split: 2023_10_04T13_09_09.810388
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-09-09.810388.parquet'
  - split: 2023_10_04T13_12_09.577587
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-12-09.577587.parquet'
  - split: 2023_10_04T13_16_21.335168
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-16-21.335168.parquet'
  - split: 2023_10_04T13_20_35.263216
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-20-35.263216.parquet'
  - split: 2023_10_04T13_25_23.109399
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-25-23.109399.parquet'
  - split: 2023_10_04T13_29_08.177160
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-29-08.177160.parquet'
  - split: 2023_10_04T13_33_51.287500
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-33-51.287500.parquet'
  - split: 2023_10_04T13_37_35.398465
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-37-35.398465.parquet'
  - split: 2023_10_04T13_42_20.499830
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-42-20.499830.parquet'
  - split: 2023_10_04T13_46_28.038503
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-46-28.038503.parquet'
  - split: 2023_10_04T13_50_47.961393
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-50-47.961393.parquet'
  - split: 2023_10_04T13_54_27.978277
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-54-27.978277.parquet'
  - split: 2023_10_04T13_59_15.434091
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T13-59-15.434091.parquet'
  - split: 2023_10_04T14_02_59.047832
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-02-59.047832.parquet'
  - split: 2023_10_04T14_07_44.870332
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-07-44.870332.parquet'
  - split: 2023_10_04T14_11_29.132402
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-11-29.132402.parquet'
  - split: 2023_10_04T14_16_15.837949
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-16-15.837949.parquet'
  - split: 2023_10_04T14_19_58.918350
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-19-58.918350.parquet'
  - split: 2023_10_04T14_24_46.887823
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-24-46.887823.parquet'
  - split: 2023_10_04T14_28_26.785854
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-28-26.785854.parquet'
  - split: 2023_10_04T14_33_06.913672
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-33-06.913672.parquet'
  - split: 2023_10_04T14_36_58.070222
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-36-58.070222.parquet'
  - split: 2023_10_04T14_41_37.046791
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-41-37.046791.parquet'
  - split: 2023_10_04T14_45_20.150953
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-45-20.150953.parquet'
  - split: 2023_10_04T14_50_07.262615
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-50-07.262615.parquet'
  - split: 2023_10_04T14_54_26.942710
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-54-26.942710.parquet'
  - split: 2023_10_04T14_58_04.139674
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-58-04.139674.parquet'
  - split: latest
    path:
    - '**/details_harness|arc:easy|0_2023-10-04T14-58-04.139674.parquet'
- config_name: harness_hellaswag_0
  data_files:
  - split: 2023_10_04T11_03_07.216829
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-03-07.216829.parquet'
  - split: 2023_10_04T11_10_27.477524
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-10-27.477524.parquet'
  - split: 2023_10_04T11_18_25.200084
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-18-25.200084.parquet'
  - split: 2023_10_04T11_26_16.947636
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-26-16.947636.parquet'
  - split: 2023_10_04T11_34_11.514796
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-34-11.514796.parquet'
  - split: 2023_10_04T11_42_23.778071
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-42-23.778071.parquet'
  - split: 2023_10_04T11_50_36.694217
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-50-36.694217.parquet'
  - split: 2023_10_04T11_56_18.084271
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-56-18.084271.parquet'
  - split: 2023_10_04T11_57_52.411959
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T11-57-52.411959.parquet'
  - split: 2023_10_04T12_00_31.693249
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-00-31.693249.parquet'
  - split: 2023_10_04T12_04_16.077653
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-04-16.077653.parquet'
  - split: 2023_10_04T12_06_24.996570
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-06-24.996570.parquet'
  - split: 2023_10_04T12_08_56.892900
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-08-56.892900.parquet'
  - split: 2023_10_04T12_12_46.314485
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-12-46.314485.parquet'
  - split: 2023_10_04T12_13_49.777652
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-13-49.777652.parquet'
  - split: 2023_10_04T12_17_02.430342
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-17-02.430342.parquet'
  - split: 2023_10_04T12_21_16.953429
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-21-16.953429.parquet'
  - split: 2023_10_04T12_22_17.423475
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-22-17.423475.parquet'
  - split: 2023_10_04T12_25_30.403700
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-25-30.403700.parquet'
  - split: 2023_10_04T12_29_38.382384
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-29-38.382384.parquet'
  - split: 2023_10_04T12_30_18.370868
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-30-18.370868.parquet'
  - split: 2023_10_04T12_33_58.768124
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-33-58.768124.parquet'
  - split: 2023_10_04T12_37_32.455940
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-37-32.455940.parquet'
  - split: 2023_10_04T12_38_10.233180
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-38-10.233180.parquet'
  - split: 2023_10_04T12_43_01.955381
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-43-01.955381.parquet'
  - split: 2023_10_04T12_46_06.400823
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-46-06.400823.parquet'
  - split: 2023_10_04T12_46_38.799460
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-46-38.799460.parquet'
  - split: 2023_10_04T12_50_58.771429
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-50-58.771429.parquet'
  - split: 2023_10_04T12_53_21.741194
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-53-21.741194.parquet'
  - split: 2023_10_04T12_55_07.255200
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-55-07.255200.parquet'
  - split: 2023_10_04T12_59_58.305535
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T12-59-58.305535.parquet'
  - split: 2023_10_04T13_01_22.880319
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-01-22.880319.parquet'
  - split: 2023_10_04T13_03_36.201302
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-03-36.201302.parquet'
  - split: 2023_10_04T13_08_28.038440
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-08-28.038440.parquet'
  - split: 2023_10_04T13_09_09.810388
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-09-09.810388.parquet'
  - split: 2023_10_04T13_12_09.577587
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-12-09.577587.parquet'
  - split: 2023_10_04T13_16_21.335168
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-16-21.335168.parquet'
  - split: 2023_10_04T13_20_35.263216
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-20-35.263216.parquet'
  - split: 2023_10_04T13_25_23.109399
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-25-23.109399.parquet'
  - split: 2023_10_04T13_29_08.177160
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-29-08.177160.parquet'
  - split: 2023_10_04T13_33_51.287500
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-33-51.287500.parquet'
  - split: 2023_10_04T13_37_35.398465
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-37-35.398465.parquet'
  - split: 2023_10_04T13_42_20.499830
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-42-20.499830.parquet'
  - split: 2023_10_04T13_46_28.038503
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-46-28.038503.parquet'
  - split: 2023_10_04T13_50_47.961393
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-50-47.961393.parquet'
  - split: 2023_10_04T13_54_27.978277
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-54-27.978277.parquet'
  - split: 2023_10_04T13_59_15.434091
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T13-59-15.434091.parquet'
  - split: 2023_10_04T14_02_59.047832
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-02-59.047832.parquet'
  - split: 2023_10_04T14_07_44.870332
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-07-44.870332.parquet'
  - split: 2023_10_04T14_11_29.132402
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-11-29.132402.parquet'
  - split: 2023_10_04T14_16_15.837949
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-16-15.837949.parquet'
  - split: 2023_10_04T14_19_58.918350
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-19-58.918350.parquet'
  - split: 2023_10_04T14_24_46.887823
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-24-46.887823.parquet'
  - split: 2023_10_04T14_28_26.785854
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-28-26.785854.parquet'
  - split: 2023_10_04T14_33_06.913672
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-33-06.913672.parquet'
  - split: 2023_10_04T14_36_58.070222
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-36-58.070222.parquet'
  - split: 2023_10_04T14_41_37.046791
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-41-37.046791.parquet'
  - split: 2023_10_04T14_45_20.150953
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-45-20.150953.parquet'
  - split: 2023_10_04T14_50_07.262615
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-50-07.262615.parquet'
  - split: 2023_10_04T14_54_26.942710
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-54-26.942710.parquet'
  - split: 2023_10_04T14_58_04.139674
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-58-04.139674.parquet'
  - split: latest
    path:
    - '**/details_harness|hellaswag|0_2023-10-04T14-58-04.139674.parquet'
- config_name: harness_openbookqa_0
  data_files:
  - split: 2023_10_04T11_03_07.216829
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-03-07.216829.parquet'
  - split: 2023_10_04T11_10_27.477524
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-10-27.477524.parquet'
  - split: 2023_10_04T11_18_25.200084
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-18-25.200084.parquet'
  - split: 2023_10_04T11_26_16.947636
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-26-16.947636.parquet'
  - split: 2023_10_04T11_34_11.514796
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-34-11.514796.parquet'
  - split: 2023_10_04T11_42_23.778071
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-42-23.778071.parquet'
  - split: 2023_10_04T11_50_36.694217
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-50-36.694217.parquet'
  - split: 2023_10_04T11_56_18.084271
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-56-18.084271.parquet'
  - split: 2023_10_04T11_57_52.411959
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T11-57-52.411959.parquet'
  - split: 2023_10_04T12_00_31.693249
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-00-31.693249.parquet'
  - split: 2023_10_04T12_04_16.077653
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-04-16.077653.parquet'
  - split: 2023_10_04T12_06_24.996570
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-06-24.996570.parquet'
  - split: 2023_10_04T12_08_56.892900
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-08-56.892900.parquet'
  - split: 2023_10_04T12_12_46.314485
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-12-46.314485.parquet'
  - split: 2023_10_04T12_13_49.777652
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-13-49.777652.parquet'
  - split: 2023_10_04T12_17_02.430342
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-17-02.430342.parquet'
  - split: 2023_10_04T12_21_16.953429
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-21-16.953429.parquet'
  - split: 2023_10_04T12_22_17.423475
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-22-17.423475.parquet'
  - split: 2023_10_04T12_25_30.403700
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-25-30.403700.parquet'
  - split: 2023_10_04T12_29_38.382384
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-29-38.382384.parquet'
  - split: 2023_10_04T12_30_18.370868
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-30-18.370868.parquet'
  - split: 2023_10_04T12_33_58.768124
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-33-58.768124.parquet'
  - split: 2023_10_04T12_37_32.455940
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-37-32.455940.parquet'
  - split: 2023_10_04T12_38_10.233180
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-38-10.233180.parquet'
  - split: 2023_10_04T12_43_01.955381
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-43-01.955381.parquet'
  - split: 2023_10_04T12_46_06.400823
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-46-06.400823.parquet'
  - split: 2023_10_04T12_46_38.799460
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-46-38.799460.parquet'
  - split: 2023_10_04T12_50_58.771429
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-50-58.771429.parquet'
  - split: 2023_10_04T12_53_21.741194
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-53-21.741194.parquet'
  - split: 2023_10_04T12_55_07.255200
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-55-07.255200.parquet'
  - split: 2023_10_04T12_59_58.305535
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T12-59-58.305535.parquet'
  - split: 2023_10_04T13_01_22.880319
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-01-22.880319.parquet'
  - split: 2023_10_04T13_03_36.201302
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-03-36.201302.parquet'
  - split: 2023_10_04T13_08_28.038440
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-08-28.038440.parquet'
  - split: 2023_10_04T13_09_09.810388
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-09-09.810388.parquet'
  - split: 2023_10_04T13_12_09.577587
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-12-09.577587.parquet'
  - split: 2023_10_04T13_16_21.335168
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-16-21.335168.parquet'
  - split: 2023_10_04T13_20_35.263216
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-20-35.263216.parquet'
  - split: 2023_10_04T13_25_23.109399
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-25-23.109399.parquet'
  - split: 2023_10_04T13_29_08.177160
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-29-08.177160.parquet'
  - split: 2023_10_04T13_33_51.287500
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-33-51.287500.parquet'
  - split: 2023_10_04T13_37_35.398465
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-37-35.398465.parquet'
  - split: 2023_10_04T13_42_20.499830
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-42-20.499830.parquet'
  - split: 2023_10_04T13_46_28.038503
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-46-28.038503.parquet'
  - split: 2023_10_04T13_50_47.961393
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-50-47.961393.parquet'
  - split: 2023_10_04T13_54_27.978277
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-54-27.978277.parquet'
  - split: 2023_10_04T13_59_15.434091
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T13-59-15.434091.parquet'
  - split: 2023_10_04T14_02_59.047832
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-02-59.047832.parquet'
  - split: 2023_10_04T14_07_44.870332
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-07-44.870332.parquet'
  - split: 2023_10_04T14_11_29.132402
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-11-29.132402.parquet'
  - split: 2023_10_04T14_16_15.837949
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-16-15.837949.parquet'
  - split: 2023_10_04T14_19_58.918350
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-19-58.918350.parquet'
  - split: 2023_10_04T14_24_46.887823
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-24-46.887823.parquet'
  - split: 2023_10_04T14_28_26.785854
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-28-26.785854.parquet'
  - split: 2023_10_04T14_33_06.913672
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-33-06.913672.parquet'
  - split: 2023_10_04T14_36_58.070222
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-36-58.070222.parquet'
  - split: 2023_10_04T14_41_37.046791
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-41-37.046791.parquet'
  - split: 2023_10_04T14_45_20.150953
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-45-20.150953.parquet'
  - split: 2023_10_04T14_50_07.262615
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-50-07.262615.parquet'
  - split: 2023_10_04T14_54_26.942710
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-54-26.942710.parquet'
  - split: 2023_10_04T14_58_04.139674
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-58-04.139674.parquet'
  - split: latest
    path:
    - '**/details_harness|openbookqa|0_2023-10-04T14-58-04.139674.parquet'
- config_name: harness_piqa_0
  data_files:
  - split: 2023_10_04T11_03_07.216829
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-03-07.216829.parquet'
  - split: 2023_10_04T11_10_27.477524
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-10-27.477524.parquet'
  - split: 2023_10_04T11_18_25.200084
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-18-25.200084.parquet'
  - split: 2023_10_04T11_26_16.947636
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-26-16.947636.parquet'
  - split: 2023_10_04T11_34_11.514796
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-34-11.514796.parquet'
  - split: 2023_10_04T11_42_23.778071
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-42-23.778071.parquet'
  - split: 2023_10_04T11_50_36.694217
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-50-36.694217.parquet'
  - split: 2023_10_04T11_56_18.084271
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-56-18.084271.parquet'
  - split: 2023_10_04T11_57_52.411959
    path:
    - '**/details_harness|piqa|0_2023-10-04T11-57-52.411959.parquet'
  - split: 2023_10_04T12_00_31.693249
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-00-31.693249.parquet'
  - split: 2023_10_04T12_04_16.077653
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-04-16.077653.parquet'
  - split: 2023_10_04T12_06_24.996570
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-06-24.996570.parquet'
  - split: 2023_10_04T12_08_56.892900
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-08-56.892900.parquet'
  - split: 2023_10_04T12_12_46.314485
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-12-46.314485.parquet'
  - split: 2023_10_04T12_13_49.777652
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-13-49.777652.parquet'
  - split: 2023_10_04T12_17_02.430342
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-17-02.430342.parquet'
  - split: 2023_10_04T12_21_16.953429
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-21-16.953429.parquet'
  - split: 2023_10_04T12_22_17.423475
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-22-17.423475.parquet'
  - split: 2023_10_04T12_25_30.403700
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-25-30.403700.parquet'
  - split: 2023_10_04T12_29_38.382384
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-29-38.382384.parquet'
  - split: 2023_10_04T12_30_18.370868
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-30-18.370868.parquet'
  - split: 2023_10_04T12_33_58.768124
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-33-58.768124.parquet'
  - split: 2023_10_04T12_37_32.455940
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-37-32.455940.parquet'
  - split: 2023_10_04T12_38_10.233180
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-38-10.233180.parquet'
  - split: 2023_10_04T12_43_01.955381
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-43-01.955381.parquet'
  - split: 2023_10_04T12_46_06.400823
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-46-06.400823.parquet'
  - split: 2023_10_04T12_46_38.799460
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-46-38.799460.parquet'
  - split: 2023_10_04T12_50_58.771429
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-50-58.771429.parquet'
  - split: 2023_10_04T12_53_21.741194
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-53-21.741194.parquet'
  - split: 2023_10_04T12_55_07.255200
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-55-07.255200.parquet'
  - split: 2023_10_04T12_59_58.305535
    path:
    - '**/details_harness|piqa|0_2023-10-04T12-59-58.305535.parquet'
  - split: 2023_10_04T13_01_22.880319
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-01-22.880319.parquet'
  - split: 2023_10_04T13_03_36.201302
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-03-36.201302.parquet'
  - split: 2023_10_04T13_08_28.038440
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-08-28.038440.parquet'
  - split: 2023_10_04T13_09_09.810388
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-09-09.810388.parquet'
  - split: 2023_10_04T13_12_09.577587
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-12-09.577587.parquet'
  - split: 2023_10_04T13_16_21.335168
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-16-21.335168.parquet'
  - split: 2023_10_04T13_20_35.263216
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-20-35.263216.parquet'
  - split: 2023_10_04T13_25_23.109399
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-25-23.109399.parquet'
  - split: 2023_10_04T13_29_08.177160
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-29-08.177160.parquet'
  - split: 2023_10_04T13_33_51.287500
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-33-51.287500.parquet'
  - split: 2023_10_04T13_37_35.398465
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-37-35.398465.parquet'
  - split: 2023_10_04T13_42_20.499830
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-42-20.499830.parquet'
  - split: 2023_10_04T13_46_28.038503
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-46-28.038503.parquet'
  - split: 2023_10_04T13_50_47.961393
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-50-47.961393.parquet'
  - split: 2023_10_04T13_54_27.978277
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-54-27.978277.parquet'
  - split: 2023_10_04T13_59_15.434091
    path:
    - '**/details_harness|piqa|0_2023-10-04T13-59-15.434091.parquet'
  - split: 2023_10_04T14_02_59.047832
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-02-59.047832.parquet'
  - split: 2023_10_04T14_07_44.870332
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-07-44.870332.parquet'
  - split: 2023_10_04T14_11_29.132402
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-11-29.132402.parquet'
  - split: 2023_10_04T14_16_15.837949
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-16-15.837949.parquet'
  - split: 2023_10_04T14_19_58.918350
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-19-58.918350.parquet'
  - split: 2023_10_04T14_24_46.887823
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-24-46.887823.parquet'
  - split: 2023_10_04T14_28_26.785854
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-28-26.785854.parquet'
  - split: 2023_10_04T14_33_06.913672
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-33-06.913672.parquet'
  - split: 2023_10_04T14_36_58.070222
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-36-58.070222.parquet'
  - split: 2023_10_04T14_41_37.046791
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-41-37.046791.parquet'
  - split: 2023_10_04T14_45_20.150953
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-45-20.150953.parquet'
  - split: 2023_10_04T14_50_07.262615
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-50-07.262615.parquet'
  - split: 2023_10_04T14_54_26.942710
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-54-26.942710.parquet'
  - split: 2023_10_04T14_58_04.139674
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-58-04.139674.parquet'
  - split: latest
    path:
    - '**/details_harness|piqa|0_2023-10-04T14-58-04.139674.parquet'
- config_name: harness_super_glue_boolq_0
  data_files:
  - split: 2023_10_04T11_03_07.216829
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-03-07.216829.parquet'
  - split: 2023_10_04T11_10_27.477524
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-10-27.477524.parquet'
  - split: 2023_10_04T11_18_25.200084
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-18-25.200084.parquet'
  - split: 2023_10_04T11_26_16.947636
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-26-16.947636.parquet'
  - split: 2023_10_04T11_34_11.514796
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-34-11.514796.parquet'
  - split: 2023_10_04T11_42_23.778071
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-42-23.778071.parquet'
  - split: 2023_10_04T11_50_36.694217
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-50-36.694217.parquet'
  - split: 2023_10_04T11_56_18.084271
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-56-18.084271.parquet'
  - split: 2023_10_04T11_57_52.411959
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T11-57-52.411959.parquet'
  - split: 2023_10_04T12_00_31.693249
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-00-31.693249.parquet'
  - split: 2023_10_04T12_04_16.077653
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-04-16.077653.parquet'
  - split: 2023_10_04T12_06_24.996570
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-06-24.996570.parquet'
  - split: 2023_10_04T12_08_56.892900
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-08-56.892900.parquet'
  - split: 2023_10_04T12_12_46.314485
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-12-46.314485.parquet'
  - split: 2023_10_04T12_13_49.777652
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-13-49.777652.parquet'
  - split: 2023_10_04T12_17_02.430342
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-17-02.430342.parquet'
  - split: 2023_10_04T12_21_16.953429
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-21-16.953429.parquet'
  - split: 2023_10_04T12_22_17.423475
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-22-17.423475.parquet'
  - split: 2023_10_04T12_25_30.403700
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-25-30.403700.parquet'
  - split: 2023_10_04T12_29_38.382384
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-29-38.382384.parquet'
  - split: 2023_10_04T12_30_18.370868
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-30-18.370868.parquet'
  - split: 2023_10_04T12_33_58.768124
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-33-58.768124.parquet'
  - split: 2023_10_04T12_37_32.455940
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-37-32.455940.parquet'
  - split: 2023_10_04T12_38_10.233180
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-38-10.233180.parquet'
  - split: 2023_10_04T12_43_01.955381
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-43-01.955381.parquet'
  - split: 2023_10_04T12_46_06.400823
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-46-06.400823.parquet'
  - split: 2023_10_04T12_46_38.799460
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-46-38.799460.parquet'
  - split: 2023_10_04T12_50_58.771429
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-50-58.771429.parquet'
  - split: 2023_10_04T12_53_21.741194
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-53-21.741194.parquet'
  - split: 2023_10_04T12_55_07.255200
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-55-07.255200.parquet'
  - split: 2023_10_04T12_59_58.305535
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T12-59-58.305535.parquet'
  - split: 2023_10_04T13_01_22.880319
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-01-22.880319.parquet'
  - split: 2023_10_04T13_03_36.201302
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-03-36.201302.parquet'
  - split: 2023_10_04T13_08_28.038440
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-08-28.038440.parquet'
  - split: 2023_10_04T13_09_09.810388
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-09-09.810388.parquet'
  - split: 2023_10_04T13_12_09.577587
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-12-09.577587.parquet'
  - split: 2023_10_04T13_16_21.335168
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-16-21.335168.parquet'
  - split: 2023_10_04T13_20_35.263216
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-20-35.263216.parquet'
  - split: 2023_10_04T13_25_23.109399
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-25-23.109399.parquet'
  - split: 2023_10_04T13_29_08.177160
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-29-08.177160.parquet'
  - split: 2023_10_04T13_33_51.287500
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-33-51.287500.parquet'
  - split: 2023_10_04T13_37_35.398465
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-37-35.398465.parquet'
  - split: 2023_10_04T13_42_20.499830
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-42-20.499830.parquet'
  - split: 2023_10_04T13_46_28.038503
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-46-28.038503.parquet'
  - split: 2023_10_04T13_50_47.961393
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-50-47.961393.parquet'
  - split: 2023_10_04T13_54_27.978277
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-54-27.978277.parquet'
  - split: 2023_10_04T13_59_15.434091
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T13-59-15.434091.parquet'
  - split: 2023_10_04T14_02_59.047832
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-02-59.047832.parquet'
  - split: 2023_10_04T14_07_44.870332
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-07-44.870332.parquet'
  - split: 2023_10_04T14_11_29.132402
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-11-29.132402.parquet'
  - split: 2023_10_04T14_16_15.837949
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-16-15.837949.parquet'
  - split: 2023_10_04T14_19_58.918350
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-19-58.918350.parquet'
  - split: 2023_10_04T14_24_46.887823
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-24-46.887823.parquet'
  - split: 2023_10_04T14_28_26.785854
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-28-26.785854.parquet'
  - split: 2023_10_04T14_33_06.913672
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-33-06.913672.parquet'
  - split: 2023_10_04T14_36_58.070222
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-36-58.070222.parquet'
  - split: 2023_10_04T14_41_37.046791
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-41-37.046791.parquet'
  - split: 2023_10_04T14_45_20.150953
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-45-20.150953.parquet'
  - split: 2023_10_04T14_50_07.262615
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-50-07.262615.parquet'
  - split: 2023_10_04T14_54_26.942710
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-54-26.942710.parquet'
  - split: 2023_10_04T14_58_04.139674
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-58-04.139674.parquet'
  - split: latest
    path:
    - '**/details_harness|super_glue:boolq|0_2023-10-04T14-58-04.139674.parquet'
- config_name: harness_winogrande_0
  data_files:
  - split: 2023_10_04T11_03_07.216829
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-03-07.216829.parquet'
  - split: 2023_10_04T11_10_27.477524
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-10-27.477524.parquet'
  - split: 2023_10_04T11_18_25.200084
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-18-25.200084.parquet'
  - split: 2023_10_04T11_26_16.947636
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-26-16.947636.parquet'
  - split: 2023_10_04T11_34_11.514796
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-34-11.514796.parquet'
  - split: 2023_10_04T11_42_23.778071
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-42-23.778071.parquet'
  - split: 2023_10_04T11_50_36.694217
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-50-36.694217.parquet'
  - split: 2023_10_04T11_56_18.084271
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-56-18.084271.parquet'
  - split: 2023_10_04T11_57_52.411959
    path:
    - '**/details_harness|winogrande|0_2023-10-04T11-57-52.411959.parquet'
  - split: 2023_10_04T12_00_31.693249
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-00-31.693249.parquet'
  - split: 2023_10_04T12_04_16.077653
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-04-16.077653.parquet'
  - split: 2023_10_04T12_06_24.996570
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-06-24.996570.parquet'
  - split: 2023_10_04T12_08_56.892900
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-08-56.892900.parquet'
  - split: 2023_10_04T12_12_46.314485
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-12-46.314485.parquet'
  - split: 2023_10_04T12_13_49.777652
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-13-49.777652.parquet'
  - split: 2023_10_04T12_17_02.430342
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-17-02.430342.parquet'
  - split: 2023_10_04T12_21_16.953429
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-21-16.953429.parquet'
  - split: 2023_10_04T12_22_17.423475
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-22-17.423475.parquet'
  - split: 2023_10_04T12_25_30.403700
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-25-30.403700.parquet'
  - split: 2023_10_04T12_29_38.382384
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-29-38.382384.parquet'
  - split: 2023_10_04T12_30_18.370868
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-30-18.370868.parquet'
  - split: 2023_10_04T12_33_58.768124
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-33-58.768124.parquet'
  - split: 2023_10_04T12_37_32.455940
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-37-32.455940.parquet'
  - split: 2023_10_04T12_38_10.233180
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-38-10.233180.parquet'
  - split: 2023_10_04T12_43_01.955381
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-43-01.955381.parquet'
  - split: 2023_10_04T12_46_06.400823
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-46-06.400823.parquet'
  - split: 2023_10_04T12_46_38.799460
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-46-38.799460.parquet'
  - split: 2023_10_04T12_50_58.771429
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-50-58.771429.parquet'
  - split: 2023_10_04T12_53_21.741194
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-53-21.741194.parquet'
  - split: 2023_10_04T12_55_07.255200
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-55-07.255200.parquet'
  - split: 2023_10_04T12_59_58.305535
    path:
    - '**/details_harness|winogrande|0_2023-10-04T12-59-58.305535.parquet'
  - split: 2023_10_04T13_01_22.880319
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-01-22.880319.parquet'
  - split: 2023_10_04T13_03_36.201302
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-03-36.201302.parquet'
  - split: 2023_10_04T13_08_28.038440
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-08-28.038440.parquet'
  - split: 2023_10_04T13_09_09.810388
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-09-09.810388.parquet'
  - split: 2023_10_04T13_12_09.577587
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-12-09.577587.parquet'
  - split: 2023_10_04T13_16_21.335168
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-16-21.335168.parquet'
  - split: 2023_10_04T13_20_35.263216
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-20-35.263216.parquet'
  - split: 2023_10_04T13_25_23.109399
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-25-23.109399.parquet'
  - split: 2023_10_04T13_29_08.177160
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-29-08.177160.parquet'
  - split: 2023_10_04T13_33_51.287500
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-33-51.287500.parquet'
  - split: 2023_10_04T13_37_35.398465
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-37-35.398465.parquet'
  - split: 2023_10_04T13_42_20.499830
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-42-20.499830.parquet'
  - split: 2023_10_04T13_46_28.038503
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-46-28.038503.parquet'
  - split: 2023_10_04T13_50_47.961393
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-50-47.961393.parquet'
  - split: 2023_10_04T13_54_27.978277
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-54-27.978277.parquet'
  - split: 2023_10_04T13_59_15.434091
    path:
    - '**/details_harness|winogrande|0_2023-10-04T13-59-15.434091.parquet'
  - split: 2023_10_04T14_02_59.047832
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-02-59.047832.parquet'
  - split: 2023_10_04T14_07_44.870332
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-07-44.870332.parquet'
  - split: 2023_10_04T14_11_29.132402
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-11-29.132402.parquet'
  - split: 2023_10_04T14_16_15.837949
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-16-15.837949.parquet'
  - split: 2023_10_04T14_19_58.918350
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-19-58.918350.parquet'
  - split: 2023_10_04T14_24_46.887823
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-24-46.887823.parquet'
  - split: 2023_10_04T14_28_26.785854
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-28-26.785854.parquet'
  - split: 2023_10_04T14_33_06.913672
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-33-06.913672.parquet'
  - split: 2023_10_04T14_36_58.070222
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-36-58.070222.parquet'
  - split: 2023_10_04T14_41_37.046791
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-41-37.046791.parquet'
  - split: 2023_10_04T14_45_20.150953
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-45-20.150953.parquet'
  - split: 2023_10_04T14_50_07.262615
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-50-07.262615.parquet'
  - split: 2023_10_04T14_54_26.942710
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-54-26.942710.parquet'
  - split: 2023_10_04T14_58_04.139674
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-58-04.139674.parquet'
  - split: latest
    path:
    - '**/details_harness|winogrande|0_2023-10-04T14-58-04.139674.parquet'
- config_name: results
  data_files:
  - split: 2023_10_04T11_03_07.216829
    path:
    - results_2023-10-04T11-03-07.216829.parquet
  - split: 2023_10_04T11_10_27.477524
    path:
    - results_2023-10-04T11-10-27.477524.parquet
  - split: 2023_10_04T11_18_25.200084
    path:
    - results_2023-10-04T11-18-25.200084.parquet
  - split: 2023_10_04T11_26_16.947636
    path:
    - results_2023-10-04T11-26-16.947636.parquet
  - split: 2023_10_04T11_34_11.514796
    path:
    - results_2023-10-04T11-34-11.514796.parquet
  - split: 2023_10_04T11_42_23.778071
    path:
    - results_2023-10-04T11-42-23.778071.parquet
  - split: 2023_10_04T11_50_36.694217
    path:
    - results_2023-10-04T11-50-36.694217.parquet
  - split: 2023_10_04T11_56_18.084271
    path:
    - results_2023-10-04T11-56-18.084271.parquet
  - split: 2023_10_04T11_57_52.411959
    path:
    - results_2023-10-04T11-57-52.411959.parquet
  - split: 2023_10_04T12_00_31.693249
    path:
    - results_2023-10-04T12-00-31.693249.parquet
  - split: 2023_10_04T12_04_16.077653
    path:
    - results_2023-10-04T12-04-16.077653.parquet
  - split: 2023_10_04T12_06_24.996570
    path:
    - results_2023-10-04T12-06-24.996570.parquet
  - split: 2023_10_04T12_08_56.892900
    path:
    - results_2023-10-04T12-08-56.892900.parquet
  - split: 2023_10_04T12_12_46.314485
    path:
    - results_2023-10-04T12-12-46.314485.parquet
  - split: 2023_10_04T12_13_49.777652
    path:
    - results_2023-10-04T12-13-49.777652.parquet
  - split: 2023_10_04T12_17_02.430342
    path:
    - results_2023-10-04T12-17-02.430342.parquet
  - split: 2023_10_04T12_21_16.953429
    path:
    - results_2023-10-04T12-21-16.953429.parquet
  - split: 2023_10_04T12_22_17.423475
    path:
    - results_2023-10-04T12-22-17.423475.parquet
  - split: 2023_10_04T12_25_30.403700
    path:
    - results_2023-10-04T12-25-30.403700.parquet
  - split: 2023_10_04T12_29_38.382384
    path:
    - results_2023-10-04T12-29-38.382384.parquet
  - split: 2023_10_04T12_30_18.370868
    path:
    - results_2023-10-04T12-30-18.370868.parquet
  - split: 2023_10_04T12_33_58.768124
    path:
    - results_2023-10-04T12-33-58.768124.parquet
  - split: 2023_10_04T12_37_32.455940
    path:
    - results_2023-10-04T12-37-32.455940.parquet
  - split: 2023_10_04T12_38_10.233180
    path:
    - results_2023-10-04T12-38-10.233180.parquet
  - split: 2023_10_04T12_43_01.955381
    path:
    - results_2023-10-04T12-43-01.955381.parquet
  - split: 2023_10_04T12_46_06.400823
    path:
    - results_2023-10-04T12-46-06.400823.parquet
  - split: 2023_10_04T12_46_38.799460
    path:
    - results_2023-10-04T12-46-38.799460.parquet
  - split: 2023_10_04T12_50_58.771429
    path:
    - results_2023-10-04T12-50-58.771429.parquet
  - split: 2023_10_04T12_53_21.741194
    path:
    - results_2023-10-04T12-53-21.741194.parquet
  - split: 2023_10_04T12_55_07.255200
    path:
    - results_2023-10-04T12-55-07.255200.parquet
  - split: 2023_10_04T12_59_58.305535
    path:
    - results_2023-10-04T12-59-58.305535.parquet
  - split: 2023_10_04T13_01_22.880319
    path:
    - results_2023-10-04T13-01-22.880319.parquet
  - split: 2023_10_04T13_03_36.201302
    path:
    - results_2023-10-04T13-03-36.201302.parquet
  - split: 2023_10_04T13_08_28.038440
    path:
    - results_2023-10-04T13-08-28.038440.parquet
  - split: 2023_10_04T13_09_09.810388
    path:
    - results_2023-10-04T13-09-09.810388.parquet
  - split: 2023_10_04T13_12_09.577587
    path:
    - results_2023-10-04T13-12-09.577587.parquet
  - split: 2023_10_04T13_16_21.335168
    path:
    - results_2023-10-04T13-16-21.335168.parquet
  - split: 2023_10_04T13_20_35.263216
    path:
    - results_2023-10-04T13-20-35.263216.parquet
  - split: 2023_10_04T13_25_23.109399
    path:
    - results_2023-10-04T13-25-23.109399.parquet
  - split: 2023_10_04T13_29_08.177160
    path:
    - results_2023-10-04T13-29-08.177160.parquet
  - split: 2023_10_04T13_33_51.287500
    path:
    - results_2023-10-04T13-33-51.287500.parquet
  - split: 2023_10_04T13_37_35.398465
    path:
    - results_2023-10-04T13-37-35.398465.parquet
  - split: 2023_10_04T13_42_20.499830
    path:
    - results_2023-10-04T13-42-20.499830.parquet
  - split: 2023_10_04T13_46_28.038503
    path:
    - results_2023-10-04T13-46-28.038503.parquet
  - split: 2023_10_04T13_50_47.961393
    path:
    - results_2023-10-04T13-50-47.961393.parquet
  - split: 2023_10_04T13_54_27.978277
    path:
    - results_2023-10-04T13-54-27.978277.parquet
  - split: 2023_10_04T13_59_15.434091
    path:
    - results_2023-10-04T13-59-15.434091.parquet
  - split: 2023_10_04T14_02_59.047832
    path:
    - results_2023-10-04T14-02-59.047832.parquet
  - split: 2023_10_04T14_07_44.870332
    path:
    - results_2023-10-04T14-07-44.870332.parquet
  - split: 2023_10_04T14_11_29.132402
    path:
    - results_2023-10-04T14-11-29.132402.parquet
  - split: 2023_10_04T14_16_15.837949
    path:
    - results_2023-10-04T14-16-15.837949.parquet
  - split: 2023_10_04T14_19_58.918350
    path:
    - results_2023-10-04T14-19-58.918350.parquet
  - split: 2023_10_04T14_24_46.887823
    path:
    - results_2023-10-04T14-24-46.887823.parquet
  - split: 2023_10_04T14_28_26.785854
    path:
    - results_2023-10-04T14-28-26.785854.parquet
  - split: 2023_10_04T14_33_06.913672
    path:
    - results_2023-10-04T14-33-06.913672.parquet
  - split: 2023_10_04T14_36_58.070222
    path:
    - results_2023-10-04T14-36-58.070222.parquet
  - split: 2023_10_04T14_41_37.046791
    path:
    - results_2023-10-04T14-41-37.046791.parquet
  - split: 2023_10_04T14_45_20.150953
    path:
    - results_2023-10-04T14-45-20.150953.parquet
  - split: 2023_10_04T14_50_07.262615
    path:
    - results_2023-10-04T14-50-07.262615.parquet
  - split: 2023_10_04T14_54_26.942710
    path:
    - results_2023-10-04T14-54-26.942710.parquet
  - split: 2023_10_04T14_58_04.139674
    path:
    - results_2023-10-04T14-58-04.139674.parquet
  - split: latest
    path:
    - results_2023-10-04T14-58-04.139674.parquet
---

# Dataset Card for Evaluation run of 2200

## Dataset Description

- **Homepage:** 
- **Repository:** https://huggingface.co/2200
- **Paper:** 
- **Leaderboard:** https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
- **Point of Contact:** clementine@hf.co

### Dataset Summary

Dataset automatically created during the evaluation run of model [2200](https://huggingface.co/2200) on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).

The dataset is composed of 7 configuration, each one coresponding to one of the evaluated task.

The dataset has been created from 122 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.

An additional configuration "results" store all the aggregated results of the run (and is used to compute and display the agregated metrics on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).

To load the details from a run, you can for instance do the following:
```python
from datasets import load_dataset
data = load_dataset("HuggingFaceBR4/thomwolf-40B-tokens-llama-seed-7-1p82G",
	"harness_winogrande_0",
	split="train")
```

## Latest results

These are the [latest results from run 2023-10-04T14:58:04.139674](https://huggingface.co/datasets/HuggingFaceBR4/thomwolf-40B-tokens-llama-seed-7-1p82G/blob/main/2200/results_2023-10-04T14-58-04.139674.json)(note that their might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval):

```python
{
    "all": {
        "acc": 0.4034736197157248,
        "acc_stderr": 0.010961336845565628,
        "acc_norm": 0.38208444366701694,
        "acc_norm_stderr": 0.011634813232460172
    },
    "harness|arc:challenge|0": {
        "acc": 0.18686006825938567,
        "acc_stderr": 0.011391015649694382,
        "acc_norm": 0.23464163822525597,
        "acc_norm_stderr": 0.012383873560768671
    },
    "harness|arc:easy|0": {
        "acc": 0.44907407407407407,
        "acc_stderr": 0.010206428316323362,
        "acc_norm": 0.40025252525252525,
        "acc_norm_stderr": 0.010053550119896108
    },
    "harness|hellaswag|0": {
        "acc": 0.3066122286397132,
        "acc_stderr": 0.004601446124041564,
        "acc_norm": 0.34574785899223265,
        "acc_norm_stderr": 0.004746394613384554
    },
    "harness|openbookqa|0": {
        "acc": 0.168,
        "acc_stderr": 0.01673655354154189,
        "acc_norm": 0.272,
        "acc_norm_stderr": 0.019920483209566065
    },
    "harness|piqa|0": {
        "acc": 0.6599564744287268,
        "acc_stderr": 0.011052749414423548,
        "acc_norm": 0.6577801958650707,
        "acc_norm_stderr": 0.011069764658685456
    },
    "harness|super_glue:boolq|0": {
        "acc": 0.5565749235474006,
        "acc_stderr": 0.008688893661318219
    },
    "harness|winogrande|0": {
        "acc": 0.4972375690607735,
        "acc_stderr": 0.014052271211616441
    }
}
```

### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

[More Information Needed]

## Dataset Structure

### Data Instances

[More Information Needed]

### Data Fields

[More Information Needed]

### Data Splits

[More Information Needed]

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

[More Information Needed]

### Contributions

[More Information Needed]