Upload ./Qwen2-7B-Q3_K_S.mmlu.pro.txt with huggingface_hub

Qwen2-7B-Q3_K_S.mmlu.pro.txt

@@ -1,80 +1,2 @@
-multiple_choice_score: there are 70 tasks in prompt
-multiple_choice_score: reading tasks......................................................................done
-multiple_choice_score: preparing task data......................................................................done
-multiple_choice_score : calculating TruthfulQA score over 70 tasks.
-
-task	acc_norm
-1	0.00000000
-2	0.00000000
-3	0.00000000
-4	0.00000000
-5	20.00000000
-6	33.33333333
-7	28.57142857
-8	25.00000000
-9	22.22222222
-10	30.00000000
-11	27.27272727
-12	25.00000000
-13	23.07692308
-14	28.57142857
-15	33.33333333
-16	31.25000000
-17	29.41176471
-18	27.77777778
-19	26.31578947
-20	25.00000000
-21	23.80952381
-22	22.72727273
-23	21.73913043
-24	20.83333333
-25	20.00000000
-26	19.23076923
-27	18.51851852
-28	17.85714286
-29	17.24137931
-30	20.00000000
-31	19.35483871
-32	18.75000000
-33	21.21212121
-34	20.58823529
-35	20.00000000
-36	19.44444444
-37	18.91891892
-38	18.42105263
-39	17.94871795
-40	20.00000000
-41	19.51219512
-42	19.04761905
-43	18.60465116
-44	18.18181818
-45	17.77777778
-46	19.56521739
-47	19.14893617
-48	20.83333333
-49	20.40816327
-50	20.00000000
-51	19.60784314
-52	19.23076923
-53	20.75471698
-54	20.37037037
-55	21.81818182
-56	21.42857143
-57	21.05263158
-58	20.68965517
-59	20.33898305
-60	20.00000000
-61	19.67213115
-62	19.35483871
-63	19.04761905
-64	20.31250000
-65	21.53846154
-66	21.21212121
-67	20.89552239
-68	20.58823529
-69	20.28985507
-70	20.00000000
-
- Final result: 20.0000 +/- 4.8154
-Random chance: 10.0000 +/- 3.6116
-
+multiple_choice_score: there are 12032 tasks in prompt
+multiple_choice_score: reading tasksmultiple_choice_score: failed to read task 1 of 12032