Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Wandb run: https://wandb.ai/eleutherai/pythia-rlhf/runs/7f9c9lrm
|
| 2 |
+
|
| 3 |
+
Eval Results
|
| 4 |
+
| Tasks |Version|Filter| Metric | Value | |Stderr|
|
| 5 |
+
|--------------|-------|------|----------|------:|---|-----:|
|
| 6 |
+
|arc_challenge |Yaml |none |acc | 0.2201|± |0.0121|
|
| 7 |
+
| | |none |acc_norm | 0.2568|± |0.0128|
|
| 8 |
+
|arc_easy |Yaml |none |acc | 0.5253|± |0.0102|
|
| 9 |
+
| | |none |acc_norm | 0.4558|± |0.0102|
|
| 10 |
+
|lambada_openai|Yaml |none |perplexity|11.3766|± |0.3623|
|
| 11 |
+
| | |none |acc | 0.4844|± |0.0070|
|
| 12 |
+
|logiqa |Yaml |none |acc | 0.2120|± |0.0160|
|
| 13 |
+
| | |none |acc_norm | 0.2780|± |0.0176|
|
| 14 |
+
|piqa |Yaml |none |acc | 0.6817|± |0.0109|
|
| 15 |
+
| | |none |acc_norm | 0.6828|± |0.0109|
|
| 16 |
+
|sciq |Yaml |none |acc | 0.8130|± |0.0123|
|
| 17 |
+
| | |none |acc_norm | 0.7090|± |0.0144|
|
| 18 |
+
|winogrande |Yaml |none |acc | 0.5375|± |0.0140|
|
| 19 |
+
|wsc |Yaml |none |acc | 0.3654|± |0.0474|
|