Commit
•
0eed7b0
1
Parent(s):
6efd01e
Update README.md
Browse files
README.md
CHANGED
|
@@ -99,4 +99,15 @@ print("Response:\n", response)
|
|
| 99 |
|
| 100 |
## Eval
|
| 101 |
|
| 102 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 99 |
|
| 100 |
## Eval
|
| 101 |
|
| 102 |
+
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
| 103 |
+
|----------|-------|------|-----:|--------|-----:|---|-----:|
|
| 104 |
+
|arc_easy |Yaml |none | 0|acc |0.8367|± |0.0076|
|
| 105 |
+
| | |none | 0|acc_norm|0.8169|± |0.0079|
|
| 106 |
+
|boolq |Yaml |none | 0|acc |0.8703|± |0.0059|
|
| 107 |
+
|hellaswag |Yaml |none | 0|acc |0.6452|± |0.0048|
|
| 108 |
+
| | |none | 0|acc_norm|0.8266|± |0.0038|
|
| 109 |
+
|openbookqa|Yaml |none | 0|acc |0.3560|± |0.0214|
|
| 110 |
+
| | |none | 0|acc_norm|0.4740|± |0.0224|
|
| 111 |
+
|piqa |Yaml |none | 0|acc |0.8205|± |0.0090|
|
| 112 |
+
| | |none | 0|acc_norm|0.8297|± |0.0088|
|
| 113 |
+
|winogrande|Yaml |none | 0|acc |0.7403|± |0.0123|
|