metadata
license: apache-2.0
datasets:
- microsoft/orca-math-word-problems-200k
#todo : update the model card
Running benchmarks rn
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| hellaswag | 1 | none | None | acc | 0.5536 | ± | 0.0050 |
| none | None | acc_norm | 0.7294 | ± | 0.0044 |