#todo : update the model card
Running benchmarks rn
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| hellaswag | 1 | none | None | acc | 0.5536 | ± | 0.0050 |
| none | None | acc_norm | 0.7294 | ± | 0.0044 |
- Downloads last month
- 187
Inference API (serverless) is not available, repository is disabled.