File size: 920 Bytes
92dbf79 9ae5d1f 92dbf79 ff40341 92dbf79 a4ed21e 92dbf79 8910085 92dbf79 f99eb9f 92dbf79 f99eb9f 9ae5d1f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
---
datasets:
- microsoft/orca-math-word-problems-200k
license: apache-2.0
---
### Maverick-Math-7B
### Model description
Maverick-Math is a Mistral Fine-tune, on top of math and code datasets and performs very well on benchmarks .
## 🏆 Evaluation
### gsm8k
|Tasks|Version| Filter |n-shot| Metric |Value | |Stderr|
|-----|------:|----------------|-----:|-----------|-----:|---|-----:|
|gsm8k| 3|strict-match | 5|exact_match|0.7331|± |0.0122|
| | |flexible-extract| 5|exact_match|0.7400|± |0.0121|
### mathqa
|Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|------|------:|------|------|--------|-----:|---|-----:|
|mathqa| 1|none |None |acc |0.3591|± |0.0088|
| | |none |None |acc_norm|0.3635|± |0.0088| |