|
--- |
|
datasets: |
|
- microsoft/orca-math-word-problems-200k |
|
license: apache-2.0 |
|
--- |
|
|
|
### Maverick-Math-7B |
|
|
|
### Model description |
|
|
|
Maverick-Maths is a Mistral Fine-tune, on top of math and code datasets and performs very well on benchmarks . |
|
|
|
## 🏆 Evaluation |
|
|
|
### gsm8k |
|
|
|
|Tasks|Version| Filter |n-shot| Metric |Value | |Stderr| |
|
|-----|------:|----------------|-----:|-----------|-----:|---|-----:| |
|
|gsm8k| 3|strict-match | 5|exact_match|0.7331|± |0.0122| |
|
| | |flexible-extract| 5|exact_match|0.7400|± |0.0121| |
|
|
|
### mathqa |
|
|
|
|Tasks |Version|Filter|n-shot| Metric |Value | |Stderr| |
|
|------|------:|------|------|--------|-----:|---|-----:| |
|
|mathqa| 1|none |None |acc |0.3591|± |0.0088| |
|
| | |none |None |acc_norm|0.3635|± |0.0088| |
