metadata
datasets:
- microsoft/orca-math-word-problems-200k
license: apache-2.0
Maverick-Math-7B
Model description
Maverick-Math is a Mistral Fine-tune, on top of math and code datasets and performs very well on benchmarks .
🏆 Evaluation
gsm8k
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| gsm8k | 3 | strict-match | 5 | exact_match | 0.7331 | ± | 0.0122 |
| flexible-extract | 5 | exact_match | 0.7400 | ± | 0.0121 |
mathqa
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| mathqa | 1 | none | None | acc | 0.3591 | ± | 0.0088 |
| none | None | acc_norm | 0.3635 | ± | 0.0088 |