metadata
license: mit
language:
- en
CarbonVillain
This model is an experimental version created using mergekit.
- merge models
- Weyaxi/SauerkrautLM-UNA-SOLAR-Instruct
- VAGOsolutions/SauerkrautLM-SOLAR-Instruct
- method: slerp
This model is the same as CarbonVillain-en-13B-v1 and was registered twice due to my mistake.
Prompt Template(s)
### User:
{user}
### Assistant:
{asistant}
Evaluation
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.27 |
| ARC (25-shot) | 71.24 |
| HellaSwag (10-shot) | 88.45 |
| MMLU (5-shot) | 66.42 |
| TruthfulQA (0-shot) | 71.97 |
| Winogrande (5-shot) | 83.26 |
| GSM8K (5-shot) | 64.29 |