|
--- |
|
library_name: llamacpp |
|
model_name: Vikhr-Gemma-2B-instruct |
|
base_model: Vikhrmodels/Vikhr-Gemma-2B-instruct |
|
language: |
|
- ru |
|
license: apache-2.0 |
|
tags: |
|
- instruct |
|
datasets: |
|
- Vikhrmodels/GrandMaster-PRO-MAX |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
# 💨 Vikhr-Gemma-2B-instruct |
|
|
|
Мощная инструктивная модель на основе Gemma 2 2B, обученная на русскоязычном датасете GrandMaster-PRO-MAX. |
|
|
|
- [HF model](https://huggingface.co/Vikhrmodels/Vikhr-Gemma-2B-instruct) |
|
|
|
## Perplexity (ниже - лучше) |
|
|
|
### Veles |
|
| Model | Perplexity | |
|
|:--------|:-------------------| |
|
| Q4_K | 4.7254 +/- 0.03867 | |
|
| Q4_0 | 4.8067 +/- 0.03922 | |
|
| Q8_0 | 4.6042 +/- 0.03751 | |
|
| Q4_1 | 4.7798 +/- 0.03933 | |
|
| F32 | 4.6013 +/- 0.03749 | |
|
| Q6_K | 4.6244 +/- 0.03760 | |
|
| BF16 | 4.6015 +/- 0.03749 | |
|
| Q2_K | 5.6819 +/- 0.04737 | |
|
| Q5_0 | 4.6876 +/- 0.03855 | |
|
| Q5_K | 4.6428 +/- 0.03789 | |
|
| Q3_K_S | 5.1485 +/- 0.04257 | |
|
| Q2_K_S | 6.3124 +/- 0.05359 | |
|
| F16 | 4.6013 +/- 0.03749 | |
|
| Q4_K_M | 4.7254 +/- 0.03867 | |
|
| Q5_K_M | 4.6428 +/- 0.03789 | |
|
| Q5_1 | 4.6518 +/- 0.03794 | |
|
| Q4_K_S | 4.7631 +/- 0.03916 | |
|
| Q5_K_S | 4.6509 +/- 0.03803 | |
|
| Q3_K | 4.8339 +/- 0.03965 | |
|
| Q3_K_M | 4.8339 +/- 0.03965 | |
|
| Q3_K_L | 4.7981 +/- 0.03934 | |
|
|
|
### Wikitext-2 |
|
| Model | Perplexity | |
|
|:--------|:--------------------| |
|
| Q4_K | 10.4374 +/- 0.07339 | |
|
| Q4_0 | 10.6480 +/- 0.07452 | |
|
| Q8_0 | 10.1209 +/- 0.07105 | |
|
| Q4_1 | 10.5574 +/- 0.07476 | |
|
| F32 | 10.1191 +/- 0.07099 | |
|
| Q6_K | 10.1503 +/- 0.07117 | |
|
| BF16 | 10.1189 +/- 0.07098 | |
|
| Q2_K | 12.8851 +/- 0.09332 | |
|
| Q5_0 | 10.2551 +/- 0.07251 | |
|
| Q5_K | 10.1975 +/- 0.07184 | |
|
| Q3_K_S | 11.6028 +/- 0.08333 | |
|
| Q2_K_S | 14.7951 +/- 0.10960 | |
|
| F16 | 10.1191 +/- 0.07099 | |
|
| Q4_K_M | 10.4374 +/- 0.07339 | |
|
| Q5_K_M | 10.1975 +/- 0.07184 | |
|
| Q5_1 | 10.2348 +/- 0.07208 | |
|
| Q4_K_S | 10.4924 +/- 0.07386 | |
|
| Q5_K_S | 10.2098 +/- 0.07198 | |
|
| Q3_K | 10.7416 +/- 0.07606 | |
|
| Q3_K_M | 10.7416 +/- 0.07606 | |
|
| Q3_K_L | 10.6242 +/- 0.07506 | |
