Update README.md
Browse files
README.md
CHANGED
@@ -13,6 +13,12 @@ MoE of the following models by powerful mergekit :
|
|
13 |
* [jeonsworld/CarbonVillain-en-10.7B-v1](https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v1)
|
14 |
|
15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
|
17 |
|
18 |
gpu code example
|
|
|
13 |
* [jeonsworld/CarbonVillain-en-10.7B-v1](https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v1)
|
14 |
|
15 |
|
16 |
+
* Local Test
|
17 |
+
* hf (pretrained=cloudyu/Mixtral_11Bx2_MoE_19B,load_in_8bit=True), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 64
|
18 |
+
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
19 |
+
|---------|-------|------|-----:|--------|-----:|---|-----:|
|
20 |
+
|hellaswag|Yaml |none | 0|acc |0.6911|± |0.0046|
|
21 |
+
| | |none | 0|acc_norm|0.8647|± |0.0034|
|
22 |
|
23 |
|
24 |
gpu code example
|