cloudyu commited on
Commit
1b28e29
1 Parent(s): 73ff794

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -13,6 +13,12 @@ MoE of the following models by powerful mergekit :
13
  * [jeonsworld/CarbonVillain-en-10.7B-v1](https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v1)
14
 
15
 
 
 
 
 
 
 
16
 
17
 
18
  gpu code example
 
13
  * [jeonsworld/CarbonVillain-en-10.7B-v1](https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v1)
14
 
15
 
16
+ * Local Test
17
+ * hf (pretrained=cloudyu/Mixtral_11Bx2_MoE_19B,load_in_8bit=True), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 64
18
+ | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
19
+ |---------|-------|------|-----:|--------|-----:|---|-----:|
20
+ |hellaswag|Yaml |none | 0|acc |0.6911|± |0.0046|
21
+ | | |none | 0|acc_norm|0.8647|± |0.0034|
22
 
23
 
24
  gpu code example