aashish1904 commited on
Commit
b342410
1 Parent(s): 61e9fda

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +52 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+
4
+ license: apache-2.0
5
+ tags:
6
+ - merge
7
+ - mergekit
8
+ - lazymergekit
9
+ - nothingiisreal/MN-12B-Celeste-V1.9
10
+ - elinas/Chronos-Gold-12B-1.0
11
+
12
+ ---
13
+
14
+ ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)
15
+
16
+ # QuantFactory/MN-12B-Chronos-Gold-Celeste-v1-GGUF
17
+ This is quantized version of [ThomasComics/MN-12B-Chronos-Gold-Celeste-v1](https://huggingface.co/ThomasComics/MN-12B-Chronos-Gold-Celeste-v1) created using llama.cpp
18
+
19
+ # Original Model Card
20
+
21
+
22
+ # MN-12B-Chronos-Gold-Celeste-v1
23
+
24
+ MN-12B-Chronos-Gold-Celeste-v1 is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
25
+ * [nothingiisreal/MN-12B-Celeste-V1.9](https://huggingface.co/nothingiisreal/MN-12B-Celeste-V1.9)
26
+ * [elinas/Chronos-Gold-12B-1.0](https://huggingface.co/elinas/Chronos-Gold-12B-1.0)
27
+
28
+ ## 🧩 Configuration
29
+
30
+ ```yaml
31
+ base_model: elinas/Chronos-Gold-12B-1.0
32
+ parameters:
33
+ int8_mask: true
34
+ rescale: true
35
+ normalize: false
36
+ merge_method: della
37
+ dtype: bfloat16
38
+ models:
39
+ - model: nothingiisreal/MN-12B-Celeste-V1.9
40
+ parameters:
41
+ density: [0.4, 0.5, 0.6, 0.4, 0.6, 0.5, 0.4]
42
+ epsilon: [0.15, 0.15, 0.25, 0.15, 0.15]
43
+ lambda: 0.85
44
+ weight: [0.6, 0.5, 0.4, 0.6, 0.4, 0.5, 0.6]
45
+ - model: elinas/Chronos-Gold-12B-1.0
46
+ parameters:
47
+ density: [0.45, 0.55, 0.45, 0.55, 0.45]
48
+ epsilon: [0.1, 0.1, 0.25, 0.1, 0.1]
49
+ lambda: 0.85
50
+ weight: [0.55, 0.45, 0.55, 0.45, 0.55]
51
+
52
+ ```