KaraKaraWitch
commited on
Commit
•
7685168
1
Parent(s):
2316f32
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
# KaraKaraWitch/L3.1-70b-Milasha
|
2 |
|
|
|
|
|
3 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/633e85093a17ab61de8d9073/90ZI1ocoKwQyQXXwHnt_s.png)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model:
|
3 |
+
- Fizzarolli/L3.1-70b-glitz-v0.2
|
4 |
+
- KaraKaraWitch/L3.1-70b-MeowMix2
|
5 |
+
- sophosympatheia/New-Dawn-Llama-3.1-70B-v1.1
|
6 |
+
- nothingiisreal/L3.1-70B-Celeste-V0.1-BF16
|
7 |
+
- Sao10K/L3.1-70B-Hanami-x1
|
8 |
+
tags:
|
9 |
+
- merge
|
10 |
+
- mergekit
|
11 |
+
- lazymergekit
|
12 |
+
- Fizzarolli/L3.1-70b-glitz-v0.2
|
13 |
+
- KaraKaraWitch/L3.1-70b-MeowMix2
|
14 |
+
- sophosympatheia/New-Dawn-Llama-3.1-70B-v1.1
|
15 |
+
- nothingiisreal/L3.1-70B-Celeste-V0.1-BF16
|
16 |
+
- Sao10K/L3.1-70B-Hanami-x1
|
17 |
+
license: cc-by-nc-4.0
|
18 |
+
---
|
19 |
+
|
20 |
# KaraKaraWitch/L3.1-70b-Milasha
|
21 |
|
22 |
+
Milasha is my 3rd and final series with Llama 3.1.
|
23 |
+
|
24 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/633e85093a17ab61de8d9073/90ZI1ocoKwQyQXXwHnt_s.png)
|
25 |
+
|
26 |
+
L3.1-70b-Milasha is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing) running on a server:
|
27 |
+
|
28 |
+
- Fizzarolli/L3.1-70b-glitz-v0.2
|
29 |
+
- KaraKaraWitch/L3.1-70b-MeowMix2
|
30 |
+
- sophosympatheia/New-Dawn-Llama-3.1-70B-v1.1
|
31 |
+
- nothingiisreal/L3.1-70B-Celeste-V0.1-BF16
|
32 |
+
- Sao10K/L3.1-70B-Hanami-x1
|
33 |
+
|
34 |
+
**NOTE**: Following Sao10k's preferences, this model is licenced as cc-by-nc-4.0
|
35 |
+
|
36 |
+
This model kinda returns to tradition of merging the best models. MeowMix was used as language reinforcement for CJK while the rest of the models are more or less from the first in the series.
|
37 |
+
|
38 |
+
## Yap / Chat Format
|
39 |
+
|
40 |
+
Llama 3 Instruct.
|
41 |
+
|
42 |
+
## Thoughts, etc
|
43 |
+
|
44 |
+
As I'm writing this, I'm overseas waiting for beef to arrive at my table. I'll probably finish writing this up properly later.
|
45 |
+
|
46 |
+
This model uses model stock. The rest just refer to the merge config file.
|