maywell commited on
Commit
c165c0a
โ€ข
1 Parent(s): ee9dd8e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +61 -1
README.md CHANGED
@@ -1,3 +1,63 @@
1
  ---
2
- license: cc-by-sa-4.0
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: other
3
+ license_name: miqu
4
+ language:
5
+ - ko
6
+ - en
7
  ---
8
+
9
+ # **kiqu-70B**
10
+ <img src="./kiqu.webp" alt="kiqu-70B" width="420"/>
11
+
12
+ **kiqu-70B** is a SFT+DPO trained model based on Miqu-70B-Alpaca-DPO using **Korean** datasets.
13
+
14
+ Since this model is finetune of miqu-1-70b using it on commercial purposes is at your own risk. โ€” leaked early version Mistral-Medium
15
+
16
+ ๋ณธ ๋ชจ๋ธ **kiqu-70B**๋Š” Miqu-70B-Alpaca-DPO ๋ชจ๋ธ์„ ๊ธฐ๋ฐ˜์œผ๋กœ **ํ•œ๊ตญ์–ด** ๋ฐ์ดํ„ฐ์…‹์„ ์‚ฌ์šฉํ•˜์—ฌ SFT+DPO ํ›ˆ๋ จ์„ ์ง„ํ–‰ํ•˜์—ฌ ์ œ์ž‘๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
17
+
18
+ ๋ฒ ์ด์Šค ๋ชจ๋ธ์ธ miqu-1-70b ๋ชจ๋ธ์ด ๋ฏธ์ŠคํŠธ๋ž„-๋ฏธ๋””์›€์˜ ์ดˆ๊ธฐ ์œ ์ถœ ๋ฒ„์ „์ด๊ธฐ์— ์ƒ์—…์  ์‚ฌ์šฉ์— ๋Œ€ํ•œ risk๋Š” ๋ณธ์ธ์—๊ฒŒ ์žˆ์Šต๋‹ˆ๋‹ค.
19
+
20
+
21
+ # **Model Details**
22
+
23
+ **Base Model**
24
+ miqu-1-70b (Early Mistral-Medium)
25
+
26
+ **Instruction format**
27
+
28
+ It follows **Mistral** format.
29
+ ```
30
+ <s>[INST] {instruction}
31
+ [/INST] {output}</s>
32
+ ```
33
+
34
+ Multi-shot
35
+ ```
36
+ <s>[INST] {instruction}
37
+ [/INST] {output}</s>
38
+
39
+ [INST] {instruction}
40
+ [/INST] {output}</s>
41
+
42
+ [INST] {instruction}
43
+ [/INST] {output}</s>
44
+ .
45
+ .
46
+ .
47
+ ```
48
+
49
+ # **Model Benchmark**
50
+ TBD
51
+
52
+
53
+ # **Author's Message**
54
+
55
+ This model's training got sponsered by no one but support from people around Earth.
56
+
57
+ [Support Me](https://www.buymeacoffee.com/mwell)
58
+
59
+ [Discord Server](https://discord.gg/MrBt3PXdXc)
60
+
61
+ Contact Me on Discord - is.maywell
62
+
63
+ Follow me on twitter - https://twitter.com/stablefluffy