kyujinpy commited on
Commit
00623df
1 Parent(s): 7253c98

Upload 2 files

Browse files
Files changed (2) hide show
  1. Ko-PlatYi.png +0 -0
  2. README.md +57 -0
Ko-PlatYi.png ADDED
README.md CHANGED
@@ -1,3 +1,60 @@
1
  ---
 
 
 
 
 
 
2
  license: cc-by-nc-sa-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - ko
4
+ datasets:
5
+ - kyujinpy/KOR-OpenOrca-Platypus-v3
6
+ library_name: transformers
7
+ pipeline_tag: text-generation
8
  license: cc-by-nc-sa-4.0
9
  ---
10
+
11
+ # **Ko-PlatYi-6B-O**
12
+ <img src='./Ko-PlatYi.png' width=256>
13
+
14
+ ## Model Details
15
+
16
+ **Model Developers** Kyujin Han (kyujinpy)
17
+
18
+ **Input** Models input text only.
19
+
20
+ **Output** Models generate text only.
21
+
22
+ **Model Architecture**
23
+ Ko-PlatYi-6B-O is an auto-regressive language model based on the Yi-34B transformer architecture.
24
+
25
+ **Blog Link**
26
+ Blog: [Coming soon...]
27
+ Github: [Coming soon...]
28
+
29
+ **Base Model**
30
+ [beomi/Yi-Ko-6B](https://huggingface.co/beomi/Yi-Ko-6B)
31
+
32
+ **Training Dataset**
33
+ [kyujinpy/KOR-OpenOrca-Platypus-v3](https://huggingface.co/datasets/kyujinpy/KOR-OpenOrca-Platypus-v3).
34
+
35
+ # **Model Benchmark**
36
+
37
+ ## Open leaderboard
38
+ - Follow up as [link](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
39
+
40
+ | Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | CommonGen-V2 |
41
+ | --- | --- | --- | --- | --- | --- | --- |
42
+ | **Ko-PlatYi-6B-O** | NaN | NaN | NaN | NaN | NaN | NaN |
43
+ | Ko-PlatYi-6B | NaN | NaN | NaN | NaN | NaN | NaN |
44
+ | Yi-Ko-6B | 48.79 | 41.04 | 53.39 | 46.28 | 41.64 | 61.63 |
45
+
46
+ # Implementation Code
47
+ ```python
48
+ ### KO-Platypus
49
+ from transformers import AutoModelForCausalLM, AutoTokenizer
50
+ import torch
51
+
52
+ repo = "kyujinpy/Ko-PlatYi-6B-O"
53
+ OpenOrca = AutoModelForCausalLM.from_pretrained(
54
+ repo,
55
+ return_dict=True,
56
+ torch_dtype=torch.float16,
57
+ device_map='auto'
58
+ )
59
+ OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)
60
+ ```