kyujinpy commited on
Commit
d94b814
1 Parent(s): fcb80ce

Upload 2 files

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +50 -0
  3. sakura.png +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ sakura.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,53 @@
1
  ---
 
 
 
 
 
2
  license: cc-by-nc-sa-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ datasets:
5
+ - Intel/orca_dpo_pairs
6
+ pipeline_tag: text-generation
7
  license: cc-by-nc-sa-4.0
8
  ---
9
+
10
+ # **Sakura-SOLRCA-Instruct-DPO**
11
+ <img src='./sakura.png' width=512>
12
+
13
+ ## Model Details
14
+
15
+ **Model Developers** Kyujin Han (kyujinpy)
16
+
17
+ **Method**
18
+ Using DPO method.
19
+ With [Intel/orca_dpo_pairs](https://huggingface.co/datasets/Intel/orca_dpo_pairs).
20
+
21
+ I will share the information about my model. (training and code)
22
+ Please see: ⭐[Sakura-SOLAR(will update)]().
23
+
24
+ # **Model Benchmark**
25
+
26
+ ## Open leaderboard
27
+ - Follow up as [link](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).
28
+
29
+ | Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
30
+ | --- | --- | --- | --- | --- | --- | --- | --- |
31
+ | Sakura-SOLRCA-Instruct-DPO | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
32
+ | Sakura-SOLAR-Instruct-DPO-v2 | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
33
+ | Sakura-SOLAR-Instruct-DPO-v1 | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
34
+ | [kyujinpy/Sakura-SOLAR-Instruct](https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct) | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
35
+
36
+
37
+ # Implementation Code
38
+ ```python
39
+ ### KO-Platypus
40
+ from transformers import AutoModelForCausalLM, AutoTokenizer
41
+ import torch
42
+
43
+ repo = "kyujinpy/Sakura-SOLRCA-Instruct-DPO"
44
+ OpenOrca = AutoModelForCausalLM.from_pretrained(
45
+ repo,
46
+ return_dict=True,
47
+ torch_dtype=torch.float16,
48
+ device_map='auto'
49
+ )
50
+ OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)
51
+ ```
52
+
53
+ ---
sakura.png ADDED

Git LFS Details

  • SHA256: 5a066cccad8d305c4ea9bc00d720c7c487853b2eb4d50c9f879742ecfdb56396
  • Pointer size: 132 Bytes
  • Size of remote file: 1.35 MB