|
--- |
|
license: mit |
|
datasets: We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs |
|
language: |
|
- en |
|
- ko |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
**Explanation** |
|
- With the base model, attached the DPO applied Adapter |
|
|
|
**Base Model** |
|
- [TomGrc/FusionNet_7Bx2_MoE_v0.1](https://huggingface.co/TomGrc/FusionNet_7Bx2_MoE_v0.1) |
|
|
|
**Adapter Base Model** |
|
- [yanolja/KoSOLAR-10.7B-v0.3](https://huggingface.co/yanolja/KoSOLAR-10.7B-v0.3) |
|
|
|
**Adapter Corpus** |
|
- [We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs](https://huggingface.co/datasets/We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs) |
|
|
|
**Score** |
|
|Average|ARC|HellaSwag|MMLU|TruthfulQA|Winogrande|GSM8K| |
|
|:---:|:---:|:---:|:---:|:---:|:---:|:---:| |
|
|76.09|73.89|88.94|65.03|71.24|87.61|69.83| |
|
|
|
**Log** |
|
- 2024.02.13: Initial version Upload |
|
|
|
**LICENSE** |
|
- MIT |
