README.md

metadata

license: mit
datasets: We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs
language:
  - en
  - ko
pipeline_tag: text-generation

Explanation

• With the base model, attached the DPO applied Adapter

Base Model

• TomGrc/FusionNet_7Bx2_MoE_v0.1

Adapter Base Model

• yanolja/KoSOLAR-10.7B-v0.3

Adapter Corpus

• We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs

Score

Average	ARC	HellaSwag	MMLU	TruthfulQA	Winogrande	GSM8K
76.09	73.89	88.94	65.03	71.24	87.61	69.83

Log

• 2024.02.13: Initial version Upload

LICENSE

• MIT