DPO Datasets - a arcee-ai Collection

arcee-ai 's Collections

Medical Model Merges

Gemma-based Merged Models

Mistral-based Merged Models

Legal Mistral Merges

Mistral-SEC-Models

Patent Model Merges

Arcee Data Dump

DPO Datasets

updated Aug 15

arcee-ai/cleaned-distilabel-intel-orca-dpo-pairs-binarized

Viewer • Updated Jun 17 • 5.92k • 40 • 1
arcee-ai/cleaned-ultrafeedback-binarized-avg-rating-for-dpo-filtered

Viewer • Updated Jun 17 • 57.7k • 39
arcee-ai/cleaned-notus-uf-dpo-closest-rejected

Viewer • Updated Jun 17 • 59.2k • 41
arcee-ai/cleaned-OpenHermes2.5-dpo-binarized-alpha

Viewer • Updated Jun 17 • 9.79k • 37 • 1
arcee-ai/cleaned-distilabel-math-preference-dpo

Viewer • Updated Jun 17 • 2.41k • 39
arcee-ai/cleaned-Aya-Aya.23.8B-DPO

Viewer • Updated Jun 18 • 14k • 39
arcee-ai/cleaned-NoRobots-AceGPT.13B.Chat-DPO

Viewer • Updated Jun 18 • 9.5k • 45
arcee-ai/cleaned-NoRobots-SambaLingo.Arabic.Chat-DPO

Viewer • Updated Jun 18 • 9.5k • 42
arcee-ai/cleaned-NoRobots-Aya.23.8B-DPO

Viewer • Updated Jun 18 • 9.5k • 40
arcee-ai/cleaned-Aya-SambaLingo.Arabic.Chat-DPO

Viewer • Updated Jun 18 • 14.2k • 38
arcee-ai/cleaned-Aya-AceGPT.13B.Chat-DPO

Viewer • Updated Jun 18 • 13k • 39
arcee-ai/cleaned-HuggingFaceH4-orca_dpo_pairs_no_system

Viewer • Updated Jul 4 • 12.9k • 41
arcee-ai/cleaned-HuggingFaceH4-orca_dpo_pairs

Viewer • Updated Jun 18 • 12.9k • 37
arcee-ai/cleaned-HuggingFaceH4-ultrafeedback_binarized

Viewer • Updated Jun 18 • 63.1k • 39
arcee-ai/cleaned-jondurbin-truthy-dpo-v0.1

Viewer • Updated Jul 4 • 1.02k • 40
arcee-ai/cleaned-mlabonne-distilabel-intel-orca-dpo-pairs

Viewer • Updated Jun 18 • 5.92k • 38
arcee-ai/cleaned-mlabonne-distilabel-truthy-dpo-v0.1

Viewer • Updated Jun 18 • 1.02k • 37
arcee-ai/cleaned-mlabonne-distilabel-truthy-dpo-v0.1-filtered

Viewer • Updated Jun 18 • 663 • 35
arcee-ai/cleaned-mlabonne-orpo-dpo-mix-40k

Viewer • Updated Jun 18 • 44.2k • 38
arcee-ai/cleaned-mlabonne-truthy-dpo-v0.1

Viewer • Updated Jun 18 • 1.02k • 36
arcee-ai/cleaned-distilabel-capybara-dpo-7k-binarized

Viewer • Updated Jun 18 • 6.57k • 35
arcee-ai/cleaned-orpo-dpo-mix-40k

Viewer • Updated Aug 15 • 43.7k • 48