---
license: apache-2.0
datasets:
- Intel/orca_dpo_pairs
language:
- en
---

Applied DPO to TinyLlama-1.1B-Chat-v1.0 using orca_dpo_pairs dataset