|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- celsowm/auryn_dpo_orpo_english |
|
language: |
|
- en |
|
base_model: |
|
- meta-llama/Llama-3.2-1B |
|
tags: |
|
- orpo |
|
--- |
|
# auryn_dpo_orpo_english |
|
|
|
This is a ORPO fine-tune of meta-llama/Llama-3.2-1b trained on three epochs of https://huggingface.co/datasets/celsowm/auryn_dpo_orpo_english |
|
|
|
Auryn is a fictional place intended to serve as a proof of concept for injecting knowledge into a large language model using ORPO. |
|
|
|
Tutorial here: https://medium.com/@celsoaf/injecting-new-knowledge-into-an-llm-via-fine-tuning-with-orpo-017d3bfdb11b |
