Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
shirwu
/
content
like
0
PEFT
Safetensors
trl
dpo
Generated from Trainer
License:
llama3.2
Model card
Files
Files and versions
Community
Use this model
e0257e3
content
/
preference_data.csv
Commit History
shirwu/dpo-personal-preference-llama3.2-1b-trainer
e0257e3
verified
shirwu
commited on
13 days ago