Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
shirwu
/
content
like
0
PEFT
Safetensors
trl
dpo
Generated from Trainer
License:
llama3.2
Model card
Files
Files and versions
Community
Use this model
main
content
Commit History
shirwu/dpo-personal-preference-llama3.2-1b-trainer
e0257e3
verified
shirwu
commited on
Oct 19
initial commit
10f9c15
verified
shirwu
commited on
Oct 19