Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
shirwu
/
content
like
0
PEFT
Safetensors
trl
dpo
Generated from Trainer
License:
llama3.2
Model card
Files
Files and versions
Community
Use this model
e0257e3
content
/
.config
/
default_configs.db
shirwu
shirwu/dpo-personal-preference-llama3.2-1b-trainer
e0257e3
verified
13 days ago
download
Copy download link
history
Safe
12.3 kB
This file contains binary data. It cannot be displayed, but you can still
download
it.