Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
shirwu
/
content
like
0
PEFT
Safetensors
trl
dpo
Generated from Trainer
License:
llama3.2
Model card
Files
Files and versions
Community
Use this model
main
content
/
sample_data
1 contributor
History:
1 commit
shirwu
shirwu/dpo-personal-preference-llama3.2-1b-trainer
e0257e3
verified
12 days ago
README.md
Safe
962 Bytes
shirwu/dpo-personal-preference-llama3.2-1b-trainer
12 days ago
anscombe.json
Safe
1.7 kB
shirwu/dpo-personal-preference-llama3.2-1b-trainer
12 days ago
california_housing_test.csv
Safe
301 kB
shirwu/dpo-personal-preference-llama3.2-1b-trainer
12 days ago
california_housing_train.csv
Safe
1.71 MB
shirwu/dpo-personal-preference-llama3.2-1b-trainer
12 days ago
mnist_test.csv
Safe
18.3 MB
LFS
shirwu/dpo-personal-preference-llama3.2-1b-trainer
12 days ago
mnist_train_small.csv
Safe
36.5 MB
LFS
shirwu/dpo-personal-preference-llama3.2-1b-trainer
12 days ago