swulee's picture
Update README.md
12b0112 verified
---
base_model: meta-llama/Llama-3.2-1B
library_name: peft
---
# Model Card for Model ID
329X DPO'd Model. Finetuned off meta-llama/Llama-3.2-1B. Trained for 1 epoch, learning rate=2e-4, batch_size=1.
- PEFT 0.10.0