Edit model card

Model Card for Model ID

329X DPO'd Model. Finetuned off meta-llama/Llama-3.2-1B. Trained for 1 epoch, learning rate=2e-4, batch_size=1.

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for swulee/cs329x-llama-3.2-1B-dpo

Base model

Adapter

(40)

this model