Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
374e156
•
1 Parent(s): 2c7d48d

Training in progress, step 400

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:342d2c3c2d6e3347c7827db1189dcfe2257929c09168ef9a55bd17c26d3bc2f1
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:994a6c0441e6918e1417be331aa9ee788835b17ac82e72b248dca827b9ea896e
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3acd0e0fb2dd326c9fbabf2729d1a2eb1dd142ea6724ee2126fe837d07103381
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e29b4ed1d44ac3a841d51a3337069bc6263dd6c4af96d55bdb0fcb9b004e8e97
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16e837ff91edbec2669e2b18412d1bce47fda330bafd9d0b42e403381de9d4cb
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f796939f77fdf81f8f1ceab4232713c0abaeb12d94cd6ca348f3e7cfa298583
3
  size 4540516344