Hugging Face's logo

jkazdan
/
anthropic_dpo_gemma_2_2b_helpsteer2

Safetensors
gemma2
trl
dpo
Generated from Trainer
Model card Files Community
jkazdan commited on
Commit
3b2a3a4
•
1 Parent(s): 54776be

jkazdan/Anthropic/hh-rlhf-dpo-jkazdan/collapse_gemma-2-2b_hs2_iter1_sftsd0

Browse files
Files changed (3) hide show
  1. model-00001-of-00002.safetensors +1 -1
  2. model-00002-of-00002.safetensors +1 -1
  3. training_args.bin +1 -1
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:146cf8bcbc844ff8f755edf876db832278d6470e2bdc77b2e208726d14c5b0c5
3
  size 4988025760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f15e701bbbf57b001703b0c3dda1354bfcb6a58b272ec723b0054879e45e876
3
  size 4988025760
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e92fdfabf70535e60ca8cce06a0435494081ee28599ea6ea8153d43bcd8a17bf
3
  size 240691728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbe715086a284972b3dd32991bb8fc775844b8b7485b2911569727a4c6ce1836
3
  size 240691728
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5aeeaeae07abb3b600721fcff524b926967b4d76b3ab572ce2efe1ab80fb1b7b
3
  size 5944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8172095f0ddd21bd88f8b00c5868a5cf8d7c542d584b4091add06a92dafb85f
3
  size 5944