Augusto777 commited on
Commit
29a0393
1 Parent(s): aa12a09

End of training

Browse files
README.md CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [google/vit-base-patch16-224](https://huggingface.co/google/vit-base-patch16-224) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.0023
21
  - Accuracy: 1.0
22
 
23
  ## Model description
 
17
 
18
  This model is a fine-tuned version of [google/vit-base-patch16-224](https://huggingface.co/google/vit-base-patch16-224) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5660
21
  - Accuracy: 1.0
22
 
23
  ## Model description
all_results.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 39.62,
3
+ "eval_accuracy": 1.0,
4
+ "eval_loss": 0.5660281181335449,
5
+ "eval_runtime": 0.663,
6
+ "eval_samples_per_second": 28.655,
7
+ "eval_steps_per_second": 4.525,
8
+ "train_loss": 0.1023936996057343,
9
+ "train_runtime": 630.9729,
10
+ "train_samples_per_second": 53.061,
11
+ "train_steps_per_second": 3.296
12
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 39.62,
3
+ "eval_accuracy": 1.0,
4
+ "eval_loss": 0.5660281181335449,
5
+ "eval_runtime": 0.663,
6
+ "eval_samples_per_second": 28.655,
7
+ "eval_steps_per_second": 4.525
8
+ }
runs/Aug19_07-29-34_DESKTOP-SKBE9FB/events.out.tfevents.1724074860.DESKTOP-SKBE9FB.7452.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adc6af71cc665f887ad21bf8cd1c44b1fc468b3bdb052ca4abf0b2a649027bc3
3
+ size 411
train_results.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 39.62,
3
+ "train_loss": 0.1023936996057343,
4
+ "train_runtime": 630.9729,
5
+ "train_samples_per_second": 53.061,
6
+ "train_steps_per_second": 3.296
7
+ }
trainer_state.json ADDED
@@ -0,0 +1,1638 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 1.0,
3
+ "best_model_checkpoint": "vit-base-patch16-224-mascotas\\checkpoint-52",
4
+ "epoch": 39.61904761904762,
5
+ "eval_steps": 500,
6
+ "global_step": 2080,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.19,
13
+ "learning_rate": 5.288461538461539e-06,
14
+ "loss": 0.6927,
15
+ "step": 10
16
+ },
17
+ {
18
+ "epoch": 0.38,
19
+ "learning_rate": 1.0576923076923078e-05,
20
+ "loss": 0.6891,
21
+ "step": 20
22
+ },
23
+ {
24
+ "epoch": 0.57,
25
+ "learning_rate": 1.5865384615384613e-05,
26
+ "loss": 0.6783,
27
+ "step": 30
28
+ },
29
+ {
30
+ "epoch": 0.76,
31
+ "learning_rate": 2.1153846153846157e-05,
32
+ "loss": 0.6577,
33
+ "step": 40
34
+ },
35
+ {
36
+ "epoch": 0.95,
37
+ "learning_rate": 2.6442307692307694e-05,
38
+ "loss": 0.6192,
39
+ "step": 50
40
+ },
41
+ {
42
+ "epoch": 0.99,
43
+ "eval_accuracy": 1.0,
44
+ "eval_loss": 0.5660281181335449,
45
+ "eval_runtime": 0.4455,
46
+ "eval_samples_per_second": 42.651,
47
+ "eval_steps_per_second": 6.734,
48
+ "step": 52
49
+ },
50
+ {
51
+ "epoch": 1.14,
52
+ "learning_rate": 3.173076923076923e-05,
53
+ "loss": 0.5503,
54
+ "step": 60
55
+ },
56
+ {
57
+ "epoch": 1.33,
58
+ "learning_rate": 3.701923076923077e-05,
59
+ "loss": 0.4491,
60
+ "step": 70
61
+ },
62
+ {
63
+ "epoch": 1.52,
64
+ "learning_rate": 4.2307692307692314e-05,
65
+ "loss": 0.4092,
66
+ "step": 80
67
+ },
68
+ {
69
+ "epoch": 1.71,
70
+ "learning_rate": 4.759615384615385e-05,
71
+ "loss": 0.3908,
72
+ "step": 90
73
+ },
74
+ {
75
+ "epoch": 1.9,
76
+ "learning_rate": 5.288461538461539e-05,
77
+ "loss": 0.2794,
78
+ "step": 100
79
+ },
80
+ {
81
+ "epoch": 2.0,
82
+ "eval_accuracy": 1.0,
83
+ "eval_loss": 0.15241165459156036,
84
+ "eval_runtime": 0.3561,
85
+ "eval_samples_per_second": 53.359,
86
+ "eval_steps_per_second": 8.425,
87
+ "step": 105
88
+ },
89
+ {
90
+ "epoch": 2.1,
91
+ "learning_rate": 5.4832995951417006e-05,
92
+ "loss": 0.2684,
93
+ "step": 110
94
+ },
95
+ {
96
+ "epoch": 2.29,
97
+ "learning_rate": 5.455465587044535e-05,
98
+ "loss": 0.1892,
99
+ "step": 120
100
+ },
101
+ {
102
+ "epoch": 2.48,
103
+ "learning_rate": 5.4276315789473686e-05,
104
+ "loss": 0.2716,
105
+ "step": 130
106
+ },
107
+ {
108
+ "epoch": 2.67,
109
+ "learning_rate": 5.399797570850203e-05,
110
+ "loss": 0.2146,
111
+ "step": 140
112
+ },
113
+ {
114
+ "epoch": 2.86,
115
+ "learning_rate": 5.3719635627530365e-05,
116
+ "loss": 0.2006,
117
+ "step": 150
118
+ },
119
+ {
120
+ "epoch": 2.99,
121
+ "eval_accuracy": 0.9473684210526315,
122
+ "eval_loss": 0.11429128050804138,
123
+ "eval_runtime": 0.3671,
124
+ "eval_samples_per_second": 51.759,
125
+ "eval_steps_per_second": 8.173,
126
+ "step": 157
127
+ },
128
+ {
129
+ "epoch": 3.05,
130
+ "learning_rate": 5.34412955465587e-05,
131
+ "loss": 0.2683,
132
+ "step": 160
133
+ },
134
+ {
135
+ "epoch": 3.24,
136
+ "learning_rate": 5.3162955465587044e-05,
137
+ "loss": 0.2086,
138
+ "step": 170
139
+ },
140
+ {
141
+ "epoch": 3.43,
142
+ "learning_rate": 5.288461538461539e-05,
143
+ "loss": 0.1823,
144
+ "step": 180
145
+ },
146
+ {
147
+ "epoch": 3.62,
148
+ "learning_rate": 5.2606275303643724e-05,
149
+ "loss": 0.2282,
150
+ "step": 190
151
+ },
152
+ {
153
+ "epoch": 3.81,
154
+ "learning_rate": 5.2327935222672067e-05,
155
+ "loss": 0.2076,
156
+ "step": 200
157
+ },
158
+ {
159
+ "epoch": 4.0,
160
+ "learning_rate": 5.204959514170041e-05,
161
+ "loss": 0.2106,
162
+ "step": 210
163
+ },
164
+ {
165
+ "epoch": 4.0,
166
+ "eval_accuracy": 1.0,
167
+ "eval_loss": 0.050596825778484344,
168
+ "eval_runtime": 0.3601,
169
+ "eval_samples_per_second": 52.766,
170
+ "eval_steps_per_second": 8.331,
171
+ "step": 210
172
+ },
173
+ {
174
+ "epoch": 4.19,
175
+ "learning_rate": 5.1771255060728746e-05,
176
+ "loss": 0.1872,
177
+ "step": 220
178
+ },
179
+ {
180
+ "epoch": 4.38,
181
+ "learning_rate": 5.149291497975709e-05,
182
+ "loss": 0.0983,
183
+ "step": 230
184
+ },
185
+ {
186
+ "epoch": 4.57,
187
+ "learning_rate": 5.1214574898785425e-05,
188
+ "loss": 0.165,
189
+ "step": 240
190
+ },
191
+ {
192
+ "epoch": 4.76,
193
+ "learning_rate": 5.093623481781377e-05,
194
+ "loss": 0.0742,
195
+ "step": 250
196
+ },
197
+ {
198
+ "epoch": 4.95,
199
+ "learning_rate": 5.0657894736842104e-05,
200
+ "loss": 0.1077,
201
+ "step": 260
202
+ },
203
+ {
204
+ "epoch": 4.99,
205
+ "eval_accuracy": 1.0,
206
+ "eval_loss": 0.03385559841990471,
207
+ "eval_runtime": 0.3681,
208
+ "eval_samples_per_second": 51.619,
209
+ "eval_steps_per_second": 8.15,
210
+ "step": 262
211
+ },
212
+ {
213
+ "epoch": 5.14,
214
+ "learning_rate": 5.037955465587045e-05,
215
+ "loss": 0.1099,
216
+ "step": 270
217
+ },
218
+ {
219
+ "epoch": 5.33,
220
+ "learning_rate": 5.010121457489879e-05,
221
+ "loss": 0.1163,
222
+ "step": 280
223
+ },
224
+ {
225
+ "epoch": 5.52,
226
+ "learning_rate": 4.982287449392713e-05,
227
+ "loss": 0.17,
228
+ "step": 290
229
+ },
230
+ {
231
+ "epoch": 5.71,
232
+ "learning_rate": 4.954453441295547e-05,
233
+ "loss": 0.2067,
234
+ "step": 300
235
+ },
236
+ {
237
+ "epoch": 5.9,
238
+ "learning_rate": 4.926619433198381e-05,
239
+ "loss": 0.1379,
240
+ "step": 310
241
+ },
242
+ {
243
+ "epoch": 6.0,
244
+ "eval_accuracy": 0.9473684210526315,
245
+ "eval_loss": 0.13907362520694733,
246
+ "eval_runtime": 0.3581,
247
+ "eval_samples_per_second": 53.061,
248
+ "eval_steps_per_second": 8.378,
249
+ "step": 315
250
+ },
251
+ {
252
+ "epoch": 6.1,
253
+ "learning_rate": 4.898785425101215e-05,
254
+ "loss": 0.0956,
255
+ "step": 320
256
+ },
257
+ {
258
+ "epoch": 6.29,
259
+ "learning_rate": 4.8709514170040485e-05,
260
+ "loss": 0.0764,
261
+ "step": 330
262
+ },
263
+ {
264
+ "epoch": 6.48,
265
+ "learning_rate": 4.843117408906883e-05,
266
+ "loss": 0.106,
267
+ "step": 340
268
+ },
269
+ {
270
+ "epoch": 6.67,
271
+ "learning_rate": 4.8152834008097165e-05,
272
+ "loss": 0.1658,
273
+ "step": 350
274
+ },
275
+ {
276
+ "epoch": 6.86,
277
+ "learning_rate": 4.787449392712551e-05,
278
+ "loss": 0.1387,
279
+ "step": 360
280
+ },
281
+ {
282
+ "epoch": 6.99,
283
+ "eval_accuracy": 0.9473684210526315,
284
+ "eval_loss": 0.07111804187297821,
285
+ "eval_runtime": 0.4206,
286
+ "eval_samples_per_second": 45.173,
287
+ "eval_steps_per_second": 7.133,
288
+ "step": 367
289
+ },
290
+ {
291
+ "epoch": 7.05,
292
+ "learning_rate": 4.759615384615385e-05,
293
+ "loss": 0.1693,
294
+ "step": 370
295
+ },
296
+ {
297
+ "epoch": 7.24,
298
+ "learning_rate": 4.731781376518219e-05,
299
+ "loss": 0.1271,
300
+ "step": 380
301
+ },
302
+ {
303
+ "epoch": 7.43,
304
+ "learning_rate": 4.703947368421053e-05,
305
+ "loss": 0.1374,
306
+ "step": 390
307
+ },
308
+ {
309
+ "epoch": 7.62,
310
+ "learning_rate": 4.676113360323887e-05,
311
+ "loss": 0.0917,
312
+ "step": 400
313
+ },
314
+ {
315
+ "epoch": 7.81,
316
+ "learning_rate": 4.64827935222672e-05,
317
+ "loss": 0.1411,
318
+ "step": 410
319
+ },
320
+ {
321
+ "epoch": 8.0,
322
+ "learning_rate": 4.6204453441295545e-05,
323
+ "loss": 0.1342,
324
+ "step": 420
325
+ },
326
+ {
327
+ "epoch": 8.0,
328
+ "eval_accuracy": 1.0,
329
+ "eval_loss": 0.023148125037550926,
330
+ "eval_runtime": 0.3751,
331
+ "eval_samples_per_second": 50.655,
332
+ "eval_steps_per_second": 7.998,
333
+ "step": 420
334
+ },
335
+ {
336
+ "epoch": 8.19,
337
+ "learning_rate": 4.592611336032389e-05,
338
+ "loss": 0.0993,
339
+ "step": 430
340
+ },
341
+ {
342
+ "epoch": 8.38,
343
+ "learning_rate": 4.5647773279352225e-05,
344
+ "loss": 0.1042,
345
+ "step": 440
346
+ },
347
+ {
348
+ "epoch": 8.57,
349
+ "learning_rate": 4.536943319838057e-05,
350
+ "loss": 0.0635,
351
+ "step": 450
352
+ },
353
+ {
354
+ "epoch": 8.76,
355
+ "learning_rate": 4.509109311740891e-05,
356
+ "loss": 0.1124,
357
+ "step": 460
358
+ },
359
+ {
360
+ "epoch": 8.95,
361
+ "learning_rate": 4.481275303643725e-05,
362
+ "loss": 0.0803,
363
+ "step": 470
364
+ },
365
+ {
366
+ "epoch": 8.99,
367
+ "eval_accuracy": 1.0,
368
+ "eval_loss": 0.047453682869672775,
369
+ "eval_runtime": 0.3711,
370
+ "eval_samples_per_second": 51.201,
371
+ "eval_steps_per_second": 8.084,
372
+ "step": 472
373
+ },
374
+ {
375
+ "epoch": 9.14,
376
+ "learning_rate": 4.453441295546559e-05,
377
+ "loss": 0.1052,
378
+ "step": 480
379
+ },
380
+ {
381
+ "epoch": 9.33,
382
+ "learning_rate": 4.4256072874493926e-05,
383
+ "loss": 0.1562,
384
+ "step": 490
385
+ },
386
+ {
387
+ "epoch": 9.52,
388
+ "learning_rate": 4.397773279352227e-05,
389
+ "loss": 0.1356,
390
+ "step": 500
391
+ },
392
+ {
393
+ "epoch": 9.71,
394
+ "learning_rate": 4.3699392712550606e-05,
395
+ "loss": 0.1523,
396
+ "step": 510
397
+ },
398
+ {
399
+ "epoch": 9.9,
400
+ "learning_rate": 4.342105263157895e-05,
401
+ "loss": 0.097,
402
+ "step": 520
403
+ },
404
+ {
405
+ "epoch": 10.0,
406
+ "eval_accuracy": 1.0,
407
+ "eval_loss": 0.01901022344827652,
408
+ "eval_runtime": 0.3681,
409
+ "eval_samples_per_second": 51.619,
410
+ "eval_steps_per_second": 8.15,
411
+ "step": 525
412
+ },
413
+ {
414
+ "epoch": 10.1,
415
+ "learning_rate": 4.314271255060729e-05,
416
+ "loss": 0.0688,
417
+ "step": 530
418
+ },
419
+ {
420
+ "epoch": 10.29,
421
+ "learning_rate": 4.286437246963563e-05,
422
+ "loss": 0.1178,
423
+ "step": 540
424
+ },
425
+ {
426
+ "epoch": 10.48,
427
+ "learning_rate": 4.258603238866397e-05,
428
+ "loss": 0.0491,
429
+ "step": 550
430
+ },
431
+ {
432
+ "epoch": 10.67,
433
+ "learning_rate": 4.2307692307692314e-05,
434
+ "loss": 0.1043,
435
+ "step": 560
436
+ },
437
+ {
438
+ "epoch": 10.86,
439
+ "learning_rate": 4.202935222672065e-05,
440
+ "loss": 0.0888,
441
+ "step": 570
442
+ },
443
+ {
444
+ "epoch": 10.99,
445
+ "eval_accuracy": 1.0,
446
+ "eval_loss": 0.022018224000930786,
447
+ "eval_runtime": 0.3621,
448
+ "eval_samples_per_second": 52.474,
449
+ "eval_steps_per_second": 8.285,
450
+ "step": 577
451
+ },
452
+ {
453
+ "epoch": 11.05,
454
+ "learning_rate": 4.1751012145748986e-05,
455
+ "loss": 0.0424,
456
+ "step": 580
457
+ },
458
+ {
459
+ "epoch": 11.24,
460
+ "learning_rate": 4.147267206477733e-05,
461
+ "loss": 0.0698,
462
+ "step": 590
463
+ },
464
+ {
465
+ "epoch": 11.43,
466
+ "learning_rate": 4.1194331983805666e-05,
467
+ "loss": 0.0399,
468
+ "step": 600
469
+ },
470
+ {
471
+ "epoch": 11.62,
472
+ "learning_rate": 4.091599190283401e-05,
473
+ "loss": 0.1481,
474
+ "step": 610
475
+ },
476
+ {
477
+ "epoch": 11.81,
478
+ "learning_rate": 4.063765182186235e-05,
479
+ "loss": 0.1183,
480
+ "step": 620
481
+ },
482
+ {
483
+ "epoch": 12.0,
484
+ "learning_rate": 4.035931174089069e-05,
485
+ "loss": 0.0668,
486
+ "step": 630
487
+ },
488
+ {
489
+ "epoch": 12.0,
490
+ "eval_accuracy": 1.0,
491
+ "eval_loss": 0.00784948468208313,
492
+ "eval_runtime": 0.3516,
493
+ "eval_samples_per_second": 54.041,
494
+ "eval_steps_per_second": 8.533,
495
+ "step": 630
496
+ },
497
+ {
498
+ "epoch": 12.19,
499
+ "learning_rate": 4.008097165991903e-05,
500
+ "loss": 0.065,
501
+ "step": 640
502
+ },
503
+ {
504
+ "epoch": 12.38,
505
+ "learning_rate": 3.9802631578947374e-05,
506
+ "loss": 0.0716,
507
+ "step": 650
508
+ },
509
+ {
510
+ "epoch": 12.57,
511
+ "learning_rate": 3.952429149797571e-05,
512
+ "loss": 0.0811,
513
+ "step": 660
514
+ },
515
+ {
516
+ "epoch": 12.76,
517
+ "learning_rate": 3.9245951417004047e-05,
518
+ "loss": 0.1079,
519
+ "step": 670
520
+ },
521
+ {
522
+ "epoch": 12.95,
523
+ "learning_rate": 3.896761133603239e-05,
524
+ "loss": 0.0559,
525
+ "step": 680
526
+ },
527
+ {
528
+ "epoch": 12.99,
529
+ "eval_accuracy": 1.0,
530
+ "eval_loss": 0.007285874802619219,
531
+ "eval_runtime": 0.3904,
532
+ "eval_samples_per_second": 48.668,
533
+ "eval_steps_per_second": 7.684,
534
+ "step": 682
535
+ },
536
+ {
537
+ "epoch": 13.14,
538
+ "learning_rate": 3.8689271255060726e-05,
539
+ "loss": 0.1006,
540
+ "step": 690
541
+ },
542
+ {
543
+ "epoch": 13.33,
544
+ "learning_rate": 3.841093117408907e-05,
545
+ "loss": 0.1479,
546
+ "step": 700
547
+ },
548
+ {
549
+ "epoch": 13.52,
550
+ "learning_rate": 3.813259109311741e-05,
551
+ "loss": 0.0442,
552
+ "step": 710
553
+ },
554
+ {
555
+ "epoch": 13.71,
556
+ "learning_rate": 3.785425101214575e-05,
557
+ "loss": 0.0593,
558
+ "step": 720
559
+ },
560
+ {
561
+ "epoch": 13.9,
562
+ "learning_rate": 3.757591093117409e-05,
563
+ "loss": 0.0759,
564
+ "step": 730
565
+ },
566
+ {
567
+ "epoch": 14.0,
568
+ "eval_accuracy": 1.0,
569
+ "eval_loss": 0.005547249224036932,
570
+ "eval_runtime": 0.3706,
571
+ "eval_samples_per_second": 51.261,
572
+ "eval_steps_per_second": 8.094,
573
+ "step": 735
574
+ },
575
+ {
576
+ "epoch": 14.1,
577
+ "learning_rate": 3.7297570850202434e-05,
578
+ "loss": 0.1361,
579
+ "step": 740
580
+ },
581
+ {
582
+ "epoch": 14.29,
583
+ "learning_rate": 3.701923076923077e-05,
584
+ "loss": 0.087,
585
+ "step": 750
586
+ },
587
+ {
588
+ "epoch": 14.48,
589
+ "learning_rate": 3.674089068825911e-05,
590
+ "loss": 0.0928,
591
+ "step": 760
592
+ },
593
+ {
594
+ "epoch": 14.67,
595
+ "learning_rate": 3.646255060728745e-05,
596
+ "loss": 0.0357,
597
+ "step": 770
598
+ },
599
+ {
600
+ "epoch": 14.86,
601
+ "learning_rate": 3.618421052631579e-05,
602
+ "loss": 0.081,
603
+ "step": 780
604
+ },
605
+ {
606
+ "epoch": 14.99,
607
+ "eval_accuracy": 1.0,
608
+ "eval_loss": 0.005823916289955378,
609
+ "eval_runtime": 0.4351,
610
+ "eval_samples_per_second": 43.668,
611
+ "eval_steps_per_second": 6.895,
612
+ "step": 787
613
+ },
614
+ {
615
+ "epoch": 15.05,
616
+ "learning_rate": 3.590587044534413e-05,
617
+ "loss": 0.1453,
618
+ "step": 790
619
+ },
620
+ {
621
+ "epoch": 15.24,
622
+ "learning_rate": 3.562753036437247e-05,
623
+ "loss": 0.0973,
624
+ "step": 800
625
+ },
626
+ {
627
+ "epoch": 15.43,
628
+ "learning_rate": 3.5349190283400815e-05,
629
+ "loss": 0.0781,
630
+ "step": 810
631
+ },
632
+ {
633
+ "epoch": 15.62,
634
+ "learning_rate": 3.507085020242915e-05,
635
+ "loss": 0.0664,
636
+ "step": 820
637
+ },
638
+ {
639
+ "epoch": 15.81,
640
+ "learning_rate": 3.4792510121457494e-05,
641
+ "loss": 0.1156,
642
+ "step": 830
643
+ },
644
+ {
645
+ "epoch": 16.0,
646
+ "learning_rate": 3.451417004048583e-05,
647
+ "loss": 0.0806,
648
+ "step": 840
649
+ },
650
+ {
651
+ "epoch": 16.0,
652
+ "eval_accuracy": 1.0,
653
+ "eval_loss": 0.010181745514273643,
654
+ "eval_runtime": 0.4006,
655
+ "eval_samples_per_second": 47.428,
656
+ "eval_steps_per_second": 7.489,
657
+ "step": 840
658
+ },
659
+ {
660
+ "epoch": 16.19,
661
+ "learning_rate": 3.423582995951417e-05,
662
+ "loss": 0.0531,
663
+ "step": 850
664
+ },
665
+ {
666
+ "epoch": 16.38,
667
+ "learning_rate": 3.395748987854251e-05,
668
+ "loss": 0.0504,
669
+ "step": 860
670
+ },
671
+ {
672
+ "epoch": 16.57,
673
+ "learning_rate": 3.367914979757085e-05,
674
+ "loss": 0.0892,
675
+ "step": 870
676
+ },
677
+ {
678
+ "epoch": 16.76,
679
+ "learning_rate": 3.340080971659919e-05,
680
+ "loss": 0.0664,
681
+ "step": 880
682
+ },
683
+ {
684
+ "epoch": 16.95,
685
+ "learning_rate": 3.312246963562753e-05,
686
+ "loss": 0.0568,
687
+ "step": 890
688
+ },
689
+ {
690
+ "epoch": 16.99,
691
+ "eval_accuracy": 1.0,
692
+ "eval_loss": 0.01637931726872921,
693
+ "eval_runtime": 0.3491,
694
+ "eval_samples_per_second": 54.429,
695
+ "eval_steps_per_second": 8.594,
696
+ "step": 892
697
+ },
698
+ {
699
+ "epoch": 17.14,
700
+ "learning_rate": 3.2844129554655875e-05,
701
+ "loss": 0.1494,
702
+ "step": 900
703
+ },
704
+ {
705
+ "epoch": 17.33,
706
+ "learning_rate": 3.256578947368421e-05,
707
+ "loss": 0.0428,
708
+ "step": 910
709
+ },
710
+ {
711
+ "epoch": 17.52,
712
+ "learning_rate": 3.2287449392712554e-05,
713
+ "loss": 0.0778,
714
+ "step": 920
715
+ },
716
+ {
717
+ "epoch": 17.71,
718
+ "learning_rate": 3.200910931174089e-05,
719
+ "loss": 0.0495,
720
+ "step": 930
721
+ },
722
+ {
723
+ "epoch": 17.9,
724
+ "learning_rate": 3.173076923076923e-05,
725
+ "loss": 0.0696,
726
+ "step": 940
727
+ },
728
+ {
729
+ "epoch": 18.0,
730
+ "eval_accuracy": 1.0,
731
+ "eval_loss": 0.0049411519430577755,
732
+ "eval_runtime": 0.3741,
733
+ "eval_samples_per_second": 50.791,
734
+ "eval_steps_per_second": 8.02,
735
+ "step": 945
736
+ },
737
+ {
738
+ "epoch": 18.1,
739
+ "learning_rate": 3.145242914979757e-05,
740
+ "loss": 0.0626,
741
+ "step": 950
742
+ },
743
+ {
744
+ "epoch": 18.29,
745
+ "learning_rate": 3.117408906882591e-05,
746
+ "loss": 0.0884,
747
+ "step": 960
748
+ },
749
+ {
750
+ "epoch": 18.48,
751
+ "learning_rate": 3.0895748987854256e-05,
752
+ "loss": 0.1241,
753
+ "step": 970
754
+ },
755
+ {
756
+ "epoch": 18.67,
757
+ "learning_rate": 3.061740890688259e-05,
758
+ "loss": 0.0409,
759
+ "step": 980
760
+ },
761
+ {
762
+ "epoch": 18.86,
763
+ "learning_rate": 3.0339068825910932e-05,
764
+ "loss": 0.0692,
765
+ "step": 990
766
+ },
767
+ {
768
+ "epoch": 18.99,
769
+ "eval_accuracy": 1.0,
770
+ "eval_loss": 0.003958892542868853,
771
+ "eval_runtime": 0.3831,
772
+ "eval_samples_per_second": 49.597,
773
+ "eval_steps_per_second": 7.831,
774
+ "step": 997
775
+ },
776
+ {
777
+ "epoch": 19.05,
778
+ "learning_rate": 3.0060728744939275e-05,
779
+ "loss": 0.0185,
780
+ "step": 1000
781
+ },
782
+ {
783
+ "epoch": 19.24,
784
+ "learning_rate": 2.978238866396761e-05,
785
+ "loss": 0.0174,
786
+ "step": 1010
787
+ },
788
+ {
789
+ "epoch": 19.43,
790
+ "learning_rate": 2.9504048582995954e-05,
791
+ "loss": 0.0471,
792
+ "step": 1020
793
+ },
794
+ {
795
+ "epoch": 19.62,
796
+ "learning_rate": 2.9225708502024294e-05,
797
+ "loss": 0.0385,
798
+ "step": 1030
799
+ },
800
+ {
801
+ "epoch": 19.81,
802
+ "learning_rate": 2.894736842105263e-05,
803
+ "loss": 0.094,
804
+ "step": 1040
805
+ },
806
+ {
807
+ "epoch": 20.0,
808
+ "learning_rate": 2.8669028340080973e-05,
809
+ "loss": 0.0929,
810
+ "step": 1050
811
+ },
812
+ {
813
+ "epoch": 20.0,
814
+ "eval_accuracy": 1.0,
815
+ "eval_loss": 0.003028671257197857,
816
+ "eval_runtime": 0.3701,
817
+ "eval_samples_per_second": 51.34,
818
+ "eval_steps_per_second": 8.106,
819
+ "step": 1050
820
+ },
821
+ {
822
+ "epoch": 20.19,
823
+ "learning_rate": 2.8390688259109316e-05,
824
+ "loss": 0.0612,
825
+ "step": 1060
826
+ },
827
+ {
828
+ "epoch": 20.38,
829
+ "learning_rate": 2.8112348178137652e-05,
830
+ "loss": 0.1051,
831
+ "step": 1070
832
+ },
833
+ {
834
+ "epoch": 20.57,
835
+ "learning_rate": 2.7834008097165992e-05,
836
+ "loss": 0.1134,
837
+ "step": 1080
838
+ },
839
+ {
840
+ "epoch": 20.76,
841
+ "learning_rate": 2.7555668016194335e-05,
842
+ "loss": 0.0729,
843
+ "step": 1090
844
+ },
845
+ {
846
+ "epoch": 20.95,
847
+ "learning_rate": 2.7277327935222675e-05,
848
+ "loss": 0.1169,
849
+ "step": 1100
850
+ },
851
+ {
852
+ "epoch": 20.99,
853
+ "eval_accuracy": 1.0,
854
+ "eval_loss": 0.018264027312397957,
855
+ "eval_runtime": 0.3641,
856
+ "eval_samples_per_second": 52.186,
857
+ "eval_steps_per_second": 8.24,
858
+ "step": 1102
859
+ },
860
+ {
861
+ "epoch": 21.14,
862
+ "learning_rate": 2.6998987854251014e-05,
863
+ "loss": 0.0873,
864
+ "step": 1110
865
+ },
866
+ {
867
+ "epoch": 21.33,
868
+ "learning_rate": 2.672064777327935e-05,
869
+ "loss": 0.0065,
870
+ "step": 1120
871
+ },
872
+ {
873
+ "epoch": 21.52,
874
+ "learning_rate": 2.6442307692307694e-05,
875
+ "loss": 0.0503,
876
+ "step": 1130
877
+ },
878
+ {
879
+ "epoch": 21.71,
880
+ "learning_rate": 2.6163967611336033e-05,
881
+ "loss": 0.0535,
882
+ "step": 1140
883
+ },
884
+ {
885
+ "epoch": 21.9,
886
+ "learning_rate": 2.5885627530364373e-05,
887
+ "loss": 0.0385,
888
+ "step": 1150
889
+ },
890
+ {
891
+ "epoch": 22.0,
892
+ "eval_accuracy": 0.9473684210526315,
893
+ "eval_loss": 0.057639673352241516,
894
+ "eval_runtime": 0.3631,
895
+ "eval_samples_per_second": 52.33,
896
+ "eval_steps_per_second": 8.263,
897
+ "step": 1155
898
+ },
899
+ {
900
+ "epoch": 22.1,
901
+ "learning_rate": 2.5607287449392713e-05,
902
+ "loss": 0.0787,
903
+ "step": 1160
904
+ },
905
+ {
906
+ "epoch": 22.29,
907
+ "learning_rate": 2.5328947368421052e-05,
908
+ "loss": 0.0201,
909
+ "step": 1170
910
+ },
911
+ {
912
+ "epoch": 22.48,
913
+ "learning_rate": 2.5050607287449395e-05,
914
+ "loss": 0.074,
915
+ "step": 1180
916
+ },
917
+ {
918
+ "epoch": 22.67,
919
+ "learning_rate": 2.4772267206477735e-05,
920
+ "loss": 0.0275,
921
+ "step": 1190
922
+ },
923
+ {
924
+ "epoch": 22.86,
925
+ "learning_rate": 2.4493927125506075e-05,
926
+ "loss": 0.0564,
927
+ "step": 1200
928
+ },
929
+ {
930
+ "epoch": 22.99,
931
+ "eval_accuracy": 0.9473684210526315,
932
+ "eval_loss": 0.05121718719601631,
933
+ "eval_runtime": 0.3611,
934
+ "eval_samples_per_second": 52.62,
935
+ "eval_steps_per_second": 8.308,
936
+ "step": 1207
937
+ },
938
+ {
939
+ "epoch": 23.05,
940
+ "learning_rate": 2.4215587044534414e-05,
941
+ "loss": 0.1354,
942
+ "step": 1210
943
+ },
944
+ {
945
+ "epoch": 23.24,
946
+ "learning_rate": 2.3937246963562754e-05,
947
+ "loss": 0.0665,
948
+ "step": 1220
949
+ },
950
+ {
951
+ "epoch": 23.43,
952
+ "learning_rate": 2.3658906882591093e-05,
953
+ "loss": 0.0393,
954
+ "step": 1230
955
+ },
956
+ {
957
+ "epoch": 23.62,
958
+ "learning_rate": 2.3380566801619436e-05,
959
+ "loss": 0.0427,
960
+ "step": 1240
961
+ },
962
+ {
963
+ "epoch": 23.81,
964
+ "learning_rate": 2.3102226720647773e-05,
965
+ "loss": 0.0563,
966
+ "step": 1250
967
+ },
968
+ {
969
+ "epoch": 24.0,
970
+ "learning_rate": 2.2823886639676112e-05,
971
+ "loss": 0.0206,
972
+ "step": 1260
973
+ },
974
+ {
975
+ "epoch": 24.0,
976
+ "eval_accuracy": 1.0,
977
+ "eval_loss": 0.0025241610128432512,
978
+ "eval_runtime": 0.3626,
979
+ "eval_samples_per_second": 52.4,
980
+ "eval_steps_per_second": 8.274,
981
+ "step": 1260
982
+ },
983
+ {
984
+ "epoch": 24.19,
985
+ "learning_rate": 2.2545546558704455e-05,
986
+ "loss": 0.1316,
987
+ "step": 1270
988
+ },
989
+ {
990
+ "epoch": 24.38,
991
+ "learning_rate": 2.2267206477732795e-05,
992
+ "loss": 0.0247,
993
+ "step": 1280
994
+ },
995
+ {
996
+ "epoch": 24.57,
997
+ "learning_rate": 2.1988866396761135e-05,
998
+ "loss": 0.0741,
999
+ "step": 1290
1000
+ },
1001
+ {
1002
+ "epoch": 24.76,
1003
+ "learning_rate": 2.1710526315789474e-05,
1004
+ "loss": 0.0965,
1005
+ "step": 1300
1006
+ },
1007
+ {
1008
+ "epoch": 24.95,
1009
+ "learning_rate": 2.1432186234817814e-05,
1010
+ "loss": 0.0984,
1011
+ "step": 1310
1012
+ },
1013
+ {
1014
+ "epoch": 24.99,
1015
+ "eval_accuracy": 1.0,
1016
+ "eval_loss": 0.002796064130961895,
1017
+ "eval_runtime": 0.3786,
1018
+ "eval_samples_per_second": 50.185,
1019
+ "eval_steps_per_second": 7.924,
1020
+ "step": 1312
1021
+ },
1022
+ {
1023
+ "epoch": 25.14,
1024
+ "learning_rate": 2.1153846153846157e-05,
1025
+ "loss": 0.0943,
1026
+ "step": 1320
1027
+ },
1028
+ {
1029
+ "epoch": 25.33,
1030
+ "learning_rate": 2.0875506072874493e-05,
1031
+ "loss": 0.0701,
1032
+ "step": 1330
1033
+ },
1034
+ {
1035
+ "epoch": 25.52,
1036
+ "learning_rate": 2.0597165991902833e-05,
1037
+ "loss": 0.0542,
1038
+ "step": 1340
1039
+ },
1040
+ {
1041
+ "epoch": 25.71,
1042
+ "learning_rate": 2.0318825910931176e-05,
1043
+ "loss": 0.0756,
1044
+ "step": 1350
1045
+ },
1046
+ {
1047
+ "epoch": 25.9,
1048
+ "learning_rate": 2.0040485829959516e-05,
1049
+ "loss": 0.0368,
1050
+ "step": 1360
1051
+ },
1052
+ {
1053
+ "epoch": 26.0,
1054
+ "eval_accuracy": 1.0,
1055
+ "eval_loss": 0.003676516469568014,
1056
+ "eval_runtime": 0.3821,
1057
+ "eval_samples_per_second": 49.727,
1058
+ "eval_steps_per_second": 7.852,
1059
+ "step": 1365
1060
+ },
1061
+ {
1062
+ "epoch": 26.1,
1063
+ "learning_rate": 1.9762145748987855e-05,
1064
+ "loss": 0.0547,
1065
+ "step": 1370
1066
+ },
1067
+ {
1068
+ "epoch": 26.29,
1069
+ "learning_rate": 1.9483805668016195e-05,
1070
+ "loss": 0.0563,
1071
+ "step": 1380
1072
+ },
1073
+ {
1074
+ "epoch": 26.48,
1075
+ "learning_rate": 1.9205465587044534e-05,
1076
+ "loss": 0.0399,
1077
+ "step": 1390
1078
+ },
1079
+ {
1080
+ "epoch": 26.67,
1081
+ "learning_rate": 1.8927125506072874e-05,
1082
+ "loss": 0.0499,
1083
+ "step": 1400
1084
+ },
1085
+ {
1086
+ "epoch": 26.86,
1087
+ "learning_rate": 1.8648785425101217e-05,
1088
+ "loss": 0.0436,
1089
+ "step": 1410
1090
+ },
1091
+ {
1092
+ "epoch": 26.99,
1093
+ "eval_accuracy": 0.9473684210526315,
1094
+ "eval_loss": 0.06093175709247589,
1095
+ "eval_runtime": 0.3641,
1096
+ "eval_samples_per_second": 52.186,
1097
+ "eval_steps_per_second": 8.24,
1098
+ "step": 1417
1099
+ },
1100
+ {
1101
+ "epoch": 27.05,
1102
+ "learning_rate": 1.8370445344129553e-05,
1103
+ "loss": 0.1086,
1104
+ "step": 1420
1105
+ },
1106
+ {
1107
+ "epoch": 27.24,
1108
+ "learning_rate": 1.8092105263157896e-05,
1109
+ "loss": 0.0425,
1110
+ "step": 1430
1111
+ },
1112
+ {
1113
+ "epoch": 27.43,
1114
+ "learning_rate": 1.7813765182186236e-05,
1115
+ "loss": 0.0399,
1116
+ "step": 1440
1117
+ },
1118
+ {
1119
+ "epoch": 27.62,
1120
+ "learning_rate": 1.7535425101214576e-05,
1121
+ "loss": 0.0438,
1122
+ "step": 1450
1123
+ },
1124
+ {
1125
+ "epoch": 27.81,
1126
+ "learning_rate": 1.7257085020242915e-05,
1127
+ "loss": 0.0419,
1128
+ "step": 1460
1129
+ },
1130
+ {
1131
+ "epoch": 28.0,
1132
+ "learning_rate": 1.6978744939271255e-05,
1133
+ "loss": 0.0896,
1134
+ "step": 1470
1135
+ },
1136
+ {
1137
+ "epoch": 28.0,
1138
+ "eval_accuracy": 1.0,
1139
+ "eval_loss": 0.01538935024291277,
1140
+ "eval_runtime": 0.3706,
1141
+ "eval_samples_per_second": 51.27,
1142
+ "eval_steps_per_second": 8.095,
1143
+ "step": 1470
1144
+ },
1145
+ {
1146
+ "epoch": 28.19,
1147
+ "learning_rate": 1.6700404858299595e-05,
1148
+ "loss": 0.0483,
1149
+ "step": 1480
1150
+ },
1151
+ {
1152
+ "epoch": 28.38,
1153
+ "learning_rate": 1.6422064777327938e-05,
1154
+ "loss": 0.0589,
1155
+ "step": 1490
1156
+ },
1157
+ {
1158
+ "epoch": 28.57,
1159
+ "learning_rate": 1.6143724696356277e-05,
1160
+ "loss": 0.0708,
1161
+ "step": 1500
1162
+ },
1163
+ {
1164
+ "epoch": 28.76,
1165
+ "learning_rate": 1.5865384615384613e-05,
1166
+ "loss": 0.062,
1167
+ "step": 1510
1168
+ },
1169
+ {
1170
+ "epoch": 28.95,
1171
+ "learning_rate": 1.5587044534412957e-05,
1172
+ "loss": 0.079,
1173
+ "step": 1520
1174
+ },
1175
+ {
1176
+ "epoch": 28.99,
1177
+ "eval_accuracy": 1.0,
1178
+ "eval_loss": 0.0026065746787935495,
1179
+ "eval_runtime": 0.3741,
1180
+ "eval_samples_per_second": 50.791,
1181
+ "eval_steps_per_second": 8.02,
1182
+ "step": 1522
1183
+ },
1184
+ {
1185
+ "epoch": 29.14,
1186
+ "learning_rate": 1.5308704453441296e-05,
1187
+ "loss": 0.0246,
1188
+ "step": 1530
1189
+ },
1190
+ {
1191
+ "epoch": 29.33,
1192
+ "learning_rate": 1.5030364372469637e-05,
1193
+ "loss": 0.0735,
1194
+ "step": 1540
1195
+ },
1196
+ {
1197
+ "epoch": 29.52,
1198
+ "learning_rate": 1.4752024291497977e-05,
1199
+ "loss": 0.0644,
1200
+ "step": 1550
1201
+ },
1202
+ {
1203
+ "epoch": 29.71,
1204
+ "learning_rate": 1.4473684210526315e-05,
1205
+ "loss": 0.0536,
1206
+ "step": 1560
1207
+ },
1208
+ {
1209
+ "epoch": 29.9,
1210
+ "learning_rate": 1.4195344129554658e-05,
1211
+ "loss": 0.0211,
1212
+ "step": 1570
1213
+ },
1214
+ {
1215
+ "epoch": 30.0,
1216
+ "eval_accuracy": 1.0,
1217
+ "eval_loss": 0.004464460536837578,
1218
+ "eval_runtime": 0.3691,
1219
+ "eval_samples_per_second": 51.479,
1220
+ "eval_steps_per_second": 8.128,
1221
+ "step": 1575
1222
+ },
1223
+ {
1224
+ "epoch": 30.1,
1225
+ "learning_rate": 1.3917004048582996e-05,
1226
+ "loss": 0.0095,
1227
+ "step": 1580
1228
+ },
1229
+ {
1230
+ "epoch": 30.29,
1231
+ "learning_rate": 1.3638663967611337e-05,
1232
+ "loss": 0.019,
1233
+ "step": 1590
1234
+ },
1235
+ {
1236
+ "epoch": 30.48,
1237
+ "learning_rate": 1.3360323886639675e-05,
1238
+ "loss": 0.0278,
1239
+ "step": 1600
1240
+ },
1241
+ {
1242
+ "epoch": 30.67,
1243
+ "learning_rate": 1.3081983805668017e-05,
1244
+ "loss": 0.0514,
1245
+ "step": 1610
1246
+ },
1247
+ {
1248
+ "epoch": 30.86,
1249
+ "learning_rate": 1.2803643724696356e-05,
1250
+ "loss": 0.0499,
1251
+ "step": 1620
1252
+ },
1253
+ {
1254
+ "epoch": 30.99,
1255
+ "eval_accuracy": 1.0,
1256
+ "eval_loss": 0.004182770382612944,
1257
+ "eval_runtime": 0.3758,
1258
+ "eval_samples_per_second": 50.56,
1259
+ "eval_steps_per_second": 7.983,
1260
+ "step": 1627
1261
+ },
1262
+ {
1263
+ "epoch": 31.05,
1264
+ "learning_rate": 1.2525303643724698e-05,
1265
+ "loss": 0.0344,
1266
+ "step": 1630
1267
+ },
1268
+ {
1269
+ "epoch": 31.24,
1270
+ "learning_rate": 1.2246963562753037e-05,
1271
+ "loss": 0.0442,
1272
+ "step": 1640
1273
+ },
1274
+ {
1275
+ "epoch": 31.43,
1276
+ "learning_rate": 1.1968623481781377e-05,
1277
+ "loss": 0.0602,
1278
+ "step": 1650
1279
+ },
1280
+ {
1281
+ "epoch": 31.62,
1282
+ "learning_rate": 1.1690283400809718e-05,
1283
+ "loss": 0.0516,
1284
+ "step": 1660
1285
+ },
1286
+ {
1287
+ "epoch": 31.81,
1288
+ "learning_rate": 1.1411943319838056e-05,
1289
+ "loss": 0.0129,
1290
+ "step": 1670
1291
+ },
1292
+ {
1293
+ "epoch": 32.0,
1294
+ "learning_rate": 1.1133603238866398e-05,
1295
+ "loss": 0.0137,
1296
+ "step": 1680
1297
+ },
1298
+ {
1299
+ "epoch": 32.0,
1300
+ "eval_accuracy": 1.0,
1301
+ "eval_loss": 0.004318131599575281,
1302
+ "eval_runtime": 0.3645,
1303
+ "eval_samples_per_second": 52.132,
1304
+ "eval_steps_per_second": 8.231,
1305
+ "step": 1680
1306
+ },
1307
+ {
1308
+ "epoch": 32.19,
1309
+ "learning_rate": 1.0855263157894737e-05,
1310
+ "loss": 0.02,
1311
+ "step": 1690
1312
+ },
1313
+ {
1314
+ "epoch": 32.38,
1315
+ "learning_rate": 1.0576923076923078e-05,
1316
+ "loss": 0.0315,
1317
+ "step": 1700
1318
+ },
1319
+ {
1320
+ "epoch": 32.57,
1321
+ "learning_rate": 1.0298582995951416e-05,
1322
+ "loss": 0.0187,
1323
+ "step": 1710
1324
+ },
1325
+ {
1326
+ "epoch": 32.76,
1327
+ "learning_rate": 1.0020242914979758e-05,
1328
+ "loss": 0.0326,
1329
+ "step": 1720
1330
+ },
1331
+ {
1332
+ "epoch": 32.95,
1333
+ "learning_rate": 9.741902834008097e-06,
1334
+ "loss": 0.0711,
1335
+ "step": 1730
1336
+ },
1337
+ {
1338
+ "epoch": 32.99,
1339
+ "eval_accuracy": 1.0,
1340
+ "eval_loss": 0.0019276138627901673,
1341
+ "eval_runtime": 0.3721,
1342
+ "eval_samples_per_second": 51.064,
1343
+ "eval_steps_per_second": 8.063,
1344
+ "step": 1732
1345
+ },
1346
+ {
1347
+ "epoch": 33.14,
1348
+ "learning_rate": 9.463562753036437e-06,
1349
+ "loss": 0.0639,
1350
+ "step": 1740
1351
+ },
1352
+ {
1353
+ "epoch": 33.33,
1354
+ "learning_rate": 9.185222672064777e-06,
1355
+ "loss": 0.0381,
1356
+ "step": 1750
1357
+ },
1358
+ {
1359
+ "epoch": 33.52,
1360
+ "learning_rate": 8.906882591093118e-06,
1361
+ "loss": 0.0217,
1362
+ "step": 1760
1363
+ },
1364
+ {
1365
+ "epoch": 33.71,
1366
+ "learning_rate": 8.628542510121458e-06,
1367
+ "loss": 0.024,
1368
+ "step": 1770
1369
+ },
1370
+ {
1371
+ "epoch": 33.9,
1372
+ "learning_rate": 8.350202429149797e-06,
1373
+ "loss": 0.0369,
1374
+ "step": 1780
1375
+ },
1376
+ {
1377
+ "epoch": 34.0,
1378
+ "eval_accuracy": 1.0,
1379
+ "eval_loss": 0.002073986455798149,
1380
+ "eval_runtime": 0.3691,
1381
+ "eval_samples_per_second": 51.479,
1382
+ "eval_steps_per_second": 8.128,
1383
+ "step": 1785
1384
+ },
1385
+ {
1386
+ "epoch": 34.1,
1387
+ "learning_rate": 8.071862348178139e-06,
1388
+ "loss": 0.0355,
1389
+ "step": 1790
1390
+ },
1391
+ {
1392
+ "epoch": 34.29,
1393
+ "learning_rate": 7.793522267206478e-06,
1394
+ "loss": 0.0566,
1395
+ "step": 1800
1396
+ },
1397
+ {
1398
+ "epoch": 34.48,
1399
+ "learning_rate": 7.515182186234819e-06,
1400
+ "loss": 0.0605,
1401
+ "step": 1810
1402
+ },
1403
+ {
1404
+ "epoch": 34.67,
1405
+ "learning_rate": 7.2368421052631575e-06,
1406
+ "loss": 0.0283,
1407
+ "step": 1820
1408
+ },
1409
+ {
1410
+ "epoch": 34.86,
1411
+ "learning_rate": 6.958502024291498e-06,
1412
+ "loss": 0.0382,
1413
+ "step": 1830
1414
+ },
1415
+ {
1416
+ "epoch": 34.99,
1417
+ "eval_accuracy": 1.0,
1418
+ "eval_loss": 0.0030744802206754684,
1419
+ "eval_runtime": 0.3811,
1420
+ "eval_samples_per_second": 49.857,
1421
+ "eval_steps_per_second": 7.872,
1422
+ "step": 1837
1423
+ },
1424
+ {
1425
+ "epoch": 35.05,
1426
+ "learning_rate": 6.680161943319838e-06,
1427
+ "loss": 0.0175,
1428
+ "step": 1840
1429
+ },
1430
+ {
1431
+ "epoch": 35.24,
1432
+ "learning_rate": 6.401821862348178e-06,
1433
+ "loss": 0.0406,
1434
+ "step": 1850
1435
+ },
1436
+ {
1437
+ "epoch": 35.43,
1438
+ "learning_rate": 6.123481781376519e-06,
1439
+ "loss": 0.0337,
1440
+ "step": 1860
1441
+ },
1442
+ {
1443
+ "epoch": 35.62,
1444
+ "learning_rate": 5.845141700404859e-06,
1445
+ "loss": 0.0293,
1446
+ "step": 1870
1447
+ },
1448
+ {
1449
+ "epoch": 35.81,
1450
+ "learning_rate": 5.566801619433199e-06,
1451
+ "loss": 0.0492,
1452
+ "step": 1880
1453
+ },
1454
+ {
1455
+ "epoch": 36.0,
1456
+ "learning_rate": 5.288461538461539e-06,
1457
+ "loss": 0.0785,
1458
+ "step": 1890
1459
+ },
1460
+ {
1461
+ "epoch": 36.0,
1462
+ "eval_accuracy": 1.0,
1463
+ "eval_loss": 0.002902696607634425,
1464
+ "eval_runtime": 0.3681,
1465
+ "eval_samples_per_second": 51.619,
1466
+ "eval_steps_per_second": 8.15,
1467
+ "step": 1890
1468
+ },
1469
+ {
1470
+ "epoch": 36.19,
1471
+ "learning_rate": 5.010121457489879e-06,
1472
+ "loss": 0.0444,
1473
+ "step": 1900
1474
+ },
1475
+ {
1476
+ "epoch": 36.38,
1477
+ "learning_rate": 4.7317813765182185e-06,
1478
+ "loss": 0.0211,
1479
+ "step": 1910
1480
+ },
1481
+ {
1482
+ "epoch": 36.57,
1483
+ "learning_rate": 4.453441295546559e-06,
1484
+ "loss": 0.055,
1485
+ "step": 1920
1486
+ },
1487
+ {
1488
+ "epoch": 36.76,
1489
+ "learning_rate": 4.175101214574899e-06,
1490
+ "loss": 0.1123,
1491
+ "step": 1930
1492
+ },
1493
+ {
1494
+ "epoch": 36.95,
1495
+ "learning_rate": 3.896761133603239e-06,
1496
+ "loss": 0.0575,
1497
+ "step": 1940
1498
+ },
1499
+ {
1500
+ "epoch": 36.99,
1501
+ "eval_accuracy": 1.0,
1502
+ "eval_loss": 0.00197758455760777,
1503
+ "eval_runtime": 0.3731,
1504
+ "eval_samples_per_second": 50.927,
1505
+ "eval_steps_per_second": 8.041,
1506
+ "step": 1942
1507
+ },
1508
+ {
1509
+ "epoch": 37.14,
1510
+ "learning_rate": 3.6184210526315788e-06,
1511
+ "loss": 0.0501,
1512
+ "step": 1950
1513
+ },
1514
+ {
1515
+ "epoch": 37.33,
1516
+ "learning_rate": 3.340080971659919e-06,
1517
+ "loss": 0.0605,
1518
+ "step": 1960
1519
+ },
1520
+ {
1521
+ "epoch": 37.52,
1522
+ "learning_rate": 3.0617408906882593e-06,
1523
+ "loss": 0.084,
1524
+ "step": 1970
1525
+ },
1526
+ {
1527
+ "epoch": 37.71,
1528
+ "learning_rate": 2.7834008097165994e-06,
1529
+ "loss": 0.1135,
1530
+ "step": 1980
1531
+ },
1532
+ {
1533
+ "epoch": 37.9,
1534
+ "learning_rate": 2.5050607287449394e-06,
1535
+ "loss": 0.0158,
1536
+ "step": 1990
1537
+ },
1538
+ {
1539
+ "epoch": 38.0,
1540
+ "eval_accuracy": 1.0,
1541
+ "eval_loss": 0.0019377493299543858,
1542
+ "eval_runtime": 0.3741,
1543
+ "eval_samples_per_second": 50.791,
1544
+ "eval_steps_per_second": 8.02,
1545
+ "step": 1995
1546
+ },
1547
+ {
1548
+ "epoch": 38.1,
1549
+ "learning_rate": 2.2267206477732795e-06,
1550
+ "loss": 0.0538,
1551
+ "step": 2000
1552
+ },
1553
+ {
1554
+ "epoch": 38.29,
1555
+ "learning_rate": 1.9483805668016196e-06,
1556
+ "loss": 0.0355,
1557
+ "step": 2010
1558
+ },
1559
+ {
1560
+ "epoch": 38.48,
1561
+ "learning_rate": 1.6700404858299594e-06,
1562
+ "loss": 0.011,
1563
+ "step": 2020
1564
+ },
1565
+ {
1566
+ "epoch": 38.67,
1567
+ "learning_rate": 1.3917004048582997e-06,
1568
+ "loss": 0.0291,
1569
+ "step": 2030
1570
+ },
1571
+ {
1572
+ "epoch": 38.86,
1573
+ "learning_rate": 1.1133603238866398e-06,
1574
+ "loss": 0.0489,
1575
+ "step": 2040
1576
+ },
1577
+ {
1578
+ "epoch": 38.99,
1579
+ "eval_accuracy": 1.0,
1580
+ "eval_loss": 0.002249736338853836,
1581
+ "eval_runtime": 0.3774,
1582
+ "eval_samples_per_second": 50.345,
1583
+ "eval_steps_per_second": 7.949,
1584
+ "step": 2047
1585
+ },
1586
+ {
1587
+ "epoch": 39.05,
1588
+ "learning_rate": 8.350202429149797e-07,
1589
+ "loss": 0.0618,
1590
+ "step": 2050
1591
+ },
1592
+ {
1593
+ "epoch": 39.24,
1594
+ "learning_rate": 5.566801619433199e-07,
1595
+ "loss": 0.043,
1596
+ "step": 2060
1597
+ },
1598
+ {
1599
+ "epoch": 39.43,
1600
+ "learning_rate": 2.7834008097165994e-07,
1601
+ "loss": 0.036,
1602
+ "step": 2070
1603
+ },
1604
+ {
1605
+ "epoch": 39.62,
1606
+ "learning_rate": 0.0,
1607
+ "loss": 0.0511,
1608
+ "step": 2080
1609
+ },
1610
+ {
1611
+ "epoch": 39.62,
1612
+ "eval_accuracy": 1.0,
1613
+ "eval_loss": 0.0023234980180859566,
1614
+ "eval_runtime": 0.3844,
1615
+ "eval_samples_per_second": 49.422,
1616
+ "eval_steps_per_second": 7.804,
1617
+ "step": 2080
1618
+ },
1619
+ {
1620
+ "epoch": 39.62,
1621
+ "step": 2080,
1622
+ "total_flos": 2.5698668515887145e+18,
1623
+ "train_loss": 0.1023936996057343,
1624
+ "train_runtime": 630.9729,
1625
+ "train_samples_per_second": 53.061,
1626
+ "train_steps_per_second": 3.296
1627
+ }
1628
+ ],
1629
+ "logging_steps": 10,
1630
+ "max_steps": 2080,
1631
+ "num_input_tokens_seen": 0,
1632
+ "num_train_epochs": 40,
1633
+ "save_steps": 500,
1634
+ "total_flos": 2.5698668515887145e+18,
1635
+ "train_batch_size": 8,
1636
+ "trial_name": null,
1637
+ "trial_params": null
1638
+ }