kevinzyz commited on
Commit
2714d4c
1 Parent(s): da7a6e6

Training in progress, epoch 1

Browse files
all_results.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 5.0,
3
+ "eval_accuracy": 0.1940000057220459,
4
+ "eval_loss": 3.9567816257476807,
5
+ "eval_runtime": 3.1838,
6
+ "eval_samples": 500,
7
+ "eval_samples_per_second": 157.047,
8
+ "eval_steps_per_second": 5.025,
9
+ "train_loss": 0.06812760998129988,
10
+ "train_runtime": 4390.0209,
11
+ "train_samples": 44000,
12
+ "train_samples_per_second": 50.114,
13
+ "train_steps_per_second": 1.566
14
+ }
eval_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 5.0,
3
+ "eval_accuracy": 0.1940000057220459,
4
+ "eval_loss": 3.9567816257476807,
5
+ "eval_runtime": 3.1838,
6
+ "eval_samples": 500,
7
+ "eval_samples_per_second": 157.047,
8
+ "eval_steps_per_second": 5.025
9
+ }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:23f3974bec739a11a45f6fd17911f6342083bc9d61e05f03eab7804d2f80a517
3
  size 409163017
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99b9a868425d1e801e4254c15e16760d14b51e3c5d20ed2298d7254f770052fe
3
  size 409163017
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 5.0,
3
+ "train_loss": 0.06812760998129988,
4
+ "train_runtime": 4390.0209,
5
+ "train_samples": 44000,
6
+ "train_samples_per_second": 50.114,
7
+ "train_steps_per_second": 1.566
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,2128 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 3.9567816257476807,
3
+ "best_model_checkpoint": "chinese-roberta-wwm-ext-finetuned-MC-hyper/checkpoint-1375",
4
+ "epoch": 5.0,
5
+ "global_step": 6875,
6
+ "is_hyper_param_search": false,
7
+ "is_local_process_zero": true,
8
+ "is_world_process_zero": true,
9
+ "log_history": [
10
+ {
11
+ "epoch": 0.01,
12
+ "learning_rate": 9.970909090909091e-05,
13
+ "loss": 1.3244,
14
+ "step": 20
15
+ },
16
+ {
17
+ "epoch": 0.03,
18
+ "learning_rate": 9.941818181818182e-05,
19
+ "loss": 0.9671,
20
+ "step": 40
21
+ },
22
+ {
23
+ "epoch": 0.04,
24
+ "learning_rate": 9.912727272727273e-05,
25
+ "loss": 0.8194,
26
+ "step": 60
27
+ },
28
+ {
29
+ "epoch": 0.06,
30
+ "learning_rate": 9.883636363636364e-05,
31
+ "loss": 0.7545,
32
+ "step": 80
33
+ },
34
+ {
35
+ "epoch": 0.07,
36
+ "learning_rate": 9.854545454545455e-05,
37
+ "loss": 0.7631,
38
+ "step": 100
39
+ },
40
+ {
41
+ "epoch": 0.09,
42
+ "learning_rate": 9.825454545454546e-05,
43
+ "loss": 0.6651,
44
+ "step": 120
45
+ },
46
+ {
47
+ "epoch": 0.1,
48
+ "learning_rate": 9.796363636363637e-05,
49
+ "loss": 0.5622,
50
+ "step": 140
51
+ },
52
+ {
53
+ "epoch": 0.12,
54
+ "learning_rate": 9.767272727272728e-05,
55
+ "loss": 0.6096,
56
+ "step": 160
57
+ },
58
+ {
59
+ "epoch": 0.13,
60
+ "learning_rate": 9.738181818181819e-05,
61
+ "loss": 0.4859,
62
+ "step": 180
63
+ },
64
+ {
65
+ "epoch": 0.15,
66
+ "learning_rate": 9.70909090909091e-05,
67
+ "loss": 0.4879,
68
+ "step": 200
69
+ },
70
+ {
71
+ "epoch": 0.16,
72
+ "learning_rate": 9.680000000000001e-05,
73
+ "loss": 0.4388,
74
+ "step": 220
75
+ },
76
+ {
77
+ "epoch": 0.17,
78
+ "learning_rate": 9.650909090909092e-05,
79
+ "loss": 0.478,
80
+ "step": 240
81
+ },
82
+ {
83
+ "epoch": 0.19,
84
+ "learning_rate": 9.621818181818181e-05,
85
+ "loss": 0.3661,
86
+ "step": 260
87
+ },
88
+ {
89
+ "epoch": 0.2,
90
+ "learning_rate": 9.592727272727274e-05,
91
+ "loss": 0.4131,
92
+ "step": 280
93
+ },
94
+ {
95
+ "epoch": 0.22,
96
+ "learning_rate": 9.563636363636365e-05,
97
+ "loss": 0.3415,
98
+ "step": 300
99
+ },
100
+ {
101
+ "epoch": 0.23,
102
+ "learning_rate": 9.534545454545456e-05,
103
+ "loss": 0.3695,
104
+ "step": 320
105
+ },
106
+ {
107
+ "epoch": 0.25,
108
+ "learning_rate": 9.505454545454546e-05,
109
+ "loss": 0.3059,
110
+ "step": 340
111
+ },
112
+ {
113
+ "epoch": 0.26,
114
+ "learning_rate": 9.476363636363636e-05,
115
+ "loss": 0.268,
116
+ "step": 360
117
+ },
118
+ {
119
+ "epoch": 0.28,
120
+ "learning_rate": 9.447272727272728e-05,
121
+ "loss": 0.3019,
122
+ "step": 380
123
+ },
124
+ {
125
+ "epoch": 0.29,
126
+ "learning_rate": 9.418181818181818e-05,
127
+ "loss": 0.2147,
128
+ "step": 400
129
+ },
130
+ {
131
+ "epoch": 0.31,
132
+ "learning_rate": 9.38909090909091e-05,
133
+ "loss": 0.3197,
134
+ "step": 420
135
+ },
136
+ {
137
+ "epoch": 0.32,
138
+ "learning_rate": 9.360000000000001e-05,
139
+ "loss": 0.2764,
140
+ "step": 440
141
+ },
142
+ {
143
+ "epoch": 0.33,
144
+ "learning_rate": 9.330909090909091e-05,
145
+ "loss": 0.2022,
146
+ "step": 460
147
+ },
148
+ {
149
+ "epoch": 0.35,
150
+ "learning_rate": 9.301818181818183e-05,
151
+ "loss": 0.2326,
152
+ "step": 480
153
+ },
154
+ {
155
+ "epoch": 0.36,
156
+ "learning_rate": 9.272727272727273e-05,
157
+ "loss": 0.3168,
158
+ "step": 500
159
+ },
160
+ {
161
+ "epoch": 0.38,
162
+ "learning_rate": 9.243636363636365e-05,
163
+ "loss": 0.2157,
164
+ "step": 520
165
+ },
166
+ {
167
+ "epoch": 0.39,
168
+ "learning_rate": 9.214545454545455e-05,
169
+ "loss": 0.2783,
170
+ "step": 540
171
+ },
172
+ {
173
+ "epoch": 0.41,
174
+ "learning_rate": 9.185454545454545e-05,
175
+ "loss": 0.1759,
176
+ "step": 560
177
+ },
178
+ {
179
+ "epoch": 0.42,
180
+ "learning_rate": 9.156363636363636e-05,
181
+ "loss": 0.169,
182
+ "step": 580
183
+ },
184
+ {
185
+ "epoch": 0.44,
186
+ "learning_rate": 9.127272727272727e-05,
187
+ "loss": 0.1731,
188
+ "step": 600
189
+ },
190
+ {
191
+ "epoch": 0.45,
192
+ "learning_rate": 9.09818181818182e-05,
193
+ "loss": 0.2469,
194
+ "step": 620
195
+ },
196
+ {
197
+ "epoch": 0.47,
198
+ "learning_rate": 9.069090909090909e-05,
199
+ "loss": 0.1617,
200
+ "step": 640
201
+ },
202
+ {
203
+ "epoch": 0.48,
204
+ "learning_rate": 9.04e-05,
205
+ "loss": 0.1841,
206
+ "step": 660
207
+ },
208
+ {
209
+ "epoch": 0.49,
210
+ "learning_rate": 9.010909090909091e-05,
211
+ "loss": 0.1549,
212
+ "step": 680
213
+ },
214
+ {
215
+ "epoch": 0.51,
216
+ "learning_rate": 8.981818181818182e-05,
217
+ "loss": 0.1393,
218
+ "step": 700
219
+ },
220
+ {
221
+ "epoch": 0.52,
222
+ "learning_rate": 8.952727272727273e-05,
223
+ "loss": 0.1853,
224
+ "step": 720
225
+ },
226
+ {
227
+ "epoch": 0.54,
228
+ "learning_rate": 8.923636363636364e-05,
229
+ "loss": 0.1609,
230
+ "step": 740
231
+ },
232
+ {
233
+ "epoch": 0.55,
234
+ "learning_rate": 8.894545454545455e-05,
235
+ "loss": 0.1493,
236
+ "step": 760
237
+ },
238
+ {
239
+ "epoch": 0.57,
240
+ "learning_rate": 8.865454545454546e-05,
241
+ "loss": 0.1436,
242
+ "step": 780
243
+ },
244
+ {
245
+ "epoch": 0.58,
246
+ "learning_rate": 8.836363636363637e-05,
247
+ "loss": 0.1626,
248
+ "step": 800
249
+ },
250
+ {
251
+ "epoch": 0.6,
252
+ "learning_rate": 8.807272727272728e-05,
253
+ "loss": 0.2139,
254
+ "step": 820
255
+ },
256
+ {
257
+ "epoch": 0.61,
258
+ "learning_rate": 8.778181818181819e-05,
259
+ "loss": 0.1661,
260
+ "step": 840
261
+ },
262
+ {
263
+ "epoch": 0.63,
264
+ "learning_rate": 8.74909090909091e-05,
265
+ "loss": 0.1579,
266
+ "step": 860
267
+ },
268
+ {
269
+ "epoch": 0.64,
270
+ "learning_rate": 8.72e-05,
271
+ "loss": 0.1424,
272
+ "step": 880
273
+ },
274
+ {
275
+ "epoch": 0.65,
276
+ "learning_rate": 8.690909090909091e-05,
277
+ "loss": 0.073,
278
+ "step": 900
279
+ },
280
+ {
281
+ "epoch": 0.67,
282
+ "learning_rate": 8.661818181818182e-05,
283
+ "loss": 0.1764,
284
+ "step": 920
285
+ },
286
+ {
287
+ "epoch": 0.68,
288
+ "learning_rate": 8.632727272727273e-05,
289
+ "loss": 0.1296,
290
+ "step": 940
291
+ },
292
+ {
293
+ "epoch": 0.7,
294
+ "learning_rate": 8.603636363636364e-05,
295
+ "loss": 0.144,
296
+ "step": 960
297
+ },
298
+ {
299
+ "epoch": 0.71,
300
+ "learning_rate": 8.574545454545455e-05,
301
+ "loss": 0.0955,
302
+ "step": 980
303
+ },
304
+ {
305
+ "epoch": 0.73,
306
+ "learning_rate": 8.545454545454545e-05,
307
+ "loss": 0.1262,
308
+ "step": 1000
309
+ },
310
+ {
311
+ "epoch": 0.74,
312
+ "learning_rate": 8.516363636363637e-05,
313
+ "loss": 0.1599,
314
+ "step": 1020
315
+ },
316
+ {
317
+ "epoch": 0.76,
318
+ "learning_rate": 8.487272727272728e-05,
319
+ "loss": 0.0835,
320
+ "step": 1040
321
+ },
322
+ {
323
+ "epoch": 0.77,
324
+ "learning_rate": 8.458181818181819e-05,
325
+ "loss": 0.1509,
326
+ "step": 1060
327
+ },
328
+ {
329
+ "epoch": 0.79,
330
+ "learning_rate": 8.42909090909091e-05,
331
+ "loss": 0.0916,
332
+ "step": 1080
333
+ },
334
+ {
335
+ "epoch": 0.8,
336
+ "learning_rate": 8.4e-05,
337
+ "loss": 0.0863,
338
+ "step": 1100
339
+ },
340
+ {
341
+ "epoch": 0.81,
342
+ "learning_rate": 8.370909090909092e-05,
343
+ "loss": 0.1302,
344
+ "step": 1120
345
+ },
346
+ {
347
+ "epoch": 0.83,
348
+ "learning_rate": 8.341818181818181e-05,
349
+ "loss": 0.1324,
350
+ "step": 1140
351
+ },
352
+ {
353
+ "epoch": 0.84,
354
+ "learning_rate": 8.312727272727274e-05,
355
+ "loss": 0.0838,
356
+ "step": 1160
357
+ },
358
+ {
359
+ "epoch": 0.86,
360
+ "learning_rate": 8.283636363636365e-05,
361
+ "loss": 0.1127,
362
+ "step": 1180
363
+ },
364
+ {
365
+ "epoch": 0.87,
366
+ "learning_rate": 8.254545454545454e-05,
367
+ "loss": 0.1193,
368
+ "step": 1200
369
+ },
370
+ {
371
+ "epoch": 0.89,
372
+ "learning_rate": 8.225454545454547e-05,
373
+ "loss": 0.1404,
374
+ "step": 1220
375
+ },
376
+ {
377
+ "epoch": 0.9,
378
+ "learning_rate": 8.196363636363636e-05,
379
+ "loss": 0.125,
380
+ "step": 1240
381
+ },
382
+ {
383
+ "epoch": 0.92,
384
+ "learning_rate": 8.167272727272728e-05,
385
+ "loss": 0.0519,
386
+ "step": 1260
387
+ },
388
+ {
389
+ "epoch": 0.93,
390
+ "learning_rate": 8.138181818181818e-05,
391
+ "loss": 0.1256,
392
+ "step": 1280
393
+ },
394
+ {
395
+ "epoch": 0.95,
396
+ "learning_rate": 8.109090909090909e-05,
397
+ "loss": 0.1016,
398
+ "step": 1300
399
+ },
400
+ {
401
+ "epoch": 0.96,
402
+ "learning_rate": 8.080000000000001e-05,
403
+ "loss": 0.0944,
404
+ "step": 1320
405
+ },
406
+ {
407
+ "epoch": 0.97,
408
+ "learning_rate": 8.050909090909091e-05,
409
+ "loss": 0.0666,
410
+ "step": 1340
411
+ },
412
+ {
413
+ "epoch": 0.99,
414
+ "learning_rate": 8.021818181818183e-05,
415
+ "loss": 0.0903,
416
+ "step": 1360
417
+ },
418
+ {
419
+ "epoch": 1.0,
420
+ "eval_accuracy": 0.1940000057220459,
421
+ "eval_loss": 3.9567816257476807,
422
+ "eval_runtime": 3.3624,
423
+ "eval_samples_per_second": 148.705,
424
+ "eval_steps_per_second": 4.759,
425
+ "step": 1375
426
+ },
427
+ {
428
+ "epoch": 1.0,
429
+ "learning_rate": 7.992727272727273e-05,
430
+ "loss": 0.1101,
431
+ "step": 1380
432
+ },
433
+ {
434
+ "epoch": 1.02,
435
+ "learning_rate": 7.963636363636364e-05,
436
+ "loss": 0.0603,
437
+ "step": 1400
438
+ },
439
+ {
440
+ "epoch": 1.03,
441
+ "learning_rate": 7.934545454545455e-05,
442
+ "loss": 0.0622,
443
+ "step": 1420
444
+ },
445
+ {
446
+ "epoch": 1.05,
447
+ "learning_rate": 7.905454545454546e-05,
448
+ "loss": 0.0463,
449
+ "step": 1440
450
+ },
451
+ {
452
+ "epoch": 1.06,
453
+ "learning_rate": 7.876363636363638e-05,
454
+ "loss": 0.0404,
455
+ "step": 1460
456
+ },
457
+ {
458
+ "epoch": 1.08,
459
+ "learning_rate": 7.847272727272727e-05,
460
+ "loss": 0.0476,
461
+ "step": 1480
462
+ },
463
+ {
464
+ "epoch": 1.09,
465
+ "learning_rate": 7.818181818181818e-05,
466
+ "loss": 0.0763,
467
+ "step": 1500
468
+ },
469
+ {
470
+ "epoch": 1.11,
471
+ "learning_rate": 7.789090909090909e-05,
472
+ "loss": 0.0363,
473
+ "step": 1520
474
+ },
475
+ {
476
+ "epoch": 1.12,
477
+ "learning_rate": 7.76e-05,
478
+ "loss": 0.0697,
479
+ "step": 1540
480
+ },
481
+ {
482
+ "epoch": 1.13,
483
+ "learning_rate": 7.730909090909091e-05,
484
+ "loss": 0.0838,
485
+ "step": 1560
486
+ },
487
+ {
488
+ "epoch": 1.15,
489
+ "learning_rate": 7.701818181818182e-05,
490
+ "loss": 0.0587,
491
+ "step": 1580
492
+ },
493
+ {
494
+ "epoch": 1.16,
495
+ "learning_rate": 7.672727272727273e-05,
496
+ "loss": 0.0246,
497
+ "step": 1600
498
+ },
499
+ {
500
+ "epoch": 1.18,
501
+ "learning_rate": 7.643636363636364e-05,
502
+ "loss": 0.0461,
503
+ "step": 1620
504
+ },
505
+ {
506
+ "epoch": 1.19,
507
+ "learning_rate": 7.614545454545455e-05,
508
+ "loss": 0.0695,
509
+ "step": 1640
510
+ },
511
+ {
512
+ "epoch": 1.21,
513
+ "learning_rate": 7.585454545454546e-05,
514
+ "loss": 0.0736,
515
+ "step": 1660
516
+ },
517
+ {
518
+ "epoch": 1.22,
519
+ "learning_rate": 7.556363636363637e-05,
520
+ "loss": 0.0261,
521
+ "step": 1680
522
+ },
523
+ {
524
+ "epoch": 1.24,
525
+ "learning_rate": 7.527272727272728e-05,
526
+ "loss": 0.0438,
527
+ "step": 1700
528
+ },
529
+ {
530
+ "epoch": 1.25,
531
+ "learning_rate": 7.498181818181819e-05,
532
+ "loss": 0.0858,
533
+ "step": 1720
534
+ },
535
+ {
536
+ "epoch": 1.27,
537
+ "learning_rate": 7.469090909090908e-05,
538
+ "loss": 0.0248,
539
+ "step": 1740
540
+ },
541
+ {
542
+ "epoch": 1.28,
543
+ "learning_rate": 7.44e-05,
544
+ "loss": 0.0615,
545
+ "step": 1760
546
+ },
547
+ {
548
+ "epoch": 1.29,
549
+ "learning_rate": 7.410909090909092e-05,
550
+ "loss": 0.0123,
551
+ "step": 1780
552
+ },
553
+ {
554
+ "epoch": 1.31,
555
+ "learning_rate": 7.381818181818182e-05,
556
+ "loss": 0.0451,
557
+ "step": 1800
558
+ },
559
+ {
560
+ "epoch": 1.32,
561
+ "learning_rate": 7.352727272727273e-05,
562
+ "loss": 0.05,
563
+ "step": 1820
564
+ },
565
+ {
566
+ "epoch": 1.34,
567
+ "learning_rate": 7.323636363636363e-05,
568
+ "loss": 0.0415,
569
+ "step": 1840
570
+ },
571
+ {
572
+ "epoch": 1.35,
573
+ "learning_rate": 7.294545454545455e-05,
574
+ "loss": 0.0734,
575
+ "step": 1860
576
+ },
577
+ {
578
+ "epoch": 1.37,
579
+ "learning_rate": 7.265454545454545e-05,
580
+ "loss": 0.037,
581
+ "step": 1880
582
+ },
583
+ {
584
+ "epoch": 1.38,
585
+ "learning_rate": 7.236363636363637e-05,
586
+ "loss": 0.045,
587
+ "step": 1900
588
+ },
589
+ {
590
+ "epoch": 1.4,
591
+ "learning_rate": 7.207272727272728e-05,
592
+ "loss": 0.0914,
593
+ "step": 1920
594
+ },
595
+ {
596
+ "epoch": 1.41,
597
+ "learning_rate": 7.178181818181818e-05,
598
+ "loss": 0.0288,
599
+ "step": 1940
600
+ },
601
+ {
602
+ "epoch": 1.43,
603
+ "learning_rate": 7.14909090909091e-05,
604
+ "loss": 0.0289,
605
+ "step": 1960
606
+ },
607
+ {
608
+ "epoch": 1.44,
609
+ "learning_rate": 7.12e-05,
610
+ "loss": 0.0355,
611
+ "step": 1980
612
+ },
613
+ {
614
+ "epoch": 1.45,
615
+ "learning_rate": 7.090909090909092e-05,
616
+ "loss": 0.0376,
617
+ "step": 2000
618
+ },
619
+ {
620
+ "epoch": 1.47,
621
+ "learning_rate": 7.061818181818181e-05,
622
+ "loss": 0.0375,
623
+ "step": 2020
624
+ },
625
+ {
626
+ "epoch": 1.48,
627
+ "learning_rate": 7.032727272727272e-05,
628
+ "loss": 0.0695,
629
+ "step": 2040
630
+ },
631
+ {
632
+ "epoch": 1.5,
633
+ "learning_rate": 7.003636363636365e-05,
634
+ "loss": 0.0414,
635
+ "step": 2060
636
+ },
637
+ {
638
+ "epoch": 1.51,
639
+ "learning_rate": 6.974545454545454e-05,
640
+ "loss": 0.0308,
641
+ "step": 2080
642
+ },
643
+ {
644
+ "epoch": 1.53,
645
+ "learning_rate": 6.945454545454547e-05,
646
+ "loss": 0.0209,
647
+ "step": 2100
648
+ },
649
+ {
650
+ "epoch": 1.54,
651
+ "learning_rate": 6.916363636363636e-05,
652
+ "loss": 0.0731,
653
+ "step": 2120
654
+ },
655
+ {
656
+ "epoch": 1.56,
657
+ "learning_rate": 6.887272727272727e-05,
658
+ "loss": 0.0409,
659
+ "step": 2140
660
+ },
661
+ {
662
+ "epoch": 1.57,
663
+ "learning_rate": 6.858181818181818e-05,
664
+ "loss": 0.0544,
665
+ "step": 2160
666
+ },
667
+ {
668
+ "epoch": 1.59,
669
+ "learning_rate": 6.829090909090909e-05,
670
+ "loss": 0.0677,
671
+ "step": 2180
672
+ },
673
+ {
674
+ "epoch": 1.6,
675
+ "learning_rate": 6.800000000000001e-05,
676
+ "loss": 0.0345,
677
+ "step": 2200
678
+ },
679
+ {
680
+ "epoch": 1.61,
681
+ "learning_rate": 6.770909090909091e-05,
682
+ "loss": 0.0262,
683
+ "step": 2220
684
+ },
685
+ {
686
+ "epoch": 1.63,
687
+ "learning_rate": 6.741818181818182e-05,
688
+ "loss": 0.066,
689
+ "step": 2240
690
+ },
691
+ {
692
+ "epoch": 1.64,
693
+ "learning_rate": 6.712727272727273e-05,
694
+ "loss": 0.0578,
695
+ "step": 2260
696
+ },
697
+ {
698
+ "epoch": 1.66,
699
+ "learning_rate": 6.683636363636364e-05,
700
+ "loss": 0.066,
701
+ "step": 2280
702
+ },
703
+ {
704
+ "epoch": 1.67,
705
+ "learning_rate": 6.654545454545455e-05,
706
+ "loss": 0.0565,
707
+ "step": 2300
708
+ },
709
+ {
710
+ "epoch": 1.69,
711
+ "learning_rate": 6.625454545454546e-05,
712
+ "loss": 0.0428,
713
+ "step": 2320
714
+ },
715
+ {
716
+ "epoch": 1.7,
717
+ "learning_rate": 6.596363636363637e-05,
718
+ "loss": 0.0387,
719
+ "step": 2340
720
+ },
721
+ {
722
+ "epoch": 1.72,
723
+ "learning_rate": 6.567272727272727e-05,
724
+ "loss": 0.0294,
725
+ "step": 2360
726
+ },
727
+ {
728
+ "epoch": 1.73,
729
+ "learning_rate": 6.538181818181818e-05,
730
+ "loss": 0.0332,
731
+ "step": 2380
732
+ },
733
+ {
734
+ "epoch": 1.75,
735
+ "learning_rate": 6.50909090909091e-05,
736
+ "loss": 0.0401,
737
+ "step": 2400
738
+ },
739
+ {
740
+ "epoch": 1.76,
741
+ "learning_rate": 6.48e-05,
742
+ "loss": 0.0324,
743
+ "step": 2420
744
+ },
745
+ {
746
+ "epoch": 1.77,
747
+ "learning_rate": 6.450909090909091e-05,
748
+ "loss": 0.0162,
749
+ "step": 2440
750
+ },
751
+ {
752
+ "epoch": 1.79,
753
+ "learning_rate": 6.421818181818182e-05,
754
+ "loss": 0.0501,
755
+ "step": 2460
756
+ },
757
+ {
758
+ "epoch": 1.8,
759
+ "learning_rate": 6.392727272727273e-05,
760
+ "loss": 0.0335,
761
+ "step": 2480
762
+ },
763
+ {
764
+ "epoch": 1.82,
765
+ "learning_rate": 6.363636363636364e-05,
766
+ "loss": 0.025,
767
+ "step": 2500
768
+ },
769
+ {
770
+ "epoch": 1.83,
771
+ "learning_rate": 6.334545454545455e-05,
772
+ "loss": 0.0402,
773
+ "step": 2520
774
+ },
775
+ {
776
+ "epoch": 1.85,
777
+ "learning_rate": 6.305454545454546e-05,
778
+ "loss": 0.0624,
779
+ "step": 2540
780
+ },
781
+ {
782
+ "epoch": 1.86,
783
+ "learning_rate": 6.276363636363637e-05,
784
+ "loss": 0.0337,
785
+ "step": 2560
786
+ },
787
+ {
788
+ "epoch": 1.88,
789
+ "learning_rate": 6.247272727272728e-05,
790
+ "loss": 0.0264,
791
+ "step": 2580
792
+ },
793
+ {
794
+ "epoch": 1.89,
795
+ "learning_rate": 6.218181818181819e-05,
796
+ "loss": 0.057,
797
+ "step": 2600
798
+ },
799
+ {
800
+ "epoch": 1.91,
801
+ "learning_rate": 6.18909090909091e-05,
802
+ "loss": 0.0381,
803
+ "step": 2620
804
+ },
805
+ {
806
+ "epoch": 1.92,
807
+ "learning_rate": 6.16e-05,
808
+ "loss": 0.0316,
809
+ "step": 2640
810
+ },
811
+ {
812
+ "epoch": 1.93,
813
+ "learning_rate": 6.130909090909092e-05,
814
+ "loss": 0.0492,
815
+ "step": 2660
816
+ },
817
+ {
818
+ "epoch": 1.95,
819
+ "learning_rate": 6.101818181818182e-05,
820
+ "loss": 0.0405,
821
+ "step": 2680
822
+ },
823
+ {
824
+ "epoch": 1.96,
825
+ "learning_rate": 6.0727272727272735e-05,
826
+ "loss": 0.0594,
827
+ "step": 2700
828
+ },
829
+ {
830
+ "epoch": 1.98,
831
+ "learning_rate": 6.043636363636364e-05,
832
+ "loss": 0.0263,
833
+ "step": 2720
834
+ },
835
+ {
836
+ "epoch": 1.99,
837
+ "learning_rate": 6.014545454545455e-05,
838
+ "loss": 0.0432,
839
+ "step": 2740
840
+ },
841
+ {
842
+ "epoch": 2.0,
843
+ "eval_accuracy": 0.1720000058412552,
844
+ "eval_loss": 4.625512599945068,
845
+ "eval_runtime": 3.3701,
846
+ "eval_samples_per_second": 148.362,
847
+ "eval_steps_per_second": 4.748,
848
+ "step": 2750
849
+ },
850
+ {
851
+ "epoch": 2.01,
852
+ "learning_rate": 5.985454545454545e-05,
853
+ "loss": 0.0235,
854
+ "step": 2760
855
+ },
856
+ {
857
+ "epoch": 2.02,
858
+ "learning_rate": 5.9563636363636366e-05,
859
+ "loss": 0.0293,
860
+ "step": 2780
861
+ },
862
+ {
863
+ "epoch": 2.04,
864
+ "learning_rate": 5.927272727272728e-05,
865
+ "loss": 0.0326,
866
+ "step": 2800
867
+ },
868
+ {
869
+ "epoch": 2.05,
870
+ "learning_rate": 5.8981818181818184e-05,
871
+ "loss": 0.0124,
872
+ "step": 2820
873
+ },
874
+ {
875
+ "epoch": 2.07,
876
+ "learning_rate": 5.8690909090909094e-05,
877
+ "loss": 0.0157,
878
+ "step": 2840
879
+ },
880
+ {
881
+ "epoch": 2.08,
882
+ "learning_rate": 5.8399999999999997e-05,
883
+ "loss": 0.0138,
884
+ "step": 2860
885
+ },
886
+ {
887
+ "epoch": 2.09,
888
+ "learning_rate": 5.810909090909091e-05,
889
+ "loss": 0.0291,
890
+ "step": 2880
891
+ },
892
+ {
893
+ "epoch": 2.11,
894
+ "learning_rate": 5.7818181818181815e-05,
895
+ "loss": 0.0047,
896
+ "step": 2900
897
+ },
898
+ {
899
+ "epoch": 2.12,
900
+ "learning_rate": 5.752727272727273e-05,
901
+ "loss": 0.0188,
902
+ "step": 2920
903
+ },
904
+ {
905
+ "epoch": 2.14,
906
+ "learning_rate": 5.723636363636364e-05,
907
+ "loss": 0.0277,
908
+ "step": 2940
909
+ },
910
+ {
911
+ "epoch": 2.15,
912
+ "learning_rate": 5.6945454545454544e-05,
913
+ "loss": 0.0118,
914
+ "step": 2960
915
+ },
916
+ {
917
+ "epoch": 2.17,
918
+ "learning_rate": 5.665454545454546e-05,
919
+ "loss": 0.0277,
920
+ "step": 2980
921
+ },
922
+ {
923
+ "epoch": 2.18,
924
+ "learning_rate": 5.636363636363636e-05,
925
+ "loss": 0.006,
926
+ "step": 3000
927
+ },
928
+ {
929
+ "epoch": 2.2,
930
+ "learning_rate": 5.607272727272728e-05,
931
+ "loss": 0.0214,
932
+ "step": 3020
933
+ },
934
+ {
935
+ "epoch": 2.21,
936
+ "learning_rate": 5.578181818181818e-05,
937
+ "loss": 0.0086,
938
+ "step": 3040
939
+ },
940
+ {
941
+ "epoch": 2.23,
942
+ "learning_rate": 5.549090909090909e-05,
943
+ "loss": 0.0091,
944
+ "step": 3060
945
+ },
946
+ {
947
+ "epoch": 2.24,
948
+ "learning_rate": 5.520000000000001e-05,
949
+ "loss": 0.0055,
950
+ "step": 3080
951
+ },
952
+ {
953
+ "epoch": 2.25,
954
+ "learning_rate": 5.490909090909091e-05,
955
+ "loss": 0.0326,
956
+ "step": 3100
957
+ },
958
+ {
959
+ "epoch": 2.27,
960
+ "learning_rate": 5.4618181818181826e-05,
961
+ "loss": 0.0145,
962
+ "step": 3120
963
+ },
964
+ {
965
+ "epoch": 2.28,
966
+ "learning_rate": 5.432727272727273e-05,
967
+ "loss": 0.0087,
968
+ "step": 3140
969
+ },
970
+ {
971
+ "epoch": 2.3,
972
+ "learning_rate": 5.403636363636364e-05,
973
+ "loss": 0.0084,
974
+ "step": 3160
975
+ },
976
+ {
977
+ "epoch": 2.31,
978
+ "learning_rate": 5.374545454545454e-05,
979
+ "loss": 0.0116,
980
+ "step": 3180
981
+ },
982
+ {
983
+ "epoch": 2.33,
984
+ "learning_rate": 5.3454545454545457e-05,
985
+ "loss": 0.0254,
986
+ "step": 3200
987
+ },
988
+ {
989
+ "epoch": 2.34,
990
+ "learning_rate": 5.316363636363637e-05,
991
+ "loss": 0.0033,
992
+ "step": 3220
993
+ },
994
+ {
995
+ "epoch": 2.36,
996
+ "learning_rate": 5.2872727272727275e-05,
997
+ "loss": 0.0246,
998
+ "step": 3240
999
+ },
1000
+ {
1001
+ "epoch": 2.37,
1002
+ "learning_rate": 5.2581818181818185e-05,
1003
+ "loss": 0.0222,
1004
+ "step": 3260
1005
+ },
1006
+ {
1007
+ "epoch": 2.39,
1008
+ "learning_rate": 5.229090909090909e-05,
1009
+ "loss": 0.0093,
1010
+ "step": 3280
1011
+ },
1012
+ {
1013
+ "epoch": 2.4,
1014
+ "learning_rate": 5.2000000000000004e-05,
1015
+ "loss": 0.0112,
1016
+ "step": 3300
1017
+ },
1018
+ {
1019
+ "epoch": 2.41,
1020
+ "learning_rate": 5.1709090909090906e-05,
1021
+ "loss": 0.0335,
1022
+ "step": 3320
1023
+ },
1024
+ {
1025
+ "epoch": 2.43,
1026
+ "learning_rate": 5.141818181818182e-05,
1027
+ "loss": 0.0382,
1028
+ "step": 3340
1029
+ },
1030
+ {
1031
+ "epoch": 2.44,
1032
+ "learning_rate": 5.112727272727273e-05,
1033
+ "loss": 0.0264,
1034
+ "step": 3360
1035
+ },
1036
+ {
1037
+ "epoch": 2.46,
1038
+ "learning_rate": 5.0836363636363634e-05,
1039
+ "loss": 0.0131,
1040
+ "step": 3380
1041
+ },
1042
+ {
1043
+ "epoch": 2.47,
1044
+ "learning_rate": 5.054545454545455e-05,
1045
+ "loss": 0.0198,
1046
+ "step": 3400
1047
+ },
1048
+ {
1049
+ "epoch": 2.49,
1050
+ "learning_rate": 5.025454545454545e-05,
1051
+ "loss": 0.0027,
1052
+ "step": 3420
1053
+ },
1054
+ {
1055
+ "epoch": 2.5,
1056
+ "learning_rate": 4.996363636363637e-05,
1057
+ "loss": 0.0116,
1058
+ "step": 3440
1059
+ },
1060
+ {
1061
+ "epoch": 2.52,
1062
+ "learning_rate": 4.967272727272728e-05,
1063
+ "loss": 0.0066,
1064
+ "step": 3460
1065
+ },
1066
+ {
1067
+ "epoch": 2.53,
1068
+ "learning_rate": 4.938181818181818e-05,
1069
+ "loss": 0.04,
1070
+ "step": 3480
1071
+ },
1072
+ {
1073
+ "epoch": 2.55,
1074
+ "learning_rate": 4.909090909090909e-05,
1075
+ "loss": 0.0097,
1076
+ "step": 3500
1077
+ },
1078
+ {
1079
+ "epoch": 2.56,
1080
+ "learning_rate": 4.88e-05,
1081
+ "loss": 0.0119,
1082
+ "step": 3520
1083
+ },
1084
+ {
1085
+ "epoch": 2.57,
1086
+ "learning_rate": 4.850909090909091e-05,
1087
+ "loss": 0.0111,
1088
+ "step": 3540
1089
+ },
1090
+ {
1091
+ "epoch": 2.59,
1092
+ "learning_rate": 4.821818181818182e-05,
1093
+ "loss": 0.0311,
1094
+ "step": 3560
1095
+ },
1096
+ {
1097
+ "epoch": 2.6,
1098
+ "learning_rate": 4.792727272727273e-05,
1099
+ "loss": 0.0234,
1100
+ "step": 3580
1101
+ },
1102
+ {
1103
+ "epoch": 2.62,
1104
+ "learning_rate": 4.763636363636364e-05,
1105
+ "loss": 0.0124,
1106
+ "step": 3600
1107
+ },
1108
+ {
1109
+ "epoch": 2.63,
1110
+ "learning_rate": 4.734545454545455e-05,
1111
+ "loss": 0.0068,
1112
+ "step": 3620
1113
+ },
1114
+ {
1115
+ "epoch": 2.65,
1116
+ "learning_rate": 4.705454545454546e-05,
1117
+ "loss": 0.0349,
1118
+ "step": 3640
1119
+ },
1120
+ {
1121
+ "epoch": 2.66,
1122
+ "learning_rate": 4.6763636363636366e-05,
1123
+ "loss": 0.0112,
1124
+ "step": 3660
1125
+ },
1126
+ {
1127
+ "epoch": 2.68,
1128
+ "learning_rate": 4.6472727272727276e-05,
1129
+ "loss": 0.0122,
1130
+ "step": 3680
1131
+ },
1132
+ {
1133
+ "epoch": 2.69,
1134
+ "learning_rate": 4.618181818181818e-05,
1135
+ "loss": 0.0071,
1136
+ "step": 3700
1137
+ },
1138
+ {
1139
+ "epoch": 2.71,
1140
+ "learning_rate": 4.5890909090909094e-05,
1141
+ "loss": 0.0504,
1142
+ "step": 3720
1143
+ },
1144
+ {
1145
+ "epoch": 2.72,
1146
+ "learning_rate": 4.5600000000000004e-05,
1147
+ "loss": 0.0307,
1148
+ "step": 3740
1149
+ },
1150
+ {
1151
+ "epoch": 2.73,
1152
+ "learning_rate": 4.530909090909091e-05,
1153
+ "loss": 0.0048,
1154
+ "step": 3760
1155
+ },
1156
+ {
1157
+ "epoch": 2.75,
1158
+ "learning_rate": 4.501818181818182e-05,
1159
+ "loss": 0.0136,
1160
+ "step": 3780
1161
+ },
1162
+ {
1163
+ "epoch": 2.76,
1164
+ "learning_rate": 4.472727272727273e-05,
1165
+ "loss": 0.038,
1166
+ "step": 3800
1167
+ },
1168
+ {
1169
+ "epoch": 2.78,
1170
+ "learning_rate": 4.4436363636363635e-05,
1171
+ "loss": 0.0089,
1172
+ "step": 3820
1173
+ },
1174
+ {
1175
+ "epoch": 2.79,
1176
+ "learning_rate": 4.4145454545454544e-05,
1177
+ "loss": 0.0069,
1178
+ "step": 3840
1179
+ },
1180
+ {
1181
+ "epoch": 2.81,
1182
+ "learning_rate": 4.385454545454546e-05,
1183
+ "loss": 0.0161,
1184
+ "step": 3860
1185
+ },
1186
+ {
1187
+ "epoch": 2.82,
1188
+ "learning_rate": 4.356363636363637e-05,
1189
+ "loss": 0.013,
1190
+ "step": 3880
1191
+ },
1192
+ {
1193
+ "epoch": 2.84,
1194
+ "learning_rate": 4.327272727272728e-05,
1195
+ "loss": 0.0049,
1196
+ "step": 3900
1197
+ },
1198
+ {
1199
+ "epoch": 2.85,
1200
+ "learning_rate": 4.298181818181818e-05,
1201
+ "loss": 0.0304,
1202
+ "step": 3920
1203
+ },
1204
+ {
1205
+ "epoch": 2.87,
1206
+ "learning_rate": 4.269090909090909e-05,
1207
+ "loss": 0.03,
1208
+ "step": 3940
1209
+ },
1210
+ {
1211
+ "epoch": 2.88,
1212
+ "learning_rate": 4.24e-05,
1213
+ "loss": 0.0313,
1214
+ "step": 3960
1215
+ },
1216
+ {
1217
+ "epoch": 2.89,
1218
+ "learning_rate": 4.210909090909091e-05,
1219
+ "loss": 0.0079,
1220
+ "step": 3980
1221
+ },
1222
+ {
1223
+ "epoch": 2.91,
1224
+ "learning_rate": 4.181818181818182e-05,
1225
+ "loss": 0.0189,
1226
+ "step": 4000
1227
+ },
1228
+ {
1229
+ "epoch": 2.92,
1230
+ "learning_rate": 4.152727272727273e-05,
1231
+ "loss": 0.0019,
1232
+ "step": 4020
1233
+ },
1234
+ {
1235
+ "epoch": 2.94,
1236
+ "learning_rate": 4.123636363636364e-05,
1237
+ "loss": 0.0325,
1238
+ "step": 4040
1239
+ },
1240
+ {
1241
+ "epoch": 2.95,
1242
+ "learning_rate": 4.094545454545455e-05,
1243
+ "loss": 0.0276,
1244
+ "step": 4060
1245
+ },
1246
+ {
1247
+ "epoch": 2.97,
1248
+ "learning_rate": 4.065454545454546e-05,
1249
+ "loss": 0.0137,
1250
+ "step": 4080
1251
+ },
1252
+ {
1253
+ "epoch": 2.98,
1254
+ "learning_rate": 4.0363636363636367e-05,
1255
+ "loss": 0.0169,
1256
+ "step": 4100
1257
+ },
1258
+ {
1259
+ "epoch": 3.0,
1260
+ "learning_rate": 4.0072727272727276e-05,
1261
+ "loss": 0.0087,
1262
+ "step": 4120
1263
+ },
1264
+ {
1265
+ "epoch": 3.0,
1266
+ "eval_accuracy": 0.17599999904632568,
1267
+ "eval_loss": 6.114068508148193,
1268
+ "eval_runtime": 3.4252,
1269
+ "eval_samples_per_second": 145.975,
1270
+ "eval_steps_per_second": 4.671,
1271
+ "step": 4125
1272
+ },
1273
+ {
1274
+ "epoch": 3.01,
1275
+ "learning_rate": 3.978181818181818e-05,
1276
+ "loss": 0.0005,
1277
+ "step": 4140
1278
+ },
1279
+ {
1280
+ "epoch": 3.03,
1281
+ "learning_rate": 3.9490909090909095e-05,
1282
+ "loss": 0.0109,
1283
+ "step": 4160
1284
+ },
1285
+ {
1286
+ "epoch": 3.04,
1287
+ "learning_rate": 3.9200000000000004e-05,
1288
+ "loss": 0.0128,
1289
+ "step": 4180
1290
+ },
1291
+ {
1292
+ "epoch": 3.05,
1293
+ "learning_rate": 3.8909090909090914e-05,
1294
+ "loss": 0.0016,
1295
+ "step": 4200
1296
+ },
1297
+ {
1298
+ "epoch": 3.07,
1299
+ "learning_rate": 3.861818181818182e-05,
1300
+ "loss": 0.0009,
1301
+ "step": 4220
1302
+ },
1303
+ {
1304
+ "epoch": 3.08,
1305
+ "learning_rate": 3.8327272727272726e-05,
1306
+ "loss": 0.0036,
1307
+ "step": 4240
1308
+ },
1309
+ {
1310
+ "epoch": 3.1,
1311
+ "learning_rate": 3.8036363636363635e-05,
1312
+ "loss": 0.0124,
1313
+ "step": 4260
1314
+ },
1315
+ {
1316
+ "epoch": 3.11,
1317
+ "learning_rate": 3.7745454545454544e-05,
1318
+ "loss": 0.0128,
1319
+ "step": 4280
1320
+ },
1321
+ {
1322
+ "epoch": 3.13,
1323
+ "learning_rate": 3.745454545454546e-05,
1324
+ "loss": 0.0029,
1325
+ "step": 4300
1326
+ },
1327
+ {
1328
+ "epoch": 3.14,
1329
+ "learning_rate": 3.716363636363637e-05,
1330
+ "loss": 0.0088,
1331
+ "step": 4320
1332
+ },
1333
+ {
1334
+ "epoch": 3.16,
1335
+ "learning_rate": 3.687272727272727e-05,
1336
+ "loss": 0.0129,
1337
+ "step": 4340
1338
+ },
1339
+ {
1340
+ "epoch": 3.17,
1341
+ "learning_rate": 3.658181818181818e-05,
1342
+ "loss": 0.0012,
1343
+ "step": 4360
1344
+ },
1345
+ {
1346
+ "epoch": 3.19,
1347
+ "learning_rate": 3.629090909090909e-05,
1348
+ "loss": 0.0001,
1349
+ "step": 4380
1350
+ },
1351
+ {
1352
+ "epoch": 3.2,
1353
+ "learning_rate": 3.6e-05,
1354
+ "loss": 0.0116,
1355
+ "step": 4400
1356
+ },
1357
+ {
1358
+ "epoch": 3.21,
1359
+ "learning_rate": 3.570909090909091e-05,
1360
+ "loss": 0.0005,
1361
+ "step": 4420
1362
+ },
1363
+ {
1364
+ "epoch": 3.23,
1365
+ "learning_rate": 3.541818181818182e-05,
1366
+ "loss": 0.0013,
1367
+ "step": 4440
1368
+ },
1369
+ {
1370
+ "epoch": 3.24,
1371
+ "learning_rate": 3.512727272727273e-05,
1372
+ "loss": 0.0349,
1373
+ "step": 4460
1374
+ },
1375
+ {
1376
+ "epoch": 3.26,
1377
+ "learning_rate": 3.483636363636364e-05,
1378
+ "loss": 0.0013,
1379
+ "step": 4480
1380
+ },
1381
+ {
1382
+ "epoch": 3.27,
1383
+ "learning_rate": 3.454545454545455e-05,
1384
+ "loss": 0.0025,
1385
+ "step": 4500
1386
+ },
1387
+ {
1388
+ "epoch": 3.29,
1389
+ "learning_rate": 3.425454545454546e-05,
1390
+ "loss": 0.0106,
1391
+ "step": 4520
1392
+ },
1393
+ {
1394
+ "epoch": 3.3,
1395
+ "learning_rate": 3.396363636363637e-05,
1396
+ "loss": 0.0107,
1397
+ "step": 4540
1398
+ },
1399
+ {
1400
+ "epoch": 3.32,
1401
+ "learning_rate": 3.367272727272727e-05,
1402
+ "loss": 0.0055,
1403
+ "step": 4560
1404
+ },
1405
+ {
1406
+ "epoch": 3.33,
1407
+ "learning_rate": 3.338181818181818e-05,
1408
+ "loss": 0.0021,
1409
+ "step": 4580
1410
+ },
1411
+ {
1412
+ "epoch": 3.35,
1413
+ "learning_rate": 3.3090909090909095e-05,
1414
+ "loss": 0.0187,
1415
+ "step": 4600
1416
+ },
1417
+ {
1418
+ "epoch": 3.36,
1419
+ "learning_rate": 3.2800000000000004e-05,
1420
+ "loss": 0.0005,
1421
+ "step": 4620
1422
+ },
1423
+ {
1424
+ "epoch": 3.37,
1425
+ "learning_rate": 3.2509090909090914e-05,
1426
+ "loss": 0.0126,
1427
+ "step": 4640
1428
+ },
1429
+ {
1430
+ "epoch": 3.39,
1431
+ "learning_rate": 3.2218181818181816e-05,
1432
+ "loss": 0.0001,
1433
+ "step": 4660
1434
+ },
1435
+ {
1436
+ "epoch": 3.4,
1437
+ "learning_rate": 3.1927272727272726e-05,
1438
+ "loss": 0.0022,
1439
+ "step": 4680
1440
+ },
1441
+ {
1442
+ "epoch": 3.42,
1443
+ "learning_rate": 3.1636363636363635e-05,
1444
+ "loss": 0.0018,
1445
+ "step": 4700
1446
+ },
1447
+ {
1448
+ "epoch": 3.43,
1449
+ "learning_rate": 3.1345454545454545e-05,
1450
+ "loss": 0.001,
1451
+ "step": 4720
1452
+ },
1453
+ {
1454
+ "epoch": 3.45,
1455
+ "learning_rate": 3.105454545454546e-05,
1456
+ "loss": 0.0048,
1457
+ "step": 4740
1458
+ },
1459
+ {
1460
+ "epoch": 3.46,
1461
+ "learning_rate": 3.0763636363636364e-05,
1462
+ "loss": 0.0025,
1463
+ "step": 4760
1464
+ },
1465
+ {
1466
+ "epoch": 3.48,
1467
+ "learning_rate": 3.0472727272727276e-05,
1468
+ "loss": 0.0032,
1469
+ "step": 4780
1470
+ },
1471
+ {
1472
+ "epoch": 3.49,
1473
+ "learning_rate": 3.0181818181818182e-05,
1474
+ "loss": 0.0003,
1475
+ "step": 4800
1476
+ },
1477
+ {
1478
+ "epoch": 3.51,
1479
+ "learning_rate": 2.9890909090909092e-05,
1480
+ "loss": 0.0125,
1481
+ "step": 4820
1482
+ },
1483
+ {
1484
+ "epoch": 3.52,
1485
+ "learning_rate": 2.96e-05,
1486
+ "loss": 0.0009,
1487
+ "step": 4840
1488
+ },
1489
+ {
1490
+ "epoch": 3.53,
1491
+ "learning_rate": 2.9309090909090907e-05,
1492
+ "loss": 0.0007,
1493
+ "step": 4860
1494
+ },
1495
+ {
1496
+ "epoch": 3.55,
1497
+ "learning_rate": 2.9018181818181823e-05,
1498
+ "loss": 0.0206,
1499
+ "step": 4880
1500
+ },
1501
+ {
1502
+ "epoch": 3.56,
1503
+ "learning_rate": 2.872727272727273e-05,
1504
+ "loss": 0.007,
1505
+ "step": 4900
1506
+ },
1507
+ {
1508
+ "epoch": 3.58,
1509
+ "learning_rate": 2.843636363636364e-05,
1510
+ "loss": 0.0048,
1511
+ "step": 4920
1512
+ },
1513
+ {
1514
+ "epoch": 3.59,
1515
+ "learning_rate": 2.8145454545454548e-05,
1516
+ "loss": 0.0023,
1517
+ "step": 4940
1518
+ },
1519
+ {
1520
+ "epoch": 3.61,
1521
+ "learning_rate": 2.7854545454545454e-05,
1522
+ "loss": 0.0015,
1523
+ "step": 4960
1524
+ },
1525
+ {
1526
+ "epoch": 3.62,
1527
+ "learning_rate": 2.7563636363636364e-05,
1528
+ "loss": 0.0081,
1529
+ "step": 4980
1530
+ },
1531
+ {
1532
+ "epoch": 3.64,
1533
+ "learning_rate": 2.7272727272727273e-05,
1534
+ "loss": 0.0094,
1535
+ "step": 5000
1536
+ },
1537
+ {
1538
+ "epoch": 3.65,
1539
+ "learning_rate": 2.6981818181818186e-05,
1540
+ "loss": 0.0001,
1541
+ "step": 5020
1542
+ },
1543
+ {
1544
+ "epoch": 3.67,
1545
+ "learning_rate": 2.6690909090909095e-05,
1546
+ "loss": 0.01,
1547
+ "step": 5040
1548
+ },
1549
+ {
1550
+ "epoch": 3.68,
1551
+ "learning_rate": 2.64e-05,
1552
+ "loss": 0.0074,
1553
+ "step": 5060
1554
+ },
1555
+ {
1556
+ "epoch": 3.69,
1557
+ "learning_rate": 2.610909090909091e-05,
1558
+ "loss": 0.0017,
1559
+ "step": 5080
1560
+ },
1561
+ {
1562
+ "epoch": 3.71,
1563
+ "learning_rate": 2.581818181818182e-05,
1564
+ "loss": 0.0112,
1565
+ "step": 5100
1566
+ },
1567
+ {
1568
+ "epoch": 3.72,
1569
+ "learning_rate": 2.5527272727272726e-05,
1570
+ "loss": 0.0022,
1571
+ "step": 5120
1572
+ },
1573
+ {
1574
+ "epoch": 3.74,
1575
+ "learning_rate": 2.5236363636363636e-05,
1576
+ "loss": 0.0004,
1577
+ "step": 5140
1578
+ },
1579
+ {
1580
+ "epoch": 3.75,
1581
+ "learning_rate": 2.494545454545455e-05,
1582
+ "loss": 0.0,
1583
+ "step": 5160
1584
+ },
1585
+ {
1586
+ "epoch": 3.77,
1587
+ "learning_rate": 2.4654545454545454e-05,
1588
+ "loss": 0.0134,
1589
+ "step": 5180
1590
+ },
1591
+ {
1592
+ "epoch": 3.78,
1593
+ "learning_rate": 2.4363636363636364e-05,
1594
+ "loss": 0.0014,
1595
+ "step": 5200
1596
+ },
1597
+ {
1598
+ "epoch": 3.8,
1599
+ "learning_rate": 2.4072727272727273e-05,
1600
+ "loss": 0.0001,
1601
+ "step": 5220
1602
+ },
1603
+ {
1604
+ "epoch": 3.81,
1605
+ "learning_rate": 2.3781818181818183e-05,
1606
+ "loss": 0.0075,
1607
+ "step": 5240
1608
+ },
1609
+ {
1610
+ "epoch": 3.83,
1611
+ "learning_rate": 2.3490909090909092e-05,
1612
+ "loss": 0.0021,
1613
+ "step": 5260
1614
+ },
1615
+ {
1616
+ "epoch": 3.84,
1617
+ "learning_rate": 2.32e-05,
1618
+ "loss": 0.0159,
1619
+ "step": 5280
1620
+ },
1621
+ {
1622
+ "epoch": 3.85,
1623
+ "learning_rate": 2.290909090909091e-05,
1624
+ "loss": 0.0001,
1625
+ "step": 5300
1626
+ },
1627
+ {
1628
+ "epoch": 3.87,
1629
+ "learning_rate": 2.261818181818182e-05,
1630
+ "loss": 0.0011,
1631
+ "step": 5320
1632
+ },
1633
+ {
1634
+ "epoch": 3.88,
1635
+ "learning_rate": 2.2327272727272726e-05,
1636
+ "loss": 0.0052,
1637
+ "step": 5340
1638
+ },
1639
+ {
1640
+ "epoch": 3.9,
1641
+ "learning_rate": 2.203636363636364e-05,
1642
+ "loss": 0.0162,
1643
+ "step": 5360
1644
+ },
1645
+ {
1646
+ "epoch": 3.91,
1647
+ "learning_rate": 2.1745454545454545e-05,
1648
+ "loss": 0.0066,
1649
+ "step": 5380
1650
+ },
1651
+ {
1652
+ "epoch": 3.93,
1653
+ "learning_rate": 2.1454545454545455e-05,
1654
+ "loss": 0.0022,
1655
+ "step": 5400
1656
+ },
1657
+ {
1658
+ "epoch": 3.94,
1659
+ "learning_rate": 2.1163636363636367e-05,
1660
+ "loss": 0.0049,
1661
+ "step": 5420
1662
+ },
1663
+ {
1664
+ "epoch": 3.96,
1665
+ "learning_rate": 2.0872727272727273e-05,
1666
+ "loss": 0.0147,
1667
+ "step": 5440
1668
+ },
1669
+ {
1670
+ "epoch": 3.97,
1671
+ "learning_rate": 2.0581818181818183e-05,
1672
+ "loss": 0.0015,
1673
+ "step": 5460
1674
+ },
1675
+ {
1676
+ "epoch": 3.99,
1677
+ "learning_rate": 2.0290909090909092e-05,
1678
+ "loss": 0.0129,
1679
+ "step": 5480
1680
+ },
1681
+ {
1682
+ "epoch": 4.0,
1683
+ "learning_rate": 2e-05,
1684
+ "loss": 0.001,
1685
+ "step": 5500
1686
+ },
1687
+ {
1688
+ "epoch": 4.0,
1689
+ "eval_accuracy": 0.17399999499320984,
1690
+ "eval_loss": 4.792283058166504,
1691
+ "eval_runtime": 3.3921,
1692
+ "eval_samples_per_second": 147.401,
1693
+ "eval_steps_per_second": 4.717,
1694
+ "step": 5500
1695
+ },
1696
+ {
1697
+ "epoch": 4.01,
1698
+ "learning_rate": 1.970909090909091e-05,
1699
+ "loss": 0.0,
1700
+ "step": 5520
1701
+ },
1702
+ {
1703
+ "epoch": 4.03,
1704
+ "learning_rate": 1.9418181818181817e-05,
1705
+ "loss": 0.0005,
1706
+ "step": 5540
1707
+ },
1708
+ {
1709
+ "epoch": 4.04,
1710
+ "learning_rate": 1.9127272727272726e-05,
1711
+ "loss": 0.0,
1712
+ "step": 5560
1713
+ },
1714
+ {
1715
+ "epoch": 4.06,
1716
+ "learning_rate": 1.883636363636364e-05,
1717
+ "loss": 0.0,
1718
+ "step": 5580
1719
+ },
1720
+ {
1721
+ "epoch": 4.07,
1722
+ "learning_rate": 1.8545454545454545e-05,
1723
+ "loss": 0.0011,
1724
+ "step": 5600
1725
+ },
1726
+ {
1727
+ "epoch": 4.09,
1728
+ "learning_rate": 1.8254545454545455e-05,
1729
+ "loss": 0.0021,
1730
+ "step": 5620
1731
+ },
1732
+ {
1733
+ "epoch": 4.1,
1734
+ "learning_rate": 1.7963636363636364e-05,
1735
+ "loss": 0.001,
1736
+ "step": 5640
1737
+ },
1738
+ {
1739
+ "epoch": 4.12,
1740
+ "learning_rate": 1.7672727272727274e-05,
1741
+ "loss": 0.0001,
1742
+ "step": 5660
1743
+ },
1744
+ {
1745
+ "epoch": 4.13,
1746
+ "learning_rate": 1.7381818181818183e-05,
1747
+ "loss": 0.0044,
1748
+ "step": 5680
1749
+ },
1750
+ {
1751
+ "epoch": 4.15,
1752
+ "learning_rate": 1.7090909090909092e-05,
1753
+ "loss": 0.0018,
1754
+ "step": 5700
1755
+ },
1756
+ {
1757
+ "epoch": 4.16,
1758
+ "learning_rate": 1.6800000000000002e-05,
1759
+ "loss": 0.0012,
1760
+ "step": 5720
1761
+ },
1762
+ {
1763
+ "epoch": 4.17,
1764
+ "learning_rate": 1.650909090909091e-05,
1765
+ "loss": 0.0001,
1766
+ "step": 5740
1767
+ },
1768
+ {
1769
+ "epoch": 4.19,
1770
+ "learning_rate": 1.6218181818181817e-05,
1771
+ "loss": 0.0013,
1772
+ "step": 5760
1773
+ },
1774
+ {
1775
+ "epoch": 4.2,
1776
+ "learning_rate": 1.5927272727272727e-05,
1777
+ "loss": 0.0,
1778
+ "step": 5780
1779
+ },
1780
+ {
1781
+ "epoch": 4.22,
1782
+ "learning_rate": 1.563636363636364e-05,
1783
+ "loss": 0.0003,
1784
+ "step": 5800
1785
+ },
1786
+ {
1787
+ "epoch": 4.23,
1788
+ "learning_rate": 1.5345454545454545e-05,
1789
+ "loss": 0.0001,
1790
+ "step": 5820
1791
+ },
1792
+ {
1793
+ "epoch": 4.25,
1794
+ "learning_rate": 1.5054545454545455e-05,
1795
+ "loss": 0.0003,
1796
+ "step": 5840
1797
+ },
1798
+ {
1799
+ "epoch": 4.26,
1800
+ "learning_rate": 1.4763636363636366e-05,
1801
+ "loss": 0.019,
1802
+ "step": 5860
1803
+ },
1804
+ {
1805
+ "epoch": 4.28,
1806
+ "learning_rate": 1.4472727272727274e-05,
1807
+ "loss": 0.001,
1808
+ "step": 5880
1809
+ },
1810
+ {
1811
+ "epoch": 4.29,
1812
+ "learning_rate": 1.4181818181818181e-05,
1813
+ "loss": 0.0001,
1814
+ "step": 5900
1815
+ },
1816
+ {
1817
+ "epoch": 4.31,
1818
+ "learning_rate": 1.389090909090909e-05,
1819
+ "loss": 0.0001,
1820
+ "step": 5920
1821
+ },
1822
+ {
1823
+ "epoch": 4.32,
1824
+ "learning_rate": 1.3600000000000002e-05,
1825
+ "loss": 0.0,
1826
+ "step": 5940
1827
+ },
1828
+ {
1829
+ "epoch": 4.33,
1830
+ "learning_rate": 1.330909090909091e-05,
1831
+ "loss": 0.0,
1832
+ "step": 5960
1833
+ },
1834
+ {
1835
+ "epoch": 4.35,
1836
+ "learning_rate": 1.3018181818181819e-05,
1837
+ "loss": 0.0064,
1838
+ "step": 5980
1839
+ },
1840
+ {
1841
+ "epoch": 4.36,
1842
+ "learning_rate": 1.2727272727272727e-05,
1843
+ "loss": 0.0033,
1844
+ "step": 6000
1845
+ },
1846
+ {
1847
+ "epoch": 4.38,
1848
+ "learning_rate": 1.2436363636363636e-05,
1849
+ "loss": 0.0002,
1850
+ "step": 6020
1851
+ },
1852
+ {
1853
+ "epoch": 4.39,
1854
+ "learning_rate": 1.2145454545454546e-05,
1855
+ "loss": 0.0001,
1856
+ "step": 6040
1857
+ },
1858
+ {
1859
+ "epoch": 4.41,
1860
+ "learning_rate": 1.1854545454545455e-05,
1861
+ "loss": 0.0014,
1862
+ "step": 6060
1863
+ },
1864
+ {
1865
+ "epoch": 4.42,
1866
+ "learning_rate": 1.1563636363636364e-05,
1867
+ "loss": 0.002,
1868
+ "step": 6080
1869
+ },
1870
+ {
1871
+ "epoch": 4.44,
1872
+ "learning_rate": 1.1272727272727274e-05,
1873
+ "loss": 0.0003,
1874
+ "step": 6100
1875
+ },
1876
+ {
1877
+ "epoch": 4.45,
1878
+ "learning_rate": 1.0981818181818182e-05,
1879
+ "loss": 0.0127,
1880
+ "step": 6120
1881
+ },
1882
+ {
1883
+ "epoch": 4.47,
1884
+ "learning_rate": 1.0690909090909091e-05,
1885
+ "loss": 0.0007,
1886
+ "step": 6140
1887
+ },
1888
+ {
1889
+ "epoch": 4.48,
1890
+ "learning_rate": 1.04e-05,
1891
+ "loss": 0.0086,
1892
+ "step": 6160
1893
+ },
1894
+ {
1895
+ "epoch": 4.49,
1896
+ "learning_rate": 1.010909090909091e-05,
1897
+ "loss": 0.0,
1898
+ "step": 6180
1899
+ },
1900
+ {
1901
+ "epoch": 4.51,
1902
+ "learning_rate": 9.818181818181818e-06,
1903
+ "loss": 0.0072,
1904
+ "step": 6200
1905
+ },
1906
+ {
1907
+ "epoch": 4.52,
1908
+ "learning_rate": 9.527272727272727e-06,
1909
+ "loss": 0.0002,
1910
+ "step": 6220
1911
+ },
1912
+ {
1913
+ "epoch": 4.54,
1914
+ "learning_rate": 9.236363636363638e-06,
1915
+ "loss": 0.0,
1916
+ "step": 6240
1917
+ },
1918
+ {
1919
+ "epoch": 4.55,
1920
+ "learning_rate": 8.945454545454546e-06,
1921
+ "loss": 0.0,
1922
+ "step": 6260
1923
+ },
1924
+ {
1925
+ "epoch": 4.57,
1926
+ "learning_rate": 8.654545454545455e-06,
1927
+ "loss": 0.001,
1928
+ "step": 6280
1929
+ },
1930
+ {
1931
+ "epoch": 4.58,
1932
+ "learning_rate": 8.363636363636365e-06,
1933
+ "loss": 0.0001,
1934
+ "step": 6300
1935
+ },
1936
+ {
1937
+ "epoch": 4.6,
1938
+ "learning_rate": 8.072727272727274e-06,
1939
+ "loss": 0.0,
1940
+ "step": 6320
1941
+ },
1942
+ {
1943
+ "epoch": 4.61,
1944
+ "learning_rate": 7.781818181818182e-06,
1945
+ "loss": 0.001,
1946
+ "step": 6340
1947
+ },
1948
+ {
1949
+ "epoch": 4.63,
1950
+ "learning_rate": 7.490909090909091e-06,
1951
+ "loss": 0.0017,
1952
+ "step": 6360
1953
+ },
1954
+ {
1955
+ "epoch": 4.64,
1956
+ "learning_rate": 7.2e-06,
1957
+ "loss": 0.0,
1958
+ "step": 6380
1959
+ },
1960
+ {
1961
+ "epoch": 4.65,
1962
+ "learning_rate": 6.909090909090909e-06,
1963
+ "loss": 0.0,
1964
+ "step": 6400
1965
+ },
1966
+ {
1967
+ "epoch": 4.67,
1968
+ "learning_rate": 6.618181818181818e-06,
1969
+ "loss": 0.0143,
1970
+ "step": 6420
1971
+ },
1972
+ {
1973
+ "epoch": 4.68,
1974
+ "learning_rate": 6.327272727272728e-06,
1975
+ "loss": 0.0,
1976
+ "step": 6440
1977
+ },
1978
+ {
1979
+ "epoch": 4.7,
1980
+ "learning_rate": 6.0363636363636365e-06,
1981
+ "loss": 0.0,
1982
+ "step": 6460
1983
+ },
1984
+ {
1985
+ "epoch": 4.71,
1986
+ "learning_rate": 5.745454545454546e-06,
1987
+ "loss": 0.0029,
1988
+ "step": 6480
1989
+ },
1990
+ {
1991
+ "epoch": 4.73,
1992
+ "learning_rate": 5.4545454545454545e-06,
1993
+ "loss": 0.0018,
1994
+ "step": 6500
1995
+ },
1996
+ {
1997
+ "epoch": 4.74,
1998
+ "learning_rate": 5.163636363636364e-06,
1999
+ "loss": 0.0,
2000
+ "step": 6520
2001
+ },
2002
+ {
2003
+ "epoch": 4.76,
2004
+ "learning_rate": 4.872727272727273e-06,
2005
+ "loss": 0.0001,
2006
+ "step": 6540
2007
+ },
2008
+ {
2009
+ "epoch": 4.77,
2010
+ "learning_rate": 4.581818181818182e-06,
2011
+ "loss": 0.0001,
2012
+ "step": 6560
2013
+ },
2014
+ {
2015
+ "epoch": 4.79,
2016
+ "learning_rate": 4.290909090909091e-06,
2017
+ "loss": 0.0,
2018
+ "step": 6580
2019
+ },
2020
+ {
2021
+ "epoch": 4.8,
2022
+ "learning_rate": 4.000000000000001e-06,
2023
+ "loss": 0.0019,
2024
+ "step": 6600
2025
+ },
2026
+ {
2027
+ "epoch": 4.81,
2028
+ "learning_rate": 3.7090909090909092e-06,
2029
+ "loss": 0.0001,
2030
+ "step": 6620
2031
+ },
2032
+ {
2033
+ "epoch": 4.83,
2034
+ "learning_rate": 3.4181818181818182e-06,
2035
+ "loss": 0.0003,
2036
+ "step": 6640
2037
+ },
2038
+ {
2039
+ "epoch": 4.84,
2040
+ "learning_rate": 3.127272727272727e-06,
2041
+ "loss": 0.0004,
2042
+ "step": 6660
2043
+ },
2044
+ {
2045
+ "epoch": 4.86,
2046
+ "learning_rate": 2.8363636363636366e-06,
2047
+ "loss": 0.0037,
2048
+ "step": 6680
2049
+ },
2050
+ {
2051
+ "epoch": 4.87,
2052
+ "learning_rate": 2.5454545454545456e-06,
2053
+ "loss": 0.0015,
2054
+ "step": 6700
2055
+ },
2056
+ {
2057
+ "epoch": 4.89,
2058
+ "learning_rate": 2.2545454545454546e-06,
2059
+ "loss": 0.0002,
2060
+ "step": 6720
2061
+ },
2062
+ {
2063
+ "epoch": 4.9,
2064
+ "learning_rate": 1.9636363636363636e-06,
2065
+ "loss": 0.0144,
2066
+ "step": 6740
2067
+ },
2068
+ {
2069
+ "epoch": 4.92,
2070
+ "learning_rate": 1.6727272727272728e-06,
2071
+ "loss": 0.0052,
2072
+ "step": 6760
2073
+ },
2074
+ {
2075
+ "epoch": 4.93,
2076
+ "learning_rate": 1.3818181818181818e-06,
2077
+ "loss": 0.0005,
2078
+ "step": 6780
2079
+ },
2080
+ {
2081
+ "epoch": 4.95,
2082
+ "learning_rate": 1.090909090909091e-06,
2083
+ "loss": 0.0003,
2084
+ "step": 6800
2085
+ },
2086
+ {
2087
+ "epoch": 4.96,
2088
+ "learning_rate": 8.000000000000001e-07,
2089
+ "loss": 0.0082,
2090
+ "step": 6820
2091
+ },
2092
+ {
2093
+ "epoch": 4.97,
2094
+ "learning_rate": 5.090909090909092e-07,
2095
+ "loss": 0.0,
2096
+ "step": 6840
2097
+ },
2098
+ {
2099
+ "epoch": 4.99,
2100
+ "learning_rate": 2.181818181818182e-07,
2101
+ "loss": 0.0008,
2102
+ "step": 6860
2103
+ },
2104
+ {
2105
+ "epoch": 5.0,
2106
+ "eval_accuracy": 0.15800000727176666,
2107
+ "eval_loss": 4.613570213317871,
2108
+ "eval_runtime": 3.3639,
2109
+ "eval_samples_per_second": 148.638,
2110
+ "eval_steps_per_second": 4.756,
2111
+ "step": 6875
2112
+ },
2113
+ {
2114
+ "epoch": 5.0,
2115
+ "step": 6875,
2116
+ "total_flos": 2.323364869172544e+16,
2117
+ "train_loss": 0.06812760998129988,
2118
+ "train_runtime": 4390.0209,
2119
+ "train_samples_per_second": 50.114,
2120
+ "train_steps_per_second": 1.566
2121
+ }
2122
+ ],
2123
+ "max_steps": 6875,
2124
+ "num_train_epochs": 5,
2125
+ "total_flos": 2.323364869172544e+16,
2126
+ "trial_name": null,
2127
+ "trial_params": null
2128
+ }