kertob commited on
Commit
53a4939
1 Parent(s): 8746b08

Training in progress, step 30

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2cdf075222b2659ea6a422ed17bc20843a9ec2f86b7b7259531df8e479838a16
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b68c742e89c2da647f9bd7ae8e40311cf034b8e7e5fa345b2d535b461a2b0fd3
3
  size 261131840
runs/Mar08_12-04-48_4997a2709b0f/events.out.tfevents.1709899498.4997a2709b0f.941.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dcf5a2da29f5ecfb4c8861c7cb1a54a364dbf0fafe2e1f0021d16c0ac7a1559f
3
- size 6146
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:921599c6f3be12d8275e0707f8e0555649f4abb6ccba7c85805fa1cbf56ca2d2
3
+ size 6353
wandb/debug-internal.log CHANGED
@@ -162,3 +162,51 @@
162
  2024-03-08 12:15:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
163
  2024-03-08 12:15:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
164
  2024-03-08 12:15:44,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
162
  2024-03-08 12:15:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
163
  2024-03-08 12:15:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
164
  2024-03-08 12:15:44,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
165
+ 2024-03-08 12:15:49,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
166
+ 2024-03-08 12:15:54,470 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
167
+ 2024-03-08 12:15:55,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
168
+ 2024-03-08 12:15:55,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
169
+ 2024-03-08 12:15:55,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
170
+ 2024-03-08 12:16:00,453 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
171
+ 2024-03-08 12:16:05,454 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
172
+ 2024-03-08 12:16:09,775 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
173
+ 2024-03-08 12:16:10,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
174
+ 2024-03-08 12:16:10,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
175
+ 2024-03-08 12:16:10,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
176
+ 2024-03-08 12:16:11,398 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
177
+ 2024-03-08 12:16:16,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
178
+ 2024-03-08 12:16:21,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
179
+ 2024-03-08 12:16:25,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
180
+ 2024-03-08 12:16:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
181
+ 2024-03-08 12:16:25,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
182
+ 2024-03-08 12:16:26,495 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
183
+ 2024-03-08 12:16:31,496 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
184
+ 2024-03-08 12:16:36,497 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
185
+ 2024-03-08 12:16:39,776 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
186
+ 2024-03-08 12:16:40,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
187
+ 2024-03-08 12:16:40,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
188
+ 2024-03-08 12:16:40,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
189
+ 2024-03-08 12:16:42,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
190
+ 2024-03-08 12:16:47,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
191
+ 2024-03-08 12:16:52,392 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
192
+ 2024-03-08 12:16:55,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
193
+ 2024-03-08 12:16:55,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
194
+ 2024-03-08 12:16:55,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
195
+ 2024-03-08 12:16:58,386 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
196
+ 2024-03-08 12:17:03,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
197
+ 2024-03-08 12:17:07,644 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
198
+ 2024-03-08 12:17:07,646 DEBUG SenderThread:10843 [sender.py:send():378] send: history
199
+ 2024-03-08 12:17:07,646 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
200
+ 2024-03-08 12:17:07,646 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
201
+ 2024-03-08 12:17:07,717 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
202
+ 2024-03-08 12:17:08,647 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
203
+ 2024-03-08 12:17:09,777 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
204
+ 2024-03-08 12:17:10,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
205
+ 2024-03-08 12:17:10,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
206
+ 2024-03-08 12:17:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
207
+ 2024-03-08 12:17:14,437 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
208
+ 2024-03-08 12:17:19,438 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
209
+ 2024-03-08 12:17:24,439 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
210
+ 2024-03-08 12:17:25,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
211
+ 2024-03-08 12:17:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
212
+ 2024-03-08 12:17:25,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.0945, "train/grad_norm": 0.021162761375308037, "train/learning_rate": 0.00019878905881817252, "train/epoch": 1.6, "train/global_step": 20, "_timestamp": 1709900112.4008648, "_runtime": 218.34023785591125, "_step": 1}
 
1
+ {"train/loss": 0.0005, "train/grad_norm": 0.0040849302895367146, "train/learning_rate": 0.00019594929736144976, "train/epoch": 2.4, "train/global_step": 30, "_timestamp": 1709900227.6440701, "_runtime": 333.58344316482544, "_step": 2}
wandb/run-20240308_121134-5y42ufcl/logs/debug-internal.log CHANGED
@@ -162,3 +162,51 @@
162
  2024-03-08 12:15:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
163
  2024-03-08 12:15:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
164
  2024-03-08 12:15:44,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
162
  2024-03-08 12:15:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
163
  2024-03-08 12:15:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
164
  2024-03-08 12:15:44,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
165
+ 2024-03-08 12:15:49,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
166
+ 2024-03-08 12:15:54,470 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
167
+ 2024-03-08 12:15:55,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
168
+ 2024-03-08 12:15:55,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
169
+ 2024-03-08 12:15:55,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
170
+ 2024-03-08 12:16:00,453 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
171
+ 2024-03-08 12:16:05,454 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
172
+ 2024-03-08 12:16:09,775 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
173
+ 2024-03-08 12:16:10,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
174
+ 2024-03-08 12:16:10,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
175
+ 2024-03-08 12:16:10,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
176
+ 2024-03-08 12:16:11,398 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
177
+ 2024-03-08 12:16:16,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
178
+ 2024-03-08 12:16:21,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
179
+ 2024-03-08 12:16:25,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
180
+ 2024-03-08 12:16:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
181
+ 2024-03-08 12:16:25,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
182
+ 2024-03-08 12:16:26,495 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
183
+ 2024-03-08 12:16:31,496 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
184
+ 2024-03-08 12:16:36,497 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
185
+ 2024-03-08 12:16:39,776 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
186
+ 2024-03-08 12:16:40,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
187
+ 2024-03-08 12:16:40,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
188
+ 2024-03-08 12:16:40,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
189
+ 2024-03-08 12:16:42,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
190
+ 2024-03-08 12:16:47,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
191
+ 2024-03-08 12:16:52,392 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
192
+ 2024-03-08 12:16:55,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
193
+ 2024-03-08 12:16:55,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
194
+ 2024-03-08 12:16:55,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
195
+ 2024-03-08 12:16:58,386 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
196
+ 2024-03-08 12:17:03,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
197
+ 2024-03-08 12:17:07,644 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
198
+ 2024-03-08 12:17:07,646 DEBUG SenderThread:10843 [sender.py:send():378] send: history
199
+ 2024-03-08 12:17:07,646 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
200
+ 2024-03-08 12:17:07,646 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
201
+ 2024-03-08 12:17:07,717 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
202
+ 2024-03-08 12:17:08,647 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
203
+ 2024-03-08 12:17:09,777 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
204
+ 2024-03-08 12:17:10,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
205
+ 2024-03-08 12:17:10,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
206
+ 2024-03-08 12:17:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
207
+ 2024-03-08 12:17:14,437 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
208
+ 2024-03-08 12:17:19,438 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
209
+ 2024-03-08 12:17:24,439 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
210
+ 2024-03-08 12:17:25,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
211
+ 2024-03-08 12:17:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
212
+ 2024-03-08 12:17:25,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb CHANGED
Binary files a/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb and b/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb differ