kertob commited on
Commit
16f65f0
1 Parent(s): 0bb8963

Training in progress, step 60

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4f9455d231288418b4cb607f28ae2de2dda8e53c7ad0a5a7b03760c2cfa64626
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fea28d878e9d89dbd06a75dd3cdef354c24d073f4b15632a318a4cab6ef2bc3a
3
  size 261131840
runs/Mar08_12-04-48_4997a2709b0f/events.out.tfevents.1709899498.4997a2709b0f.941.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:09b41f1efc6365282bcec442711258f604e985434c508136af22805a0d469371
3
- size 6767
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c96b705ebeeda06d318124a4372aa7c489e6efaa1aaf82b177496e2d0f8cbbc
3
+ size 6974
wandb/debug-internal.log CHANGED
@@ -317,3 +317,58 @@
317
  2024-03-08 12:21:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
318
  2024-03-08 12:21:10,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
319
  2024-03-08 12:21:14,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
317
  2024-03-08 12:21:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
318
  2024-03-08 12:21:10,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
319
  2024-03-08 12:21:14,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
320
+ 2024-03-08 12:21:19,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
321
+ 2024-03-08 12:21:24,469 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
322
+ 2024-03-08 12:21:25,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
323
+ 2024-03-08 12:21:25,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
324
+ 2024-03-08 12:21:25,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
325
+ 2024-03-08 12:21:30,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
326
+ 2024-03-08 12:21:35,389 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
327
+ 2024-03-08 12:21:39,783 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
328
+ 2024-03-08 12:21:40,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
329
+ 2024-03-08 12:21:40,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
330
+ 2024-03-08 12:21:40,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
331
+ 2024-03-08 12:21:40,489 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
332
+ 2024-03-08 12:21:45,490 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
333
+ 2024-03-08 12:21:50,491 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
334
+ 2024-03-08 12:21:55,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
335
+ 2024-03-08 12:21:55,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
336
+ 2024-03-08 12:21:55,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
337
+ 2024-03-08 12:21:56,408 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
338
+ 2024-03-08 12:22:01,409 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
339
+ 2024-03-08 12:22:06,410 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
340
+ 2024-03-08 12:22:09,784 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
341
+ 2024-03-08 12:22:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
342
+ 2024-03-08 12:22:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
343
+ 2024-03-08 12:22:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
344
+ 2024-03-08 12:22:12,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
345
+ 2024-03-08 12:22:17,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
346
+ 2024-03-08 12:22:22,402 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
347
+ 2024-03-08 12:22:25,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
348
+ 2024-03-08 12:22:25,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
349
+ 2024-03-08 12:22:25,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
350
+ 2024-03-08 12:22:27,411 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
351
+ 2024-03-08 12:22:32,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
352
+ 2024-03-08 12:22:37,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
353
+ 2024-03-08 12:22:39,785 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
354
+ 2024-03-08 12:22:40,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
355
+ 2024-03-08 12:22:40,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
356
+ 2024-03-08 12:22:40,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
357
+ 2024-03-08 12:22:42,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
358
+ 2024-03-08 12:22:47,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
359
+ 2024-03-08 12:22:52,161 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
360
+ 2024-03-08 12:22:52,162 DEBUG SenderThread:10843 [sender.py:send():378] send: history
361
+ 2024-03-08 12:22:52,163 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
362
+ 2024-03-08 12:22:52,163 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
363
+ 2024-03-08 12:22:52,839 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
364
+ 2024-03-08 12:22:53,164 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
365
+ 2024-03-08 12:22:55,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
366
+ 2024-03-08 12:22:55,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
367
+ 2024-03-08 12:22:55,204 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
368
+ 2024-03-08 12:22:58,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
369
+ 2024-03-08 12:23:03,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
370
+ 2024-03-08 12:23:08,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
371
+ 2024-03-08 12:23:09,786 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
372
+ 2024-03-08 12:23:10,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
373
+ 2024-03-08 12:23:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
374
+ 2024-03-08 12:23:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.0, "train/grad_norm": 0.000341083446983248, "train/learning_rate": 0.00018550053929480202, "train/epoch": 4.0, "train/global_step": 50, "_timestamp": 1709900457.557282, "_runtime": 563.4966549873352, "_step": 4}
 
1
+ {"train/loss": 0.0, "train/grad_norm": 0.00020636935369111598, "train/learning_rate": 0.0001780673851171728, "train/epoch": 4.8, "train/global_step": 60, "_timestamp": 1709900572.1609302, "_runtime": 678.1003031730652, "_step": 5}
wandb/run-20240308_121134-5y42ufcl/logs/debug-internal.log CHANGED
@@ -317,3 +317,58 @@
317
  2024-03-08 12:21:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
318
  2024-03-08 12:21:10,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
319
  2024-03-08 12:21:14,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
317
  2024-03-08 12:21:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
318
  2024-03-08 12:21:10,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
319
  2024-03-08 12:21:14,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
320
+ 2024-03-08 12:21:19,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
321
+ 2024-03-08 12:21:24,469 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
322
+ 2024-03-08 12:21:25,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
323
+ 2024-03-08 12:21:25,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
324
+ 2024-03-08 12:21:25,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
325
+ 2024-03-08 12:21:30,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
326
+ 2024-03-08 12:21:35,389 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
327
+ 2024-03-08 12:21:39,783 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
328
+ 2024-03-08 12:21:40,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
329
+ 2024-03-08 12:21:40,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
330
+ 2024-03-08 12:21:40,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
331
+ 2024-03-08 12:21:40,489 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
332
+ 2024-03-08 12:21:45,490 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
333
+ 2024-03-08 12:21:50,491 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
334
+ 2024-03-08 12:21:55,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
335
+ 2024-03-08 12:21:55,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
336
+ 2024-03-08 12:21:55,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
337
+ 2024-03-08 12:21:56,408 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
338
+ 2024-03-08 12:22:01,409 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
339
+ 2024-03-08 12:22:06,410 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
340
+ 2024-03-08 12:22:09,784 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
341
+ 2024-03-08 12:22:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
342
+ 2024-03-08 12:22:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
343
+ 2024-03-08 12:22:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
344
+ 2024-03-08 12:22:12,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
345
+ 2024-03-08 12:22:17,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
346
+ 2024-03-08 12:22:22,402 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
347
+ 2024-03-08 12:22:25,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
348
+ 2024-03-08 12:22:25,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
349
+ 2024-03-08 12:22:25,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
350
+ 2024-03-08 12:22:27,411 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
351
+ 2024-03-08 12:22:32,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
352
+ 2024-03-08 12:22:37,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
353
+ 2024-03-08 12:22:39,785 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
354
+ 2024-03-08 12:22:40,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
355
+ 2024-03-08 12:22:40,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
356
+ 2024-03-08 12:22:40,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
357
+ 2024-03-08 12:22:42,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
358
+ 2024-03-08 12:22:47,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
359
+ 2024-03-08 12:22:52,161 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
360
+ 2024-03-08 12:22:52,162 DEBUG SenderThread:10843 [sender.py:send():378] send: history
361
+ 2024-03-08 12:22:52,163 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
362
+ 2024-03-08 12:22:52,163 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
363
+ 2024-03-08 12:22:52,839 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
364
+ 2024-03-08 12:22:53,164 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
365
+ 2024-03-08 12:22:55,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
366
+ 2024-03-08 12:22:55,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
367
+ 2024-03-08 12:22:55,204 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
368
+ 2024-03-08 12:22:58,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
369
+ 2024-03-08 12:23:03,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
370
+ 2024-03-08 12:23:08,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
371
+ 2024-03-08 12:23:09,786 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
372
+ 2024-03-08 12:23:10,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
373
+ 2024-03-08 12:23:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
374
+ 2024-03-08 12:23:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb CHANGED
Binary files a/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb and b/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb differ