kertob commited on
Commit
107d22b
1 Parent(s): 16f65f0

Training in progress, step 70

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fea28d878e9d89dbd06a75dd3cdef354c24d073f4b15632a318a4cab6ef2bc3a
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8df6f10769ff75b9d82fa0d8ea60820a86699a8d464200a0872d5eb089b3696f
3
  size 261131840
runs/Mar08_12-04-48_4997a2709b0f/events.out.tfevents.1709899498.4997a2709b0f.941.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c96b705ebeeda06d318124a4372aa7c489e6efaa1aaf82b177496e2d0f8cbbc
3
- size 6974
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab4e5ec032a62754594b4575ca329848547fecd184b34c3f5260b3ade0b3c331
3
+ size 7181
wandb/debug-internal.log CHANGED
@@ -372,3 +372,59 @@
372
  2024-03-08 12:23:10,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
373
  2024-03-08 12:23:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
374
  2024-03-08 12:23:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
372
  2024-03-08 12:23:10,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
373
  2024-03-08 12:23:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
374
  2024-03-08 12:23:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
375
+ 2024-03-08 12:23:13,481 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
376
+ 2024-03-08 12:23:18,482 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
377
+ 2024-03-08 12:23:23,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
378
+ 2024-03-08 12:23:25,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
379
+ 2024-03-08 12:23:25,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
380
+ 2024-03-08 12:23:25,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
381
+ 2024-03-08 12:23:29,479 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
382
+ 2024-03-08 12:23:34,480 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
383
+ 2024-03-08 12:23:39,481 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
384
+ 2024-03-08 12:23:39,786 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
385
+ 2024-03-08 12:23:40,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
386
+ 2024-03-08 12:23:40,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
387
+ 2024-03-08 12:23:40,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
388
+ 2024-03-08 12:23:45,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
389
+ 2024-03-08 12:23:50,393 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
390
+ 2024-03-08 12:23:55,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
391
+ 2024-03-08 12:23:55,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
392
+ 2024-03-08 12:23:55,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
393
+ 2024-03-08 12:23:55,482 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
394
+ 2024-03-08 12:24:00,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
395
+ 2024-03-08 12:24:05,484 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
396
+ 2024-03-08 12:24:09,787 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
397
+ 2024-03-08 12:24:10,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
398
+ 2024-03-08 12:24:10,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
399
+ 2024-03-08 12:24:10,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
400
+ 2024-03-08 12:24:11,458 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
401
+ 2024-03-08 12:24:16,459 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
402
+ 2024-03-08 12:24:21,460 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
403
+ 2024-03-08 12:24:25,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
404
+ 2024-03-08 12:24:25,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
405
+ 2024-03-08 12:24:25,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
406
+ 2024-03-08 12:24:27,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
407
+ 2024-03-08 12:24:32,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
408
+ 2024-03-08 12:24:37,390 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
409
+ 2024-03-08 12:24:39,788 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
410
+ 2024-03-08 12:24:40,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
411
+ 2024-03-08 12:24:40,203 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
412
+ 2024-03-08 12:24:40,243 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
413
+ 2024-03-08 12:24:42,441 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
414
+ 2024-03-08 12:24:46,078 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
415
+ 2024-03-08 12:24:46,079 DEBUG SenderThread:10843 [sender.py:send():378] send: history
416
+ 2024-03-08 12:24:46,080 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
417
+ 2024-03-08 12:24:46,080 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
418
+ 2024-03-08 12:24:46,879 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
419
+ 2024-03-08 12:24:48,081 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
420
+ 2024-03-08 12:24:53,082 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
421
+ 2024-03-08 12:24:55,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
422
+ 2024-03-08 12:24:55,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
423
+ 2024-03-08 12:24:55,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
424
+ 2024-03-08 12:24:58,475 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
425
+ 2024-03-08 12:25:03,477 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
426
+ 2024-03-08 12:25:08,478 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
427
+ 2024-03-08 12:25:09,789 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
428
+ 2024-03-08 12:25:10,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
429
+ 2024-03-08 12:25:10,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
430
+ 2024-03-08 12:25:10,244 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.0, "train/grad_norm": 0.00020636935369111598, "train/learning_rate": 0.0001780673851171728, "train/epoch": 4.8, "train/global_step": 60, "_timestamp": 1709900572.1609302, "_runtime": 678.1003031730652, "_step": 5}
 
1
+ {"train/loss": 0.0, "train/grad_norm": 0.00014634178660344332, "train/learning_rate": 0.0001693204328025389, "train/epoch": 5.6, "train/global_step": 70, "_timestamp": 1709900686.0780377, "_runtime": 792.0174107551575, "_step": 6}
wandb/run-20240308_121134-5y42ufcl/logs/debug-internal.log CHANGED
@@ -372,3 +372,59 @@
372
  2024-03-08 12:23:10,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
373
  2024-03-08 12:23:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
374
  2024-03-08 12:23:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
372
  2024-03-08 12:23:10,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
373
  2024-03-08 12:23:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
374
  2024-03-08 12:23:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
375
+ 2024-03-08 12:23:13,481 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
376
+ 2024-03-08 12:23:18,482 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
377
+ 2024-03-08 12:23:23,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
378
+ 2024-03-08 12:23:25,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
379
+ 2024-03-08 12:23:25,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
380
+ 2024-03-08 12:23:25,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
381
+ 2024-03-08 12:23:29,479 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
382
+ 2024-03-08 12:23:34,480 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
383
+ 2024-03-08 12:23:39,481 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
384
+ 2024-03-08 12:23:39,786 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
385
+ 2024-03-08 12:23:40,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
386
+ 2024-03-08 12:23:40,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
387
+ 2024-03-08 12:23:40,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
388
+ 2024-03-08 12:23:45,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
389
+ 2024-03-08 12:23:50,393 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
390
+ 2024-03-08 12:23:55,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
391
+ 2024-03-08 12:23:55,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
392
+ 2024-03-08 12:23:55,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
393
+ 2024-03-08 12:23:55,482 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
394
+ 2024-03-08 12:24:00,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
395
+ 2024-03-08 12:24:05,484 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
396
+ 2024-03-08 12:24:09,787 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
397
+ 2024-03-08 12:24:10,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
398
+ 2024-03-08 12:24:10,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
399
+ 2024-03-08 12:24:10,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
400
+ 2024-03-08 12:24:11,458 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
401
+ 2024-03-08 12:24:16,459 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
402
+ 2024-03-08 12:24:21,460 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
403
+ 2024-03-08 12:24:25,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
404
+ 2024-03-08 12:24:25,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
405
+ 2024-03-08 12:24:25,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
406
+ 2024-03-08 12:24:27,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
407
+ 2024-03-08 12:24:32,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
408
+ 2024-03-08 12:24:37,390 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
409
+ 2024-03-08 12:24:39,788 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
410
+ 2024-03-08 12:24:40,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
411
+ 2024-03-08 12:24:40,203 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
412
+ 2024-03-08 12:24:40,243 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
413
+ 2024-03-08 12:24:42,441 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
414
+ 2024-03-08 12:24:46,078 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
415
+ 2024-03-08 12:24:46,079 DEBUG SenderThread:10843 [sender.py:send():378] send: history
416
+ 2024-03-08 12:24:46,080 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
417
+ 2024-03-08 12:24:46,080 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
418
+ 2024-03-08 12:24:46,879 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
419
+ 2024-03-08 12:24:48,081 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
420
+ 2024-03-08 12:24:53,082 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
421
+ 2024-03-08 12:24:55,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
422
+ 2024-03-08 12:24:55,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
423
+ 2024-03-08 12:24:55,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
424
+ 2024-03-08 12:24:58,475 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
425
+ 2024-03-08 12:25:03,477 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
426
+ 2024-03-08 12:25:08,478 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
427
+ 2024-03-08 12:25:09,789 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
428
+ 2024-03-08 12:25:10,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
429
+ 2024-03-08 12:25:10,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
430
+ 2024-03-08 12:25:10,244 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb CHANGED
Binary files a/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb and b/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb differ