kertob commited on
Commit
5ef9455
1 Parent(s): 8178e8f

Training in progress, step 180

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e0053222a420057ad5c081c16a4e01eb335b358715b8da44b935977e67e3734
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12b4877e33932f546ab6653b795adaac9393810aa60a67d4726d7f7bd3810db2
3
  size 261131840
runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f0d17095a316176cd3ad077b2abf3e425bd4ee1f7f0b24c9a44496ef2a8a5e87
3
- size 9271
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a22aac4d8d26e14511d71ceeaa84255d5afbb1dfaeb19e1743ea13dd81f07b18
3
+ size 9482
wandb/debug-internal.log CHANGED
@@ -831,3 +831,47 @@
831
  2024-03-08 14:16:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
832
  2024-03-08 14:16:07,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
833
  2024-03-08 14:16:09,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
831
  2024-03-08 14:16:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
832
  2024-03-08 14:16:07,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
833
  2024-03-08 14:16:09,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
834
+ 2024-03-08 14:16:14,059 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
835
+ 2024-03-08 14:16:19,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
836
+ 2024-03-08 14:16:22,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
837
+ 2024-03-08 14:16:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
838
+ 2024-03-08 14:16:22,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
839
+ 2024-03-08 14:16:24,145 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
840
+ 2024-03-08 14:16:29,146 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
841
+ 2024-03-08 14:16:34,147 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
842
+ 2024-03-08 14:16:37,213 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
843
+ 2024-03-08 14:16:37,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
844
+ 2024-03-08 14:16:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
845
+ 2024-03-08 14:16:37,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
846
+ 2024-03-08 14:16:40,079 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
847
+ 2024-03-08 14:16:45,080 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
848
+ 2024-03-08 14:16:50,081 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
849
+ 2024-03-08 14:16:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
850
+ 2024-03-08 14:16:52,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
851
+ 2024-03-08 14:16:52,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
852
+ 2024-03-08 14:16:55,084 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
853
+ 2024-03-08 14:17:00,085 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
854
+ 2024-03-08 14:17:05,086 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
855
+ 2024-03-08 14:17:07,214 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
856
+ 2024-03-08 14:17:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
857
+ 2024-03-08 14:17:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
858
+ 2024-03-08 14:17:07,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
859
+ 2024-03-08 14:17:11,034 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
860
+ 2024-03-08 14:17:16,035 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
861
+ 2024-03-08 14:17:17,570 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
862
+ 2024-03-08 14:17:17,571 DEBUG SenderThread:37167 [sender.py:send():378] send: history
863
+ 2024-03-08 14:17:17,571 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
864
+ 2024-03-08 14:17:17,572 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
865
+ 2024-03-08 14:17:17,577 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
866
+ 2024-03-08 14:17:21,573 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
867
+ 2024-03-08 14:17:22,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
868
+ 2024-03-08 14:17:22,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
869
+ 2024-03-08 14:17:22,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
870
+ 2024-03-08 14:17:27,473 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
871
+ 2024-03-08 14:17:32,474 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
872
+ 2024-03-08 14:17:37,215 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
873
+ 2024-03-08 14:17:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
874
+ 2024-03-08 14:17:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
875
+ 2024-03-08 14:17:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
876
+ 2024-03-08 14:17:37,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
877
+ 2024-03-08 14:17:43,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.1498, "train/grad_norm": 0.5235738158226013, "train/learning_rate": 5.785225463498828e-06, "train/epoch": 13.6, "train/global_step": 170, "_timestamp": 1709907342.1599762, "_runtime": 1600.7396793365479, "_step": 16}
 
1
+ {"train/loss": 0.1517, "train/grad_norm": 0.5520470142364502, "train/learning_rate": 2.5995410021864787e-06, "train/epoch": 14.4, "train/global_step": 180, "_timestamp": 1709907437.5697315, "_runtime": 1696.1494345664978, "_step": 17}
wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log CHANGED
@@ -831,3 +831,47 @@
831
  2024-03-08 14:16:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
832
  2024-03-08 14:16:07,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
833
  2024-03-08 14:16:09,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
831
  2024-03-08 14:16:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
832
  2024-03-08 14:16:07,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
833
  2024-03-08 14:16:09,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
834
+ 2024-03-08 14:16:14,059 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
835
+ 2024-03-08 14:16:19,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
836
+ 2024-03-08 14:16:22,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
837
+ 2024-03-08 14:16:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
838
+ 2024-03-08 14:16:22,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
839
+ 2024-03-08 14:16:24,145 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
840
+ 2024-03-08 14:16:29,146 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
841
+ 2024-03-08 14:16:34,147 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
842
+ 2024-03-08 14:16:37,213 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
843
+ 2024-03-08 14:16:37,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
844
+ 2024-03-08 14:16:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
845
+ 2024-03-08 14:16:37,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
846
+ 2024-03-08 14:16:40,079 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
847
+ 2024-03-08 14:16:45,080 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
848
+ 2024-03-08 14:16:50,081 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
849
+ 2024-03-08 14:16:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
850
+ 2024-03-08 14:16:52,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
851
+ 2024-03-08 14:16:52,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
852
+ 2024-03-08 14:16:55,084 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
853
+ 2024-03-08 14:17:00,085 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
854
+ 2024-03-08 14:17:05,086 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
855
+ 2024-03-08 14:17:07,214 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
856
+ 2024-03-08 14:17:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
857
+ 2024-03-08 14:17:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
858
+ 2024-03-08 14:17:07,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
859
+ 2024-03-08 14:17:11,034 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
860
+ 2024-03-08 14:17:16,035 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
861
+ 2024-03-08 14:17:17,570 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
862
+ 2024-03-08 14:17:17,571 DEBUG SenderThread:37167 [sender.py:send():378] send: history
863
+ 2024-03-08 14:17:17,571 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
864
+ 2024-03-08 14:17:17,572 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
865
+ 2024-03-08 14:17:17,577 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
866
+ 2024-03-08 14:17:21,573 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
867
+ 2024-03-08 14:17:22,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
868
+ 2024-03-08 14:17:22,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
869
+ 2024-03-08 14:17:22,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
870
+ 2024-03-08 14:17:27,473 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
871
+ 2024-03-08 14:17:32,474 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
872
+ 2024-03-08 14:17:37,215 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
873
+ 2024-03-08 14:17:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
874
+ 2024-03-08 14:17:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
875
+ 2024-03-08 14:17:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
876
+ 2024-03-08 14:17:37,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
877
+ 2024-03-08 14:17:43,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb CHANGED
Binary files a/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb and b/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb differ