kertob commited on
Commit
8178e8f
1 Parent(s): af2a9df

Training in progress, step 170

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2570af0bac1b60bfa547eebebbf53b89a3e1e405c332644cd7377809f9964e4b
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e0053222a420057ad5c081c16a4e01eb335b358715b8da44b935977e67e3734
3
  size 261131840
runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c77d214d2bf5fca874bd99f7930db918fcfa31ab152d95e5bc08ab535c510ed5
3
- size 9060
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0d17095a316176cd3ad077b2abf3e425bd4ee1f7f0b24c9a44496ef2a8a5e87
3
+ size 9271
wandb/debug-internal.log CHANGED
@@ -782,3 +782,52 @@
782
  2024-03-08 14:14:22,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
783
  2024-03-08 14:14:25,077 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
784
  2024-03-08 14:14:30,078 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
782
  2024-03-08 14:14:22,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
783
  2024-03-08 14:14:25,077 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
784
  2024-03-08 14:14:30,078 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
785
+ 2024-03-08 14:14:35,079 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
786
+ 2024-03-08 14:14:37,211 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
787
+ 2024-03-08 14:14:37,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
788
+ 2024-03-08 14:14:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
789
+ 2024-03-08 14:14:37,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
790
+ 2024-03-08 14:14:40,108 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
791
+ 2024-03-08 14:14:45,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
792
+ 2024-03-08 14:14:50,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
793
+ 2024-03-08 14:14:52,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
794
+ 2024-03-08 14:14:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
795
+ 2024-03-08 14:14:52,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
796
+ 2024-03-08 14:14:56,104 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
797
+ 2024-03-08 14:15:01,105 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
798
+ 2024-03-08 14:15:06,106 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
799
+ 2024-03-08 14:15:07,211 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
800
+ 2024-03-08 14:15:07,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
801
+ 2024-03-08 14:15:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
802
+ 2024-03-08 14:15:07,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
803
+ 2024-03-08 14:15:12,030 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
804
+ 2024-03-08 14:15:17,031 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
805
+ 2024-03-08 14:15:22,032 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
806
+ 2024-03-08 14:15:22,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
807
+ 2024-03-08 14:15:22,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
808
+ 2024-03-08 14:15:22,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
809
+ 2024-03-08 14:15:28,028 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
810
+ 2024-03-08 14:15:33,029 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
811
+ 2024-03-08 14:15:37,212 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
812
+ 2024-03-08 14:15:37,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
813
+ 2024-03-08 14:15:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
814
+ 2024-03-08 14:15:37,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
815
+ 2024-03-08 14:15:38,063 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
816
+ 2024-03-08 14:15:42,160 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
817
+ 2024-03-08 14:15:42,161 DEBUG SenderThread:37167 [sender.py:send():378] send: history
818
+ 2024-03-08 14:15:42,162 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
819
+ 2024-03-08 14:15:42,162 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
820
+ 2024-03-08 14:15:42,540 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
821
+ 2024-03-08 14:15:43,163 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
822
+ 2024-03-08 14:15:48,164 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
823
+ 2024-03-08 14:15:52,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
824
+ 2024-03-08 14:15:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
825
+ 2024-03-08 14:15:52,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
826
+ 2024-03-08 14:15:54,033 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
827
+ 2024-03-08 14:15:59,034 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
828
+ 2024-03-08 14:16:04,036 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
829
+ 2024-03-08 14:16:07,213 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
830
+ 2024-03-08 14:16:07,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
831
+ 2024-03-08 14:16:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
832
+ 2024-03-08 14:16:07,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
833
+ 2024-03-08 14:16:09,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.152, "train/grad_norm": 0.6680172085762024, "train/learning_rate": 1.012785947186397e-05, "train/epoch": 12.8, "train/global_step": 160, "_timestamp": 1709907245.7235875, "_runtime": 1504.303290605545, "_step": 15}
 
1
+ {"train/loss": 0.1498, "train/grad_norm": 0.5235738158226013, "train/learning_rate": 5.785225463498828e-06, "train/epoch": 13.6, "train/global_step": 170, "_timestamp": 1709907342.1599762, "_runtime": 1600.7396793365479, "_step": 16}
wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log CHANGED
@@ -782,3 +782,52 @@
782
  2024-03-08 14:14:22,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
783
  2024-03-08 14:14:25,077 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
784
  2024-03-08 14:14:30,078 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
782
  2024-03-08 14:14:22,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
783
  2024-03-08 14:14:25,077 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
784
  2024-03-08 14:14:30,078 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
785
+ 2024-03-08 14:14:35,079 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
786
+ 2024-03-08 14:14:37,211 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
787
+ 2024-03-08 14:14:37,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
788
+ 2024-03-08 14:14:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
789
+ 2024-03-08 14:14:37,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
790
+ 2024-03-08 14:14:40,108 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
791
+ 2024-03-08 14:14:45,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
792
+ 2024-03-08 14:14:50,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
793
+ 2024-03-08 14:14:52,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
794
+ 2024-03-08 14:14:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
795
+ 2024-03-08 14:14:52,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
796
+ 2024-03-08 14:14:56,104 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
797
+ 2024-03-08 14:15:01,105 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
798
+ 2024-03-08 14:15:06,106 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
799
+ 2024-03-08 14:15:07,211 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
800
+ 2024-03-08 14:15:07,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
801
+ 2024-03-08 14:15:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
802
+ 2024-03-08 14:15:07,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
803
+ 2024-03-08 14:15:12,030 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
804
+ 2024-03-08 14:15:17,031 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
805
+ 2024-03-08 14:15:22,032 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
806
+ 2024-03-08 14:15:22,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
807
+ 2024-03-08 14:15:22,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
808
+ 2024-03-08 14:15:22,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
809
+ 2024-03-08 14:15:28,028 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
810
+ 2024-03-08 14:15:33,029 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
811
+ 2024-03-08 14:15:37,212 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
812
+ 2024-03-08 14:15:37,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
813
+ 2024-03-08 14:15:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
814
+ 2024-03-08 14:15:37,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
815
+ 2024-03-08 14:15:38,063 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
816
+ 2024-03-08 14:15:42,160 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
817
+ 2024-03-08 14:15:42,161 DEBUG SenderThread:37167 [sender.py:send():378] send: history
818
+ 2024-03-08 14:15:42,162 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
819
+ 2024-03-08 14:15:42,162 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
820
+ 2024-03-08 14:15:42,540 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
821
+ 2024-03-08 14:15:43,163 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
822
+ 2024-03-08 14:15:48,164 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
823
+ 2024-03-08 14:15:52,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
824
+ 2024-03-08 14:15:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
825
+ 2024-03-08 14:15:52,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
826
+ 2024-03-08 14:15:54,033 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
827
+ 2024-03-08 14:15:59,034 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
828
+ 2024-03-08 14:16:04,036 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
829
+ 2024-03-08 14:16:07,213 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
830
+ 2024-03-08 14:16:07,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
831
+ 2024-03-08 14:16:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
832
+ 2024-03-08 14:16:07,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
833
+ 2024-03-08 14:16:09,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb CHANGED
Binary files a/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb and b/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb differ