Hugging Face's logo

kertob
/
content

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
kertob commited on
Commit
06f1b59
•
1 Parent(s): d6a458f

Training in progress, step 200

Browse files
Files changed (7) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 +2 -2
  3. wandb/debug-internal.log +65 -0
  4. wandb/run-20240308_134901-hlg2f18u/files/config.yaml +20 -0
  5. wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json +1 -1
  6. wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log +65 -0
  7. wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb +0 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a5f27c3f1728826e5350b88b701dbaa95988bb2c2eb31b96d3ff4adf826b689
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a3446833c0cbdb1438a2e28a2a8b891075d5f28f4d0ec593874c46daee2ebc0
3
  size 261131840
runs/Mar08_13-48-53_4997a2709b0f/events.out.tfevents.1709905734.4997a2709b0f.35964.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:161deb8582296e0a898831e8e25742babba4c9eb989b99c479251d1b1ac3b303
3
- size 9693
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9096300814f6f73f947cecb00b2ee95d4fe13c4df96262c071bc235018b66f64
3
+ size 10258
wandb/debug-internal.log CHANGED
@@ -919,3 +919,68 @@
919
  2024-03-08 14:19:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
920
  2024-03-08 14:19:13,138 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
921
  2024-03-08 14:19:18,139 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
919
  2024-03-08 14:19:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
920
  2024-03-08 14:19:13,138 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
921
  2024-03-08 14:19:18,139 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
922
+ 2024-03-08 14:19:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
923
+ 2024-03-08 14:19:22,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
924
+ 2024-03-08 14:19:22,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
925
+ 2024-03-08 14:19:24,653 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
926
+ 2024-03-08 14:19:29,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
927
+ 2024-03-08 14:19:34,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
928
+ 2024-03-08 14:19:37,218 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
929
+ 2024-03-08 14:19:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
930
+ 2024-03-08 14:19:37,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
931
+ 2024-03-08 14:19:37,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
932
+ 2024-03-08 14:19:40,094 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
933
+ 2024-03-08 14:19:45,096 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
934
+ 2024-03-08 14:19:50,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
935
+ 2024-03-08 14:19:52,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
936
+ 2024-03-08 14:19:52,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
937
+ 2024-03-08 14:19:52,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
938
+ 2024-03-08 14:19:56,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
939
+ 2024-03-08 14:20:01,098 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
940
+ 2024-03-08 14:20:06,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
941
+ 2024-03-08 14:20:07,219 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
942
+ 2024-03-08 14:20:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
943
+ 2024-03-08 14:20:07,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
944
+ 2024-03-08 14:20:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
945
+ 2024-03-08 14:20:12,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
946
+ 2024-03-08 14:20:17,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
947
+ 2024-03-08 14:20:22,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
948
+ 2024-03-08 14:20:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
949
+ 2024-03-08 14:20:22,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
950
+ 2024-03-08 14:20:22,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
951
+ 2024-03-08 14:20:25,585 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
952
+ 2024-03-08 14:20:25,586 DEBUG SenderThread:37167 [sender.py:send():378] send: history
953
+ 2024-03-08 14:20:25,587 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
954
+ 2024-03-08 14:20:25,587 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
955
+ 2024-03-08 14:20:25,647 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
956
+ 2024-03-08 14:20:27,588 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
957
+ 2024-03-08 14:20:30,465 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
958
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
959
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
960
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
961
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
962
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
963
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: history
964
+ 2024-03-08 14:20:30,469 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
965
+ 2024-03-08 14:20:30,469 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
966
+ 2024-03-08 14:20:30,650 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
967
+ 2024-03-08 14:20:33,470 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
968
+ 2024-03-08 14:20:37,220 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
969
+ 2024-03-08 14:20:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
970
+ 2024-03-08 14:20:37,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
971
+ 2024-03-08 14:20:37,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
972
+ 2024-03-08 14:20:39,055 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
973
+ 2024-03-08 14:20:44,056 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
974
+ 2024-03-08 14:20:49,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
975
+ 2024-03-08 14:20:52,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
976
+ 2024-03-08 14:20:52,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
977
+ 2024-03-08 14:20:52,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
978
+ 2024-03-08 14:20:55,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
979
+ 2024-03-08 14:20:55,658 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/config.yaml
980
+ 2024-03-08 14:21:00,397 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
981
+ 2024-03-08 14:21:05,398 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
982
+ 2024-03-08 14:21:07,220 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
983
+ 2024-03-08 14:21:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
984
+ 2024-03-08 14:21:07,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
985
+ 2024-03-08 14:21:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
986
+ 2024-03-08 14:21:11,068 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/files/config.yaml CHANGED
@@ -72,6 +72,26 @@ _wandb:
72
  5: 1
73
  6:
74
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
  vocab_size:
76
  desc: null
77
  value: 65024
 
72
  5: 1
73
  6:
74
  - 1
75
+ - 1: train/train_runtime
76
+ 5: 1
77
+ 6:
78
+ - 1
79
+ - 1: train/train_samples_per_second
80
+ 5: 1
81
+ 6:
82
+ - 1
83
+ - 1: train/train_steps_per_second
84
+ 5: 1
85
+ 6:
86
+ - 1
87
+ - 1: train/total_flos
88
+ 5: 1
89
+ 6:
90
+ - 1
91
+ - 1: train/train_loss
92
+ 5: 1
93
+ 6:
94
+ - 1
95
  vocab_size:
96
  desc: null
97
  value: 65024
wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.1169, "train/grad_norm": 0.517312228679657, "train/learning_rate": 6.54164563305465e-07, "train/epoch": 15.2, "train/global_step": 190, "_timestamp": 1709907530.4761915, "_runtime": 1789.055894613266, "_step": 18}
 
1
+ {"train/loss": 0.145, "train/grad_norm": 0.5381152033805847, "train/learning_rate": 0.0, "train/epoch": 16.0, "train/global_step": 200, "_timestamp": 1709907630.4651942, "_runtime": 1889.0448973178864, "_step": 20, "train/train_runtime": 1896.1646, "train/train_samples_per_second": 1.688, "train/train_steps_per_second": 0.105, "train/total_flos": 1.0545415936671744e+16, "train/train_loss": 0.4396096807718277}
wandb/run-20240308_134901-hlg2f18u/logs/debug-internal.log CHANGED
@@ -919,3 +919,68 @@
919
  2024-03-08 14:19:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
920
  2024-03-08 14:19:13,138 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
921
  2024-03-08 14:19:18,139 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
919
  2024-03-08 14:19:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
920
  2024-03-08 14:19:13,138 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
921
  2024-03-08 14:19:18,139 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
922
+ 2024-03-08 14:19:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
923
+ 2024-03-08 14:19:22,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
924
+ 2024-03-08 14:19:22,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
925
+ 2024-03-08 14:19:24,653 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
926
+ 2024-03-08 14:19:29,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
927
+ 2024-03-08 14:19:34,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
928
+ 2024-03-08 14:19:37,218 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
929
+ 2024-03-08 14:19:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
930
+ 2024-03-08 14:19:37,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
931
+ 2024-03-08 14:19:37,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
932
+ 2024-03-08 14:19:40,094 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
933
+ 2024-03-08 14:19:45,096 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
934
+ 2024-03-08 14:19:50,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
935
+ 2024-03-08 14:19:52,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
936
+ 2024-03-08 14:19:52,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
937
+ 2024-03-08 14:19:52,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
938
+ 2024-03-08 14:19:56,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
939
+ 2024-03-08 14:20:01,098 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
940
+ 2024-03-08 14:20:06,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
941
+ 2024-03-08 14:20:07,219 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
942
+ 2024-03-08 14:20:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
943
+ 2024-03-08 14:20:07,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
944
+ 2024-03-08 14:20:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
945
+ 2024-03-08 14:20:12,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
946
+ 2024-03-08 14:20:17,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
947
+ 2024-03-08 14:20:22,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
948
+ 2024-03-08 14:20:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
949
+ 2024-03-08 14:20:22,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
950
+ 2024-03-08 14:20:22,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
951
+ 2024-03-08 14:20:25,585 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
952
+ 2024-03-08 14:20:25,586 DEBUG SenderThread:37167 [sender.py:send():378] send: history
953
+ 2024-03-08 14:20:25,587 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
954
+ 2024-03-08 14:20:25,587 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
955
+ 2024-03-08 14:20:25,647 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
956
+ 2024-03-08 14:20:27,588 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
957
+ 2024-03-08 14:20:30,465 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history
958
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
959
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
960
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
961
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
962
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric
963
+ 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: history
964
+ 2024-03-08 14:20:30,469 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record
965
+ 2024-03-08 14:20:30,469 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
966
+ 2024-03-08 14:20:30,650 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json
967
+ 2024-03-08 14:20:33,470 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
968
+ 2024-03-08 14:20:37,220 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
969
+ 2024-03-08 14:20:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
970
+ 2024-03-08 14:20:37,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
971
+ 2024-03-08 14:20:37,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
972
+ 2024-03-08 14:20:39,055 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
973
+ 2024-03-08 14:20:44,056 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
974
+ 2024-03-08 14:20:49,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
975
+ 2024-03-08 14:20:52,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
976
+ 2024-03-08 14:20:52,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
977
+ 2024-03-08 14:20:52,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
978
+ 2024-03-08 14:20:55,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
979
+ 2024-03-08 14:20:55,658 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/config.yaml
980
+ 2024-03-08 14:21:00,397 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
981
+ 2024-03-08 14:21:05,398 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
982
+ 2024-03-08 14:21:07,220 DEBUG SenderThread:37167 [sender.py:send():378] send: stats
983
+ 2024-03-08 14:21:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages
984
+ 2024-03-08 14:21:07,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status
985
+ 2024-03-08 14:21:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status
986
+ 2024-03-08 14:21:11,068 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb CHANGED
Binary files a/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb and b/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb differ