| 2024-03-08 13:49:01,420 INFO StreamThr :37167 [internal.py:wandb_internal():86] W&B internal server running at pid: 37167, started at: 2024-03-08 13:49:01.420105 | |
| 2024-03-08 13:49:01,422 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status | |
| 2024-03-08 13:49:06,425 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:06,425 INFO WriterThread:37167 [datastore.py:open_for_write():87] open: /content/wandb/run-20240308_134901-hlg2f18u/run-hlg2f18u.wandb | |
| 2024-03-08 13:49:06,451 DEBUG SenderThread:37167 [sender.py:send():378] send: header | |
| 2024-03-08 13:49:06,454 DEBUG SenderThread:37167 [sender.py:send():378] send: run | |
| 2024-03-08 13:49:06,939 INFO SenderThread:37167 [dir_watcher.py:__init__():211] watching files in: /content/wandb/run-20240308_134901-hlg2f18u/files | |
| 2024-03-08 13:49:06,939 INFO SenderThread:37167 [sender.py:_start_run_threads():1099] run started: hlg2f18u with start time 1709905741.420297 | |
| 2024-03-08 13:49:06,942 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: check_version | |
| 2024-03-08 13:49:06,942 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: check_version | |
| 2024-03-08 13:49:07,153 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: run_start | |
| 2024-03-08 13:49:07,163 DEBUG HandlerThread:37167 [system_info.py:__init__():26] System info init | |
| 2024-03-08 13:49:07,163 DEBUG HandlerThread:37167 [system_info.py:__init__():41] System info init done | |
| 2024-03-08 13:49:07,163 INFO HandlerThread:37167 [system_monitor.py:start():194] Starting system monitor | |
| 2024-03-08 13:49:07,164 INFO SystemMonitor:37167 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-03-08 13:49:07,164 INFO HandlerThread:37167 [system_monitor.py:probe():214] Collecting system info | |
| 2024-03-08 13:49:07,164 INFO SystemMonitor:37167 [interfaces.py:start():190] Started cpu monitoring | |
| 2024-03-08 13:49:07,165 INFO SystemMonitor:37167 [interfaces.py:start():190] Started disk monitoring | |
| 2024-03-08 13:49:07,166 INFO SystemMonitor:37167 [interfaces.py:start():190] Started gpu monitoring | |
| 2024-03-08 13:49:07,167 INFO SystemMonitor:37167 [interfaces.py:start():190] Started memory monitoring | |
| 2024-03-08 13:49:07,168 INFO SystemMonitor:37167 [interfaces.py:start():190] Started network monitoring | |
| 2024-03-08 13:49:07,172 DEBUG HandlerThread:37167 [system_info.py:probe():150] Probing system | |
| 2024-03-08 13:49:07,174 DEBUG HandlerThread:37167 [gitlib.py:_init_repo():56] git repository is invalid | |
| 2024-03-08 13:49:07,174 DEBUG HandlerThread:37167 [system_info.py:probe():198] Probing system done | |
| 2024-03-08 13:49:07,174 DEBUG HandlerThread:37167 [system_monitor.py:probe():223] {'os': 'Linux-6.1.58+-x86_64-with-glibc2.35', 'python': '3.10.12', 'heartbeatAt': '2024-03-08T13:49:07.172649', 'startedAt': '2024-03-08T13:49:01.413484', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'Smart_Agriculture_Falcon.ipynb', 'codePathLocal': None, 'colab': 'https://colab.research.google.com/notebook#fileId=1kv2VO7q0c8xX_DQt5NERLeJJZtHW6zHO', 'host': '4997a2709b0f', 'username': 'root', 'executable': '/usr/bin/python3', 'cpu_count': 4, 'cpu_count_logical': 8, 'cpu_freq': {'current': 2199.998, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 201.22513961791992, 'used': 58.57290267944336}}, 'gpu': 'Tesla T4', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla T4', 'memory_total': 16106127360}], 'memory': {'total': 50.993690490722656}} | |
| 2024-03-08 13:49:07,174 INFO HandlerThread:37167 [system_monitor.py:probe():224] Finished collecting system info | |
| 2024-03-08 13:49:07,174 INFO HandlerThread:37167 [system_monitor.py:probe():227] Publishing system info | |
| 2024-03-08 13:49:07,174 INFO HandlerThread:37167 [system_monitor.py:probe():229] Finished publishing system info | |
| 2024-03-08 13:49:07,186 DEBUG SenderThread:37167 [sender.py:send():378] send: files | |
| 2024-03-08 13:49:07,186 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-metadata.json with policy now | |
| 2024-03-08 13:49:07,646 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: python_packages | |
| 2024-03-08 13:49:07,647 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: python_packages | |
| 2024-03-08 13:49:07,686 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:49:07,687 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:49:07,688 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:49:07,940 INFO Thread-12 :37167 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-metadata.json | |
| 2024-03-08 13:49:07,941 INFO Thread-12 :37167 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_134901-hlg2f18u/files/requirements.txt | |
| 2024-03-08 13:49:08,065 INFO wandb-upload_0:37167 [upload_job.py:push():131] Uploaded file /tmp/tmpgtstjuiqwandb/o7wr7mlg-wandb-metadata.json | |
| 2024-03-08 13:49:08,292 DEBUG SenderThread:37167 [sender.py:send():378] send: telemetry | |
| 2024-03-08 13:49:08,292 DEBUG SenderThread:37167 [sender.py:send():378] send: config | |
| 2024-03-08 13:49:08,293 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 13:49:08,293 DEBUG SenderThread:37167 [sender.py:send():378] send: telemetry | |
| 2024-03-08 13:49:08,293 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 13:49:08,293 WARNING SenderThread:37167 [sender.py:send_metric():1316] Seen metric with glob (shouldn't happen) | |
| 2024-03-08 13:49:08,293 DEBUG SenderThread:37167 [sender.py:send():378] send: telemetry | |
| 2024-03-08 13:49:12,294 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:17,295 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:22,296 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:22,647 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:49:22,647 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:49:22,688 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:49:27,889 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:32,894 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:33,949 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/config.yaml | |
| 2024-03-08 13:49:37,647 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:49:37,648 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:49:37,688 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:49:38,897 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:43,898 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:48,899 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:52,647 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:49:52,648 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:49:52,688 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:49:54,851 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:49:59,852 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:04,853 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:07,168 DEBUG SystemMonitor:37167 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-03-08 13:50:07,169 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:50:07,647 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:50:07,648 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:50:07,688 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:50:09,898 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:14,899 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:19,900 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:22,648 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:50:22,648 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:50:22,688 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:50:25,835 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:30,836 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:30,851 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 13:50:30,853 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 13:50:30,854 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 13:50:30,854 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 13:50:30,854 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 13:50:30,854 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 13:50:30,854 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 13:50:30,856 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 13:50:30,969 INFO Thread-12 :37167 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_134901-hlg2f18u/files/output.log | |
| 2024-03-08 13:50:30,970 INFO Thread-12 :37167 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 13:50:32,971 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/output.log | |
| 2024-03-08 13:50:35,899 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:36,972 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/config.yaml | |
| 2024-03-08 13:50:37,170 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:50:37,648 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:50:37,648 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:50:37,649 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:50:41,848 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:46,849 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:51,850 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:50:52,648 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:50:52,648 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:50:52,689 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:50:56,936 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:01,937 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:06,939 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:07,171 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:51:07,648 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:51:07,648 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:51:07,689 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:51:11,951 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:16,952 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:21,953 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:22,648 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:51:22,649 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:51:22,689 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:51:27,772 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:32,773 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:37,172 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:51:37,650 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:51:37,650 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:51:37,651 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:51:37,939 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:42,940 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:47,942 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:52,649 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:51:52,649 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:51:52,689 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:51:54,693 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:51:59,617 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 13:51:59,619 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 13:51:59,619 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 13:51:59,621 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 13:52:00,002 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 13:52:00,659 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:01,002 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/output.log | |
| 2024-03-08 13:52:05,660 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:07,173 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:52:07,649 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:52:07,650 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:52:07,651 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:52:10,920 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:15,921 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:20,922 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:22,649 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:52:22,650 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:52:22,690 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:52:26,913 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:31,914 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:36,915 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:37,174 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:52:37,649 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:52:37,650 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:52:37,690 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:52:42,883 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:47,884 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:52,649 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:52:52,650 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:52:52,690 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:52:52,936 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:52:57,937 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:02,938 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:07,174 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:53:07,650 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:53:07,650 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:53:07,690 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:53:07,941 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:12,942 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:17,943 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:22,650 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:53:22,650 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:53:22,690 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:53:24,209 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:29,210 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:32,742 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 13:53:32,744 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 13:53:32,744 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 13:53:32,746 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 13:53:33,038 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 13:53:34,785 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:36,039 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/output.log | |
| 2024-03-08 13:53:37,175 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:53:37,650 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:53:37,651 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:53:37,651 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:53:39,861 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:44,862 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:49,863 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:53:52,650 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:53:52,651 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:53:52,691 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:53:55,843 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:00,844 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:05,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:07,176 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:54:07,650 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:54:07,651 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:54:07,691 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:54:10,892 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:15,893 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:20,894 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:22,650 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:54:22,651 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:54:22,691 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:54:26,137 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:31,138 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:36,139 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:37,177 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:54:37,651 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:54:37,651 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:54:37,691 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:54:41,932 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:46,933 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:51,934 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:54:52,651 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:54:52,651 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:54:52,691 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:54:57,199 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:02,200 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:04,360 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 13:55:04,362 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 13:55:04,362 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 13:55:04,363 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 13:55:05,072 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 13:55:06,073 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/output.log | |
| 2024-03-08 13:55:07,177 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:55:07,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:55:07,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:55:07,653 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:55:07,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:12,846 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:17,847 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:22,651 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:55:22,652 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:55:22,692 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:55:22,923 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:27,924 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:32,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:37,178 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:55:37,651 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:55:37,652 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:55:37,692 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:55:38,904 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:43,905 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:48,906 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:52,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:55:52,652 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:55:52,692 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:55:54,850 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:55:59,850 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:04,851 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:07,179 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:56:07,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:56:07,652 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:56:07,692 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:56:09,877 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:14,878 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:19,880 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:22,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:56:22,652 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:56:22,692 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:56:24,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:29,928 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:34,929 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:37,180 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:56:37,387 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 13:56:37,389 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 13:56:37,389 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 13:56:37,390 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 13:56:37,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:56:37,653 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:56:37,653 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:56:38,107 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 13:56:39,940 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:40,108 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/output.log | |
| 2024-03-08 13:56:44,942 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:49,943 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:56:52,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:56:52,653 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:56:52,693 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:56:55,868 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:00,869 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:05,870 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:07,180 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:57:07,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:57:07,653 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:57:07,694 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:57:10,899 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:15,901 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:20,902 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:22,652 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:57:22,653 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:57:22,693 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:57:26,888 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:31,888 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:36,890 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:37,181 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:57:37,653 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:57:37,653 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:57:37,693 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:57:42,876 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:47,877 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:52,653 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:57:52,653 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:57:52,693 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:57:53,876 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:57:58,877 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:03,879 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:07,182 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:58:07,653 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:58:07,654 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:58:07,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:58:09,855 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:13,676 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 13:58:13,678 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 13:58:13,678 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 13:58:13,679 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 13:58:14,144 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 13:58:15,718 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:16,144 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/output.log | |
| 2024-03-08 13:58:20,719 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:22,653 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:58:22,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:58:22,654 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:58:26,249 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:31,251 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:36,252 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:37,183 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:58:37,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:58:37,654 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:58:37,694 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:58:41,860 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:46,862 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:51,863 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:58:52,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:58:52,654 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:58:52,694 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:58:56,890 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:01,891 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:06,892 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:07,184 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:59:07,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:59:07,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:59:07,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:59:11,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:16,929 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:21,930 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:22,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:59:22,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:59:22,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:59:27,345 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:32,346 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:37,184 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 13:59:37,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:59:37,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:59:37,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:59:37,941 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:42,942 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:45,430 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 13:59:45,431 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 13:59:45,432 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 13:59:45,432 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 13:59:46,179 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 13:59:48,180 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/output.log | |
| 2024-03-08 13:59:48,472 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:52,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 13:59:52,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 13:59:52,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 13:59:53,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 13:59:58,926 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:03,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:07,186 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:00:07,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:00:07,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:00:07,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:00:09,863 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:14,864 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:19,865 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:22,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:00:22,655 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:00:22,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:00:24,932 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:29,933 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:34,934 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:37,187 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:00:37,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:00:37,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:00:37,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:00:40,925 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:45,926 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:50,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:00:52,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:00:52,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:00:52,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:00:56,927 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:01,928 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:06,929 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:07,187 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:01:07,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:01:07,656 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:01:07,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:01:12,835 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:17,836 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:21,426 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:01:21,428 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:01:21,428 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:01:21,429 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:01:22,216 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:01:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:01:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:01:22,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:01:23,007 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:28,008 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:33,010 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:37,188 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:01:37,803 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:01:37,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:01:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:01:38,021 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:43,022 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:48,023 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:52,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:01:52,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:01:52,844 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:01:54,321 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:01:59,322 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:04,323 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:07,189 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:02:07,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:02:07,804 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:02:07,844 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:02:10,091 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:15,092 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:20,093 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:22,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:02:22,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:02:22,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:02:25,388 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:30,390 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:35,391 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:37,190 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:02:37,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:02:37,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:02:37,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:02:41,023 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:46,024 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:51,025 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:52,804 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:02:52,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:02:52,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:02:56,052 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:02:57,087 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:02:57,088 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:02:57,088 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:02:57,089 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:02:57,252 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:03:01,090 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:06,091 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:07,191 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:03:07,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:03:07,806 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:03:12,003 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:17,004 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:22,005 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:22,805 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:03:22,805 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:03:22,845 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:03:27,229 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:32,230 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:37,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:03:37,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:03:37,812 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:03:37,852 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:03:38,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:43,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:48,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:03:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:03:52,811 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:03:53,098 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:03:58,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:03,100 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:07,192 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:04:07,810 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:04:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:04:07,812 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:04:09,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:14,100 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:19,101 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:22,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:04:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:04:22,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:04:25,051 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:30,052 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:30,686 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:04:30,688 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:04:30,688 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:04:30,690 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:04:31,288 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:04:35,691 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:37,193 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:04:37,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:04:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:04:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:04:41,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:46,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:51,111 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:04:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:04:52,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:04:52,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:04:57,104 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:02,105 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:07,106 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:07,195 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:05:07,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:05:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:05:07,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:05:13,031 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:18,032 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:22,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:05:22,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:05:22,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:05:23,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:28,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:33,063 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:37,195 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:05:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:05:37,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:05:37,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:05:38,324 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:43,325 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:48,326 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:52,811 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:05:52,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:05:52,813 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:05:53,998 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:05:58,999 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:04,000 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:07,196 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:06:07,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:06:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:06:07,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:06:08,229 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:06:08,230 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:06:08,231 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:06:08,231 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:06:08,326 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:06:09,232 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:14,233 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:19,234 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:06:22,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:06:22,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:06:24,469 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:29,470 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:34,471 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:37,197 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:06:37,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:06:37,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:06:37,814 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:06:40,085 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:45,086 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:50,087 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:06:52,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:06:52,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:06:52,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:06:55,974 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:00,976 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:05,976 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:07,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:07:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:07:07,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:07:07,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:07:11,047 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:16,048 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:21,049 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:22,812 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:07:22,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:07:22,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:07:27,035 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:32,036 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:37,037 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:37,198 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:07:37,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:07:37,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:07:37,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:07:43,025 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:43,356 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:07:43,358 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:07:43,358 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:07:43,359 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:07:43,363 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:07:48,360 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:52,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:07:52,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:07:52,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:07:54,095 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:07:59,096 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:04,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:07,199 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:08:07,813 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:08:07,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:08:07,815 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:08:10,020 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:15,022 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:20,023 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:22,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:08:22,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:08:22,816 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:08:25,096 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:30,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:35,098 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:37,200 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:08:37,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:08:37,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:08:37,816 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:08:41,082 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:46,083 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:51,085 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:08:52,814 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:08:52,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:08:52,816 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:08:56,138 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:01,140 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:06,141 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:07,201 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:09:07,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:09:07,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:09:07,816 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:09:12,071 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:17,072 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:17,542 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:09:17,544 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:09:17,544 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:09:17,545 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:09:18,398 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:09:22,546 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:22,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:09:22,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:09:22,816 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:09:28,032 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:33,033 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:37,202 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:09:37,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:09:37,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:09:37,816 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:09:39,027 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:44,028 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:49,030 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:09:52,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:09:52,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:09:52,817 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:09:55,010 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:00,011 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:05,013 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:07,202 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:10:07,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:10:07,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:10:07,816 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:10:10,046 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:15,047 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:20,049 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:22,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:10:22,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:10:22,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:10:26,013 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:31,014 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:36,015 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:37,203 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:10:37,815 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:10:37,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:10:37,817 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:10:41,089 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:46,090 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:51,092 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:10:52,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:10:52,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:10:52,817 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:10:54,692 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:10:54,693 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:10:54,693 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:10:54,694 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:10:55,434 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:10:56,695 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:01,696 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:06,697 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:07,204 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:11:07,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:11:07,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:11:07,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:11:12,103 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:17,104 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:22,105 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:22,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:11:22,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:11:22,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:11:28,002 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:33,003 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:37,205 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:11:37,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:11:37,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:11:37,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:11:38,046 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:43,047 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:48,048 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:52,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:11:52,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:11:52,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:11:54,025 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:11:59,026 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:04,027 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:07,206 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:12:07,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:12:07,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:12:07,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:12:09,034 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:14,035 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:19,036 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:22,816 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:12:22,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:12:22,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:12:25,007 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:28,352 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:12:28,353 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:12:28,353 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:12:28,354 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:12:28,468 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:12:30,354 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:35,355 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:37,207 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:12:37,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:12:37,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:12:37,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:12:41,055 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:46,056 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:51,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:12:52,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:12:52,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:12:52,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:12:56,076 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:01,077 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:06,078 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:07,208 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:13:07,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:13:07,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:13:07,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:13:12,009 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:17,011 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:22,012 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:22,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:13:22,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:13:22,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:13:27,354 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:32,355 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:37,209 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:13:37,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:37,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:13:37,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:13:37,818 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:13:43,106 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:48,107 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:52,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:13:52,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:13:52,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:13:54,037 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:13:59,037 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:04,039 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:05,724 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:14:05,725 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:14:05,725 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:14:05,726 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:14:06,505 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:14:07,210 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:14:07,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:14:07,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:14:07,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:14:09,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:14,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:19,111 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:22,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:14:22,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:14:22,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:14:25,077 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:30,078 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:35,079 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:37,211 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:14:37,817 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:14:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:14:37,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:14:40,108 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:45,109 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:50,110 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:14:52,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:14:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:14:52,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:14:56,104 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:01,105 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:06,106 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:07,211 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:15:07,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:15:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:15:07,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:15:12,030 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:17,031 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:22,032 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:22,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:15:22,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:15:22,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:15:28,028 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:33,029 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:37,212 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:15:37,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:15:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:15:37,819 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:15:38,063 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:42,160 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:15:42,161 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:15:42,162 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:15:42,162 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:15:42,540 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:15:43,163 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:48,164 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:52,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:15:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:15:52,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:15:54,033 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:15:59,034 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:04,036 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:07,213 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:16:07,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:16:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:16:07,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:16:09,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:14,059 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:19,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:22,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:16:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:16:22,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:16:24,145 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:29,146 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:34,147 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:37,213 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:16:37,818 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:16:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:16:37,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:16:40,079 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:45,080 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:50,081 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:16:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:16:52,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:16:52,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:16:55,084 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:00,085 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:05,086 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:07,214 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:17:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:17:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:17:07,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:17:11,034 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:16,035 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:17,570 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:17:17,571 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:17:17,571 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:17:17,572 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:17:17,577 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:17:21,573 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:22,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:17:22,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:17:22,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:17:27,473 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:32,474 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:37,215 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:17:37,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:17:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:17:37,820 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:17:43,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:48,100 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:17:52,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:17:52,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:17:52,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:17:55,450 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:00,451 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:05,452 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:07,216 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:18:07,819 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:18:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:18:07,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:18:11,096 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:16,098 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:21,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:18:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:18:22,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:18:27,066 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:32,067 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:37,068 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:37,217 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:18:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:18:37,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:18:37,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:18:42,093 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:47,094 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:50,476 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:18:50,477 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:18:50,478 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:18:50,478 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:18:50,612 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:18:52,479 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:18:52,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:18:52,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:18:52,821 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:18:57,526 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:02,527 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:07,217 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:19:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:19:07,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:19:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:19:13,138 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:18,139 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:19:22,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:19:22,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:19:24,653 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:29,654 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:34,655 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:37,218 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:19:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:19:37,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:19:37,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:19:40,094 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:45,096 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:50,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:19:52,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:19:52,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:19:52,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:19:56,097 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:01,098 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:06,099 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:07,219 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:20:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:20:07,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:20:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:20:12,060 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:17,061 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:22,062 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:22,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:20:22,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:20:22,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:20:25,585 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:20:25,586 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:20:25,587 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:20:25,587 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:20:25,647 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:20:27,588 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:30,465 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: metric | |
| 2024-03-08 14:20:30,468 DEBUG SenderThread:37167 [sender.py:send():378] send: history | |
| 2024-03-08 14:20:30,469 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 14:20:30,469 INFO SenderThread:37167 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 14:20:30,650 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/wandb-summary.json | |
| 2024-03-08 14:20:33,470 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:37,220 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:20:37,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:20:37,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:20:37,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:20:39,055 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:44,056 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:49,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:52,821 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:20:52,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:20:52,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:20:55,058 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:20:55,658 INFO Thread-12 :37167 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_134901-hlg2f18u/files/config.yaml | |
| 2024-03-08 14:21:00,397 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:21:05,398 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 14:21:07,220 DEBUG SenderThread:37167 [sender.py:send():378] send: stats | |
| 2024-03-08 14:21:07,820 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 14:21:07,822 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 14:21:07,822 DEBUG SenderThread:37167 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 14:21:11,068 DEBUG HandlerThread:37167 [handler.py:handle_request():146] handle_request: status_report | |