| 2024-03-08 12:11:34,060 INFO StreamThr :10843 [internal.py:wandb_internal():86] W&B internal server running at pid: 10843, started at: 2024-03-08 12:11:34.060152 | |
| 2024-03-08 12:11:34,062 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status | |
| 2024-03-08 12:11:39,065 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:11:39,065 INFO WriterThread:10843 [datastore.py:open_for_write():87] open: /content/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb | |
| 2024-03-08 12:11:39,097 DEBUG SenderThread:10843 [sender.py:send():378] send: header | |
| 2024-03-08 12:11:39,101 DEBUG SenderThread:10843 [sender.py:send():378] send: run | |
| 2024-03-08 12:11:39,602 INFO SenderThread:10843 [dir_watcher.py:__init__():211] watching files in: /content/wandb/run-20240308_121134-5y42ufcl/files | |
| 2024-03-08 12:11:39,603 INFO SenderThread:10843 [sender.py:_start_run_threads():1099] run started: 5y42ufcl with start time 1709899894.060627 | |
| 2024-03-08 12:11:39,606 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: check_version | |
| 2024-03-08 12:11:39,606 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: check_version | |
| 2024-03-08 12:11:39,749 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: run_start | |
| 2024-03-08 12:11:39,759 DEBUG HandlerThread:10843 [system_info.py:__init__():26] System info init | |
| 2024-03-08 12:11:39,759 DEBUG HandlerThread:10843 [system_info.py:__init__():41] System info init done | |
| 2024-03-08 12:11:39,759 INFO HandlerThread:10843 [system_monitor.py:start():194] Starting system monitor | |
| 2024-03-08 12:11:39,759 INFO SystemMonitor:10843 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2024-03-08 12:11:39,760 INFO HandlerThread:10843 [system_monitor.py:probe():214] Collecting system info | |
| 2024-03-08 12:11:39,760 INFO SystemMonitor:10843 [interfaces.py:start():190] Started cpu monitoring | |
| 2024-03-08 12:11:39,761 INFO SystemMonitor:10843 [interfaces.py:start():190] Started disk monitoring | |
| 2024-03-08 12:11:39,762 INFO SystemMonitor:10843 [interfaces.py:start():190] Started gpu monitoring | |
| 2024-03-08 12:11:39,762 INFO SystemMonitor:10843 [interfaces.py:start():190] Started memory monitoring | |
| 2024-03-08 12:11:39,763 INFO SystemMonitor:10843 [interfaces.py:start():190] Started network monitoring | |
| 2024-03-08 12:11:39,772 DEBUG HandlerThread:10843 [system_info.py:probe():150] Probing system | |
| 2024-03-08 12:11:39,773 DEBUG HandlerThread:10843 [gitlib.py:_init_repo():56] git repository is invalid | |
| 2024-03-08 12:11:39,773 DEBUG HandlerThread:10843 [system_info.py:probe():198] Probing system done | |
| 2024-03-08 12:11:39,773 DEBUG HandlerThread:10843 [system_monitor.py:probe():223] {'os': 'Linux-6.1.58+-x86_64-with-glibc2.35', 'python': '3.10.12', 'heartbeatAt': '2024-03-08T12:11:39.772379', 'startedAt': '2024-03-08T12:11:34.054080', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'Smart_Agriculture_Falcon.ipynb', 'codePathLocal': None, 'colab': 'https://colab.research.google.com/notebook#fileId=1kv2VO7q0c8xX_DQt5NERLeJJZtHW6zHO', 'host': '4997a2709b0f', 'username': 'root', 'executable': '/usr/bin/python3', 'cpu_count': 4, 'cpu_count_logical': 8, 'cpu_freq': {'current': 2199.998, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 201.22513961791992, 'used': 52.550201416015625}}, 'gpu': 'Tesla T4', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla T4', 'memory_total': 16106127360}], 'memory': {'total': 50.993690490722656}} | |
| 2024-03-08 12:11:39,774 INFO HandlerThread:10843 [system_monitor.py:probe():224] Finished collecting system info | |
| 2024-03-08 12:11:39,774 INFO HandlerThread:10843 [system_monitor.py:probe():227] Publishing system info | |
| 2024-03-08 12:11:39,774 INFO HandlerThread:10843 [system_monitor.py:probe():229] Finished publishing system info | |
| 2024-03-08 12:11:39,779 DEBUG SenderThread:10843 [sender.py:send():378] send: files | |
| 2024-03-08 12:11:39,780 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-metadata.json with policy now | |
| 2024-03-08 12:11:40,192 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: python_packages | |
| 2024-03-08 12:11:40,193 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: python_packages | |
| 2024-03-08 12:11:40,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:11:40,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:11:40,235 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:11:40,523 INFO wandb-upload_0:10843 [upload_job.py:push():131] Uploaded file /tmp/tmprc6z1h8jwandb/bimoql9w-wandb-metadata.json | |
| 2024-03-08 12:11:40,532 DEBUG SenderThread:10843 [sender.py:send():378] send: telemetry | |
| 2024-03-08 12:11:40,532 DEBUG SenderThread:10843 [sender.py:send():378] send: config | |
| 2024-03-08 12:11:40,533 DEBUG SenderThread:10843 [sender.py:send():378] send: metric | |
| 2024-03-08 12:11:40,533 DEBUG SenderThread:10843 [sender.py:send():378] send: telemetry | |
| 2024-03-08 12:11:40,533 DEBUG SenderThread:10843 [sender.py:send():378] send: metric | |
| 2024-03-08 12:11:40,533 WARNING SenderThread:10843 [sender.py:send_metric():1316] Seen metric with glob (shouldn't happen) | |
| 2024-03-08 12:11:40,533 DEBUG SenderThread:10843 [sender.py:send():378] send: telemetry | |
| 2024-03-08 12:11:40,604 INFO Thread-12 :10843 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_121134-5y42ufcl/files/requirements.txt | |
| 2024-03-08 12:11:40,604 INFO Thread-12 :10843 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-metadata.json | |
| 2024-03-08 12:11:44,534 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:11:49,535 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:11:54,536 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:11:55,193 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:11:55,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:11:55,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:12:00,453 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:05,458 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:06,612 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/config.yaml | |
| 2024-03-08 12:12:10,193 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:12:10,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:12:10,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:12:11,477 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:16,478 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:21,479 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:25,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:12:25,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:12:25,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:12:27,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:32,401 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:37,402 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:39,764 DEBUG SystemMonitor:10843 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2024-03-08 12:12:39,765 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:12:40,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:12:40,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:12:40,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:12:42,416 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:47,417 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:52,417 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:12:55,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:12:55,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:12:55,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:12:57,445 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:02,446 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:07,447 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:09,766 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:13:10,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:13:10,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:13:10,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:13:13,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:18,392 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:20,889 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: metric | |
| 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: metric | |
| 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: metric | |
| 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: metric | |
| 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: history | |
| 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 12:13:20,894 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 12:13:21,638 INFO Thread-12 :10843 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json | |
| 2024-03-08 12:13:23,895 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:25,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:13:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:13:25,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:13:29,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:34,484 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:39,490 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:39,798 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:13:40,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:13:40,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:13:40,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:13:40,645 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/config.yaml | |
| 2024-03-08 12:13:45,446 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:50,446 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:13:55,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:13:55,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:13:55,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:13:55,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:00,465 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:05,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:09,772 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:14:10,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:14:10,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:14:10,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:14:11,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:16,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:21,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:14:25,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:14:25,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:14:26,465 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:31,466 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:36,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:39,773 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:14:40,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:14:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:14:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:14:42,466 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:47,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:52,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:14:55,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:14:55,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:14:55,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:14:58,403 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:03,404 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:08,405 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:09,774 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:15:10,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:15:10,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:15:10,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:15:12,401 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 12:15:12,402 DEBUG SenderThread:10843 [sender.py:send():378] send: history | |
| 2024-03-08 12:15:12,403 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 12:15:12,403 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 12:15:12,677 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json | |
| 2024-03-08 12:15:14,404 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:19,405 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:24,406 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:15:25,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:15:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:15:29,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:34,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:39,416 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:39,775 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:15:40,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:15:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:15:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:15:44,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:49,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:54,470 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:15:55,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:15:55,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:15:55,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:16:00,453 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:05,454 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:09,775 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:16:10,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:16:10,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:16:10,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:16:11,398 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:16,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:21,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:25,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:16:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:16:25,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:16:26,495 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:31,496 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:36,497 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:39,776 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:16:40,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:16:40,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:16:40,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:16:42,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:47,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:52,392 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:16:55,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:16:55,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:16:55,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:16:58,386 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:03,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:07,644 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 12:17:07,646 DEBUG SenderThread:10843 [sender.py:send():378] send: history | |
| 2024-03-08 12:17:07,646 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 12:17:07,646 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 12:17:07,717 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json | |
| 2024-03-08 12:17:08,647 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:09,777 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:17:10,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:17:10,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:17:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:17:14,437 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:19,438 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:24,439 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:25,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:17:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:17:25,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:17:30,410 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:35,411 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:39,778 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:17:40,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:17:40,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:17:40,238 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:17:40,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:45,469 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:50,471 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:17:55,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:17:55,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:17:55,238 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:17:56,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:01,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:06,389 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:09,778 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:18:10,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:18:10,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:18:10,238 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:18:12,371 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:17,373 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:22,374 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:25,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:18:25,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:18:25,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:18:27,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:32,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:37,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:39,779 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:18:40,198 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:18:40,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:18:40,238 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:18:43,460 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:48,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:53,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:18:55,198 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:18:55,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:18:55,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:18:59,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:02,958 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 12:19:02,959 DEBUG SenderThread:10843 [sender.py:send():378] send: history | |
| 2024-03-08 12:19:02,959 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 12:19:02,960 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 12:19:03,760 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json | |
| 2024-03-08 12:19:04,960 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:09,780 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:19:10,198 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:19:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:19:10,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:19:10,454 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:15,455 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:20,456 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:25,198 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:19:25,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:19:25,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:19:26,397 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:31,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:36,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:39,781 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:19:40,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:19:40,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:19:40,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:19:41,455 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:46,455 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:51,457 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:19:55,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:19:55,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:19:55,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:19:56,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:01,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:06,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:09,781 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:20:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:20:10,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:20:10,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:20:12,431 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:17,432 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:22,433 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:25,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:20:25,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:20:25,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:20:27,471 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:32,472 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:37,473 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:39,782 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:20:40,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:20:40,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:20:40,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:20:43,385 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:48,386 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:53,386 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:20:55,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:20:55,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:20:55,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:20:57,557 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 12:20:57,559 DEBUG SenderThread:10843 [sender.py:send():378] send: history | |
| 2024-03-08 12:20:57,559 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 12:20:57,560 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 12:20:57,801 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json | |
| 2024-03-08 12:20:58,561 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:03,562 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:08,563 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:09,782 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:21:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:21:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:21:10,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:21:14,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:19,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:24,469 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:25,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:21:25,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:21:25,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:21:30,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:35,389 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:39,783 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:21:40,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:21:40,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:21:40,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:21:40,489 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:45,490 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:50,491 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:21:55,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:21:55,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:21:55,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:21:56,408 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:01,409 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:06,410 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:09,784 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:22:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:22:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:22:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:22:12,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:17,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:22,402 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:25,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:22:25,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:22:25,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:22:27,411 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:32,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:37,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:39,785 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:22:40,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:22:40,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:22:40,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:22:42,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:47,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:52,161 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 12:22:52,162 DEBUG SenderThread:10843 [sender.py:send():378] send: history | |
| 2024-03-08 12:22:52,163 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 12:22:52,163 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 12:22:52,839 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json | |
| 2024-03-08 12:22:53,164 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:22:55,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:22:55,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:22:55,204 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:22:58,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:03,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:08,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:09,786 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:23:10,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:23:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:23:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:23:13,481 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:18,482 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:23,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:25,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:23:25,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:23:25,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:23:29,479 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:34,480 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:39,481 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:39,786 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:23:40,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:23:40,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:23:40,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:23:45,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:50,393 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:23:55,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:23:55,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:23:55,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:23:55,482 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:00,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:05,484 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:09,787 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:24:10,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:24:10,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:24:10,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:24:11,458 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:16,459 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:21,460 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:25,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:24:25,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:24:25,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:24:27,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:32,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:37,390 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:39,788 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:24:40,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:24:40,203 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:24:40,243 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:24:42,441 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:46,078 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history | |
| 2024-03-08 12:24:46,079 DEBUG SenderThread:10843 [sender.py:send():378] send: history | |
| 2024-03-08 12:24:46,080 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record | |
| 2024-03-08 12:24:46,080 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end | |
| 2024-03-08 12:24:46,879 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json | |
| 2024-03-08 12:24:48,081 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:53,082 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:24:55,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:24:55,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2024-03-08 12:24:55,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:24:58,475 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:25:03,477 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:25:08,478 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report | |
| 2024-03-08 12:25:09,789 DEBUG SenderThread:10843 [sender.py:send():378] send: stats | |
| 2024-03-08 12:25:10,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status | |
| 2024-03-08 12:25:10,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status | |
| 2024-03-08 12:25:10,244 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages | |